Mahdi Karabiben – Medium

Mahdi Karabiben

Pinned

Published in
Towards Data Science

Data Modeling Techniques for the Post-Modern Data Stack

A set of generic techniques and principles to design a robust, cost-efficient, and scalable data model for your post-modern data stack.

Jul 20

Data Modeling Techniques for the Post-Modern Data Stack

Jul 20

Pinned

Published in
Towards Data Science

Navigating Your Data Platform’s Growing Pains: A Path from Data Mess to Data Mesh

A set of strategies and guiding principles to effectively scale your data platform while maximizing its business impact.

Apr 3

Navigating Your Data Platform’s Growing Pains: A Path from Data Mess to Data Mesh

Apr 3

Pinned

Published in
Zendesk Engineering

dbt at Zendesk — Part I: Setting foundations for scalability

An overview of ED&A’s data transformation patterns and our path towards a dbt-based framework.

May 23, 2023

dbt at Zendesk — Part I: Setting foundations for scalability

May 23, 2023

Pinned

Published in
Towards Data Science

Writing design docs for data pipelines

Exploring the what, why, and how of design docs for data components — and why they matter.

May 22, 2023

Writing design docs for data pipelines

May 22, 2023

Pinned

Published in
Towards Data Science

Building an end-to-end open-source modern data platform

A detailed guide to help you navigate the modern data stack and build your own platform using open-source technologies.

Dec 28, 2021

Building an end-to-end open-source modern data platform

Dec 28, 2021

Published in
The Startup

Your twenties are meant for fun after all — or are they?

Reflecting on turning 30, the messy journey toward becoming the person you’re meant to be, and the key learnings along the way.

Oct 15

Your twenties are meant for fun after all — or are they?

Oct 15

Published in
Towards Data Science

A Simple (Yet Effective) Approach to Implementing Unit Tests for dbt Models

Unit testing dbt models has always been one of the most critical missing pieces of the dbt ecosystem. This article proposes a new unit…

Aug 18, 2023

A Simple (Yet Effective) Approach to Implementing Unit Tests for dbt Models

Aug 18, 2023

Published in
Towards Data Science

Your data catalog shouldn’t be just one more UI

An in-depth look into how an API-focused data catalog can help you ensure the success of your data platform via combining metadata types.

Nov 16, 2022

Your data catalog shouldn’t be just one more UI

Nov 16, 2022

Published in
Towards Data Science

Performing Data Validation at Scale with Soda Core

An in-depth look into the past and present of data validation, and how you can leverage today’s tools to ensure data quality at scale.

May 26, 2022

Performing Data Validation at Scale with Soda Core

May 26, 2022

Thanks for sharing this - the architecture is really impressive and it's great to see Livy…

I experimented with a similar design a couple of years ago but one problem I had with Livy was the fact that it doesn't support concurrent…

Aug 31, 2021

Aug 31, 2021

Mahdi Karabiben

Mahdi Karabiben

It’s all about data, big and small. Website: https://mahdiqb.github.io/ Newsletter: https://dataespresso.substack.com/

Following

Help
Status
About
Careers
Press
Blog
Privacy
Terms
Text to speech
Teams