Pipelines suck

Pipelines suck

  • 4 posts

We're Building the AI Revolution on Infrastructure We Know Is Broken

And we're all just pretending it's going to work out fine A data scientist told me something that perfectly captures our industry's delusion: "I spend most of my time wrangling data. I can't trust my data engineers because they don'

End Pipeline Bull$#*! — AI Is Counting on Us to Call It Like It Is

There’s a moment we kept seeing at ODSC East last week. Someone would be walking by, scanning booths like we all do at conferences—half-looking for free stuff, half-trying to avoid eye contact—and then they’d stop. Dead in their tracks. Not for a t-shirt. Not for a

Between a Rock and a Cloud Bill

You’re Doing ETL Wrong – Here’s a Better Way If you’re still managing your ETL/ELT pipelines like it’s 2015, it’s time to rethink your approach. The recent pricing change by Fivetran is just another glaring example of why the current trend in data integration is

Imagine a world where data flows freely

At Matterbeam, we've developed an innovative model that addresses the pervasive complexity hindering effective data utilization in today’s companies. Our model moves away from traditional data pipelines, instead offering a framework built on the principles of immutability, transformation, composability, replication, domain-driven design, and streaming. For those who