Can AI Replace Data Engineers? We Tried It.
Ravi Kiran Pagidi
We had a slightly reckless idea: what if we let AI do most of our data engineering work? Not "help with a query here and there," but actually build real pipelines. Azure, Databricks, Delta Lake, the whole thing. Real enterprise data, messy schemas, and stakeholders who will definitely shout if numbers look wrong. I'm a Senior Data Engineer, I work on this stack every day, and I still wanted to see how far we could push AI into my own job. This is what happened when we tried. The Experiment: Lett