We built a new product @archdotdev to make the working lives of data engineers better.
We dogfood it daily so we can run customer data pipelines as efficiently as possible.
Short version: when a pipeline fails, we get you back to green asap with automated PRs
Long version 🧵
This Wed at #OSAcon as @pat_nadolny, Sr software #engineer at @ArchDotDev (the creators of Meltano), discusses ETL in the #LLM app ecosystem. Explore new data pipeline needs in the AI space & how we can apply data engineering principles to solve them.
🔗 osacon.io/