SDF Labs

We’re thrilled to announce that SDF is joining forces with @dbt_labs! Together, we’re setting out to transform data development and analytics for the better. Read more about this exciting milestone here: getdbt.com/blog/dbt-labs-acq…

Join us at Seattle's first ever Datafusion meetup, sponsored by SDF Labs and Spice AI. Monday, October 14th, 5:30p to 8:30p lu.ma/tnwl866b

🚀 Big news: @SDFLabs & @dagster Integration is here! 👉 Shorter feedback loops, reduced cloud costs, and true column-level lineage — all in one integrated toolchain. Ready to elevate your data game? Check out our latest blog post on the integration. blog.sdf.com/p/sdf-and-dagst…

This is a big day for @dagster and SDF! Congratulations to the folks at @dagster for a phenomenal 1.8 release. More on our integration coming next week.

Returning to the office from holiday season, a time when most employees hope to pick up where they left off without issues, Patreon’s team discovered a mismatch between their realized customer signups and reported statistics from their data warehouse. When multiple data sets were found to not be updating properly, data engineers at Patreon quickly turned to @SDFLabs to provide visualized data lineage of their queries and models to locate the root cause. Learn how an industry leader simplifies their path to detailed insights within seconds by utilizing SDF Cloud: sdf.com/success-stories/acce…

We are thrilled to introduce our latest feature to the cloud: Report Visualizations! 🎉 Ever wanted to quickly understand all unused columns in your warehouse? Or how about a breakdown of the queries with the most dependencies? Try SDF Reports! SDF Reports are SQL queries that run against SDF's information schema, enabling you to analyze your warehouse and metadata. They are an essential tool for tracking and analyzing business logic, datatypes, and metadata throughout your data warehouse. Our sleek new dashboard shows you and your entire team all your created reports at a glance, with the query output and key details all neatly displayed. Whether you’re running data deletion reports or performing dead column analysis, we’ve got you covered. We’ve designed this feature to empower members across all teams to unlock deeper insights into your data with a sleek, user-friendly interface. Learn more in our Cloud Reporting doc. docs.sdf.com/cloud/reporting

Linqto’s Director of Data Engineering, Chris Hronek, experienced massive growth of his data warehouse, his team, and the complexity of requests he received -- a common occurrence for cutting edge data leaders. Chris found himself at a crossroads: pursue the conventional data stack to address the increasing demands on financial reporting analytics or find an alternative that met his data development goals. That’s when Chris turned to SDF to gain a complete understanding of his data warehouse and improve Linqto’s transformation layer. Learn how Chris and the Linqto team increased confidence in their decisions and the quality of their data warehouse. sdf.com/success-stories/fast…

Looking for an easy way to learn about the next generation of data engineering tooling? SDF has a new tutorial with no setup required. Download the our command line interface (CLI) and walk through a series of short tutorials to explore SDF locally on your machine. Our tutorial series "Mom's Flower Shop" takes you through SDF's standout features with a dataset inspired by an actual flower shop run by SDF cofounder Elias DeFaria's mother. Tag a data engineer you'd trust with your flower shop data! 🌷 docs.sdf.com/tutorials/tutor…

You may have already seen it this previous week, but as a reminder SDF Labs announced a public beta of the SDF CLI! 🎉 docs.sdf.com/introduction/in… We have been moving at such a fast pace, releasing new features, patches, and bug fixes that we often near the end of the week and don’t take a moment to look back at the immense progress. We’re starting a semi-weekly series to solve that problem and benefit the users of SDF with a concise update on new docs, features, patches, upcoming events, and news from our team. To subscribe, join our new Slack Community (join.slack.com/t/sdfcommunit…) and our Email List (sdf.com/). — Notes from this past week — Better support for local sources, performance improvements, and table & column descriptions propagate to Snowflake 10x faster schema download from Snowflake. This was a major bottleneck for several large scale customers pulling down metadata. Table and column descriptions in .sdf.yml files are now propagated up to Snowflake via the materialized query. This change was accomplished via the open source materializations lib. Workspace credentials are now live in the SDF Cloud

A huge amount of data tooling is Python or Java - we've been asked "what makes Rust different". Here’s 5 Reasons we built SDF Labs in Rust, from the ground up: Zero Dependency Deployments, Performance, Ecosystem & Tooling, Native Parallelism, and Vertical Integration

SDF, the evolution of data transformation, is officially in Public Beta 🎉. We raised $9M from RTP Global, Two Sigma, Founders Co-op. SDF is free to use and built on an open source core. Install our CLI (docs.sdf.com/introduction/in…) and join our slack! (join.slack.com/t/sdfcommunit…)

In our most recent blog post, we dive deeper into our analysis of betting on RUST for our product SDF: a SQL compiler, type system, and data build system packaged into a single binary. blog.sdf.com/p/fast-developm… #rustlang