Missed the latest Unity Catalog Community Sync? Catch up on the road to 1.0: production hardening, Helm charts, PostgreSQL & MySQL support and a new docs site.
▶️ Watch: youtube.com/watch?v=BvQ4sN6d…
Next sync: Tue, Dec 1. RSVP 👉 luma.com/qc16zibx
#UnityCatalog
37
The Unity Catalog website has a new look 👀
It's now easier to find the features, ecosystem, docs, API, blog, and events, plus quick links to GitHub, Slack, and getting started.
Check it out ➡️ unitycatalog.io/
1
50
.@newfront walked through Unity Catalog's evolution at our recent Open Lakehouse + AI meetup: native Iceberg REST, catalog-managed tables, credential vending, metric views, and the Labels API.
He also covers the roadmap: APPLY TAG, ABAC policies, MCP servers, and AI gateways.
Watch the full session ⬇️
youtube.com/watch?v=XAU1GgDO…
📣 Our next Unity Catalog Community Sync is coming up on Tuesday, November 17!
This is a dedicated space for maintainers and developers to connect on roadmap updates, dive into ongoing development, and work through technical challenges together. Bring your questions and join the discussion.
🗓️ Tues, Nov 17
🕓 8:00 AM PT
Save your spot ⬇️
luma.com/rxdhaocl
⏰ Reminder! The Unity Catalog Community Sync is tomorrow, Tuesday, Nov 3 at 8:00 AM PT.
This is a dedicated technical session for maintainers, active contributors, and developers who want to start contributing. It is focused on ongoing development, technical challenges, and community-driven roadmap updates.
👉 Register: luma.com/7yhjboww
#UnityCatalog #OpenSource
📣 Join us for the next Unity Catalog Community Sync on Tuesday, Nov 3.
This is a dedicated technical session for maintainers, active contributors, and developers who want to start contributing. It is focused on ongoing development, technical challenges, and community-driven roadmap updates. Bring questions and take part in the discussion.
🗓️ Tues, Nov 3
🕗 8:00 AM PT
👉 Register: luma.com/7yhjboww
#UnityCatalog #OpenSource
50
“What were our earnings last quarter?” If you get different answers, the KPI is not governed.
Metric views define a KPI once in Unity Catalog so humans and agents report the same value.
This post shows how to register a metric view as a Unity Catalog securable, add agent metadata, and query it with MEASURE in @ApacheSpark.
Check it out 👇
unitycatalog.io/blogs/uc-met…
#UnityCatalog #MetricViews #DataGovernance
35
📣 Join us for the next Unity Catalog Community Sync!
We’ll cover what is in flight for the upcoming Unity Catalog v0.8.0 release, including local S3 support, walk through the new UI preview, and open the floor for questions with maintainers and the community.
🗓️ Tuesday, October 20
🕗 8:00 AM PT
👉 Register: luma.com/gy8naenq
#UnityCatalog #OpenLakehouse #OpenSource
43
Native @ApacheIceberg writes are in Unity Catalog 0.7.0! 🧊
Until now, Iceberg support in Unity Catalog was read-only and needed Delta UniForm to generate Iceberg metadata. 0.7.0 adds the write side of the Iceberg REST catalog, so you can create, commit to, rename, and drop native Iceberg tables. No UniForm required.
This post walks through it:
🔹 Spark and PyIceberg reading and writing the same managed tables
🔐 The same USE CATALOG, USE SCHEMA, and SELECT grants across engines
💻 A local setup with unitycatalog-playground v0.2.0
Learn more: unitycatalog.io/blogs/unity-…
#UnityCatalog #ApacheIceberg
Reminder: The Unity Catalog Community Sync is tomorrow! 🚨
Join us for a recap of v0.7, a sneak peek at the v0.8 roadmap, and live Q&A with the maintainers.
📅 Tomorrow, Oct 6
🕝 8:00 AM PT / 17:00 CEST
📍 Virtual
RSVP here: luma.com/uc-sync1
#UnityCatalog #AI #DataGovernance
1
50
Join us for next week’s Unity Catalog Community Sync: v0.7 recap, a first look at v0.8, and Q&A with the maintainers!
We’ll walk through what shipped in v0.7, share the v0.8 roadmap, and open the floor for questions and feedback.
📅 Tues, Oct 6
🕗 8:00 AM PT / 17:00 CEST
📍 Virtual
Register 👉 luma.com/uc-sync1
#UnityCatalog #DataGovernance #AI
58
Control, choice, and cost in an open lakehouse for AI agents. 👇
This conversation explores Unity Catalog as an open metadata center across @ApacheSpark, @DeltaLakeOSS, and @ApacheIceberg.
🔐 Fine-grained access for humans and agents
🔄 Open standards for swapping engines and formats
💰 Compute, token, and iteration costs with MLflow
🎥 Watch: youtube.com/watch?v=BsxGjbNW…
#OpenLakehouse #UnityCatalog #ApacheIceberg
160
New Open Lakehouse + AI episode now available! Stop shipping 3 versions of annual revenue. 👇
Scott Haines and Lisa Cao on metric views in Spark 4.2.
📄 One YAML KPI. Catalog serves it globally.
🤖 Same number for dashboards, agents, and AI/BI.
🔗 Native interop with Unity Catalog.
🎥 youtu.be/JJkkOBLPge4
#openlakehouse #unitycatalog #apachespark
Ask three teams for last quarter’s earnings. Get three numbers.
Metric views in Unity Catalog define the KPI once (YAML: source, joins, filters, dimensions, measures). Humans and agents query the same number. Spark uses MEASURE().
Try it on Unity Catalog 0.6 with Apache Spark 4.3.
🔗 Learn more: unitycatalog.io/blogs/uc-met…
#UnityCatalog #MetricViews #ApacheSpark #OpenSource
1
95
Introducing the UC Delta API in Unity Catalog 0.5 👇
🔹 Versioned, discoverable, atomic REST surface.
🔹 Native Delta wire format and intent-based commits.
🔹 Run it locally with Spark or DuckDB.
Read the full post: unitycatalog.io/blogs/unity-…
#UnityCatalog #DeltaLake
[Ep 1] Open Lakehouse + AI: The Catalog Layer, Interoperability & AI-Agent Governance
Learn how composable lakehouses center the catalog for metadata, versioning, and commit coordination. 👇
🔸 Interop: Iceberg REST, Unity Catalog (OSS), Spark, Delta Lake, Delta-RS, Iceberg.
🔸 Governance: credential vending, row/col filters, column masks, audits, and why “no governance was the easiest governance.”
🔸 Agents as data customers (Temporal). Fine-grained access beats blanket credentials on 24/7 workloads.
🎥 Full episode: youtube.com/watch?v=dEFAkS7v…
#OpenLakehouse #UnityCatalog @ApacheSpark @ApacheIceberg @DeltaLakeOSS
Simplified Governance with Catalog-Managed Tables 🌐
Unity Catalog 0.4.0 introduces support for UC managed tables, enabling data teams to centrally govern, discover, access, and audit their data through Unity Catalog. Instead of relying on scattered storage paths, separate credentials, and manual maintenance, teams can rely on Unity Catalog as the single logical system of record for their data estate.
Leverage UC managed tables to strengthen governance, improve performance, and build on the most modern open catalog for the data and AI era.
📖 Check out the announcement and implementation details on the Unity Catalog blog: lnkd.in/eZWkMBaR
#unitycatalog #governance #opensource #catalogs #deltalake
1
2
147
With UC managed tables, teams unlock:
🔸 𝗨𝗻𝗶𝗳𝗶𝗲𝗱 𝗴𝗼𝘃𝗲𝗿𝗻𝗮𝗻𝗰𝗲: Unity Catalog centralizes access control, replacing fragmented storage-level policies. This simplifies how teams ensure all engines access data in a governed, consistent manner.
🔸 𝗦𝘁𝗮𝗻𝗱𝗮𝗿𝗱𝗶𝘇𝗲𝗱 𝗱𝗶𝘀𝗰𝗼𝘃𝗲𝗿𝘆: Unity Catalog provides stable logical table identifiers, eliminating the need for clients to depend on physical storage paths for discovery.
🔸 𝗘𝗳𝗳𝗼𝗿𝘁𝗹𝗲𝘀𝘀 𝘁𝗮𝗯𝗹𝗲 𝗼𝗽𝘁𝗶𝗺𝗶𝘇𝗮𝘁𝗶𝗼𝗻𝘀: By automating storage tuning and credential management, Unity Catalog removes the burden of manual operational maintenance from data teams.
🔸 𝗛𝗼𝗹𝗶𝘀𝘁𝗶𝗰 𝗮𝘂𝗱𝗶𝘁𝗮𝗯𝗶𝗹𝗶𝘁𝘆: Metadata and permissions are centralized in a single interface, allowing for high-level oversight of ownership and access instead of parsing low-level storage logs.
🔸 𝗘𝗻𝗳𝗼𝗿𝗰𝗲𝗮𝗯𝗹𝗲 𝗰𝗼𝗻𝘀𝘁𝗿𝗮𝗶𝗻𝘁𝘀: Unity Catalog can authoritatively validate or reject schema and constraint changes, preventing incompatible updates that could compromise data integrity or break downstream workloads.
🔸 𝗙𝗮𝘀𝘁𝗲𝗿 𝗾𝘂𝗲𝗿𝘆 𝗽𝗹𝗮𝗻𝗻𝗶𝗻𝗴 𝗮𝗻𝗱 𝗳𝗮𝘀𝘁𝗲𝗿 𝘄𝗿𝗶𝘁𝗲𝘀: Unity Catalog delivers table metadata directly to Delta clients, bypassing cloud storage requests to significantly reduce metadata latency and accelerate query planning and writes.
69
We are excited to announce 𝗨𝗻𝗶𝘁𝘆 𝗖𝗮𝘁𝗮𝗹𝗼𝗴 𝟬.𝟰.𝟬 which includes exciting new features and many bug-fixes and improvements! 🎊
Check out some of the highlights 👇
𝗨𝗖 𝗦𝗲𝗿𝘃𝗲𝗿
⚙️ Storage Credentials for AWS
⚙️ External Locations for AWS
⚙️ Managed storage location for catalogs and schemas
𝗨𝗖 𝗦𝗽𝗮𝗿𝗸 𝗖𝗼𝗻𝗻𝗲𝗰𝘁𝗼𝗿
⚡ Credential Renewal Enabled by Default
⚡ Support for Spark 4.1 and Delta 4.1
⚡ Atomic CTAS for Delta Tables in UCSingleCatalog
𝗨𝗖 𝗔𝗜
🤖 DSPY Integration with AI Functions
A huge thank you to the awesome community who made this release possible!
📖 Full release notes: github.com/unitycatalog/unit…
#unitycatalog #opensource #oss
1
120









