We went live today (onstage!) with open source Unity Catalog (UC) -- and earlier this morning officially donated UC to LF AI & Data Foundation (where Delta Lake and MLFlow are as well). Unity Catalog is the industry’s only universal catalog for Data and AI:
✅ Interoperable: Universal interface supports any table format and compute engine. In addition to the native UC APIs (coined Unity REST APIs), UC OSS enables broad client compatibility from any Iceberg reader by supporting the Iceberg REST catalog API.
✅ Open: OpenAPI spec and OSS server (Apache 2.0 license) going live tomorrow on Github
✅ Unified governance across tabular data, non-tabular data, and AI assets, such as ML models and generative AI tools
Launch partners include AWS, GCP, Azure, Salesforce, in addition to AI innovators such as Nvidia, LangChain, Tecton, Unstructured + platforms like dbt Labs, Fivetran, Immuta.
Big day for OSS!
Excited to open source Unity Catalog. The key part of this catalog is that it provides metadata to not just structured data, but unstructured data as well as other assets such as AI models. It also fully supports and implements the popular Hive Metastore API and the Iceberg REST API.
![Open Sourcing Unity Catalog]()
Open Sourcing Unity Catalog
databricks.com
