Announcing support for Databricks Delta UniForm tables
Today we are announcing read and write support for Databricks Delta UniForm. You can now use Polytomic to both ETL/ELT data from any sources into Databricks as Delta UniForm tables and Reverse ETL from Delta UniForm tables into any other systems and applications.
What is Delta UniForm?
Delta UniForm ('Universal Format') is a data lakehouse storage format. Rather than being yet another distinct format, it's a unified format that enables compatibility with three existing lakehouse formats, thus avoiding the need to commit to a single one:
- Delta Lake
- Apache Iceberg
- Apache Hudi
Delta UniForm provides this universal compatibility without creating additional copies of your data: a single copy of your data is made compatible with the above formats. This compatibility is achieved at by augmenting the meatadata layer for the underlying Apache Parquet files.
Enabling Delta UniForm support in Polytomic
To enable this, simply check the Enable Delta UniForm tables setting on your Polytomic Databricks connection. That's it 😊.
As always, email us at [email protected] with any questions.