Ozone storage support

The distributed object storage Apache Ozone is compatible with Amazon S3 using the S3 Gateway.

Starburst also supports the ofs:// (Ozone File System) protocol. This allows you to access data in a Hadoop ecosystem through Ozone’s native file interface.

Ozone is supported by the following connectors:

• Delta Lake connector

• Starburst Hive connector

• Iceberg connector

Requirements

The requirements of the connector apply when using Ozone as the storage backend. This specifically includes the configured metastore and the network access between the cluster and the storage.

S3 configuration

Ozone is fully compatible with Amazon S3 and as a result all related S3 configuration information applies.

Ozone File System configuration

To use the ofs:// protocol, ensure that fs.hadoop.enabled is set to true in your catalog properties file.

To configure the Starburst Hive connector for use with the ofs:// protocol, ensure that hive.temporary-staging-directory-enabled is set to false in your catalog properties file.