Object storage catalogs #

Object storage is a data storage mechanism that organizes data as objects rather than as blocks and sectors or as file systems. Each object is associated with metadata and a globally unique identifier.

The benefits of object storage are scalability, durability, and the ability to handle large amounts of structured or unstructured data. For structured data, object storage is typically organized as one or more table formats, such as Hive, Iceberg, Delta Lake, or Hudi. In Starburst Galaxy, access to structured object storage is mediated through Great Lakes connectivity instead of directly to a table format.

A catalog contains the configuration that allows Starburst Galaxy to access a data source. Read more information about catalogs on the Catalogs overview page.

Access to create and manage catalogs is provided through the Data > Catalogs item in the navigation menu.

Starburst Galaxy supports access to the following object storage systems:

• Amazon S3

• Azure Data Lake Storage

• Google Could Storage

• Tabular

Other useful resources:

• Create an object storage catalog