Metastore options #

Metastores map files in distributed objects stores such as S3 and HDFS into tables, and provide metadata such as columns names and type mapping. Metastores also provide data to the cost-based optimizer. A metastore service is required for Starburst Enterprise platform (SEP) and Starburst Galaxy for numerous use cases, including the following:

• Querying object storage systems with connectors such as Hive, Iceberg, Delta Lake and others in SEP, or with object storage catalogs in Starburst Galaxy.
• Creation of views or materialized views.
• Use of data products and cache service in SEP.

The following metastores options are available:

Starburst Galaxy #

Starburst Galaxy provides a built-in metastore that requires no additional installation.

For S3 catalogs, you can use AWS Glue.

You can also run and connect your self-managed Hive Metastore Service deployment.

Starburst Enterprise #

SEP includes a Helm chart to manage your own Hive Metastore for the cluster in Kubernetes.

For catalogs using the Hive, Delta Lake or Iceberg connector with data stored on AWS, you can use AWS Glue.

You can also run and connect your self-managed Hive Metastore Service deployment.