Observability #

Observability is a set of interconnected Starburst Galaxy features:

• Data maintenance
• Data quality
• Data lineage

Data observability provides the ability to gain visibility into your data, identify when your data has gone wrong, and investigate potential issues within your data easily.

With the introduction of data observability capabilities, your data teams can:

• Gain visibility into the statistics and shape of your data lake tables.
• Work with data consumers to define pass or fail quality rules for consumption.
• Quickly identify potential origins of issues and downstream impact of the issues.

Data maintenance #

Create data maintenance jobs to run tasks that improve performance and reduce storage in Iceberg tables. See Data quality for further information.

Data quality #

View the results of data quality checks or create new data quality checks. See Data quality for further information.

Data lineage #

Data lineage lets you track the history of tables that were copied or updated from other tables to help you understand how your data has changed over time.

To access lineage, navigate to a table, view, or materialized view level entity of the catalog explorer and click the Lineage tab.

See Data lineage for further information.