Kafka streaming ingestion #

Starburst Galaxy’s streaming ingestion service lets you continuously ingest data from a Kafka topic into a managed Iceberg table, also known as a live table. Live tables are stored in your AWS S3 bucket.

Live tables can be queried as part of a Starburst Galaxy cluster or by any query engine that can read Iceberg tables.

This section covers configuring live tables from Kafka and managing streaming data resources:

• Configure a live table from Kafka
• View streaming data resources
• Manage streaming data resources