Starburst Galaxy

  •  Get started

  •  Working with data

  •  Data engineering

  •  Developer tools

  •  Cluster administration

  •  Security and compliance

  •  Troubleshooting

  • Galaxy status

  •  Reference

  • Specifications #

    This page describes various specifications related to Starburst Galaxy. Because Galaxy is a shared resource, these specifications are defined in order to provide the optimal user experience. Specifications are divided into related sections, for example, to view specifications related to Galaxy’s built-in access control, navigate to the access control section.

    Catalogs and clusters #

    The following table lists resource quotas for entities related to catalogs and clusters:

    Resource Description Default value
    Max active free clusters The maximum number of active free clusters you can have on your account. 3
    Max catalogs per cluster The maximum number of catalogs per cluster you can have on your account. 25
    Cross-region read limit per worker (GB) The maximum amount of data that can be read per cross-region worker. 20
    Cross-region write limit per worker (GB) The maximum amount of data that can be written per cross-region worker. 20
    Query max run time (minutes) The maximum allowed time for a query to be processed on the cluster before it is terminated. 240
    Query length The maximum number of characters allowed for the SQL query text. 1000000
    Max clusters The maximum number of clusters you can have on your account. 30
    Max data products The maximum number of data products you can have on your account. 250
    Max lineage age The maximum number of days data lineage is stored for your account. 30

    Access control #

    The following table lists resource quotas for entities related to access control:

    Resource Description Default value
    Max column masks per account The maximum number of column masks you can have on your account. 100
    Max policies per account The maximum number of a policies you can have on your account. 100000
    Max privilege grants per account The maximum number of privilege grants you can have on your account. 500000
    Max roles per account The maximum number of roles you can have on your account. 1000
    Max row filters per account The maximum number of row filters you can have on your account. 100
    Max service accounts per account The maximum number of service accounts you can have on your account. 30
    Max service account tokens per account The maximum number of service account tokens you can have on your account. 100
    Max tags per account The maximum number of tags you can have on your account. 1000
    Max users per account The maximum number of users you can have on your account. 1000

    Indexing and data discovery #

    The following table lists resource quotas for entities related to indexing and data discovery:

    Resource Description Default value
    Max scheduled jobs per account The maximum number of active scheduled SQL statement jobs you can have on your account. 40
    Max concurrent account work tasks per instance The maximum number of concurrent account work tasks per instance. 100
    Max columns per table per schema per catalog for indexing The maximum number of columns you can have for indexing per table per schema per catalog. 10000
    Max schemas per catalog for indexing The maximum number of schemas you can have for indexing per catalog. 500
    Max tables per schema per catalog for indexing The maximum number of tables you can have for indexing per schema per catalog. 10000
    Minutes between user requested account re-indexing The total time in minutes before a user can request re-indexing. 5

    Streaming ingest #

    The following table lists resource quotas for entities related to streaming ingest:

    Resource Description Default value
    Maximum streaming ingest live tables per account The maximum number of streaming ingest live tables you can have on your account. 5
    Maximum MB/s of streaming ingest The maximum amount of streaming data you can have on your account at one time. 40