Starburst Galaxy release notes #
Starburst Galaxy is updated regularly. The following release notes provide
highlights of user-facing changes available with specific new deployments.
2024 #
December #
16 Dec 2024
- Breaking change: Starburst Galaxy has changed the output of the
SHOW
GRANTS
SQL command. The previous output columns were: Grantor, Grantor Type,
Grantee, Grantee Type, Catalog, Schema, Table, Privilege, Grantable, With
Hierarchy.
The new output columns are: Grantee, Entity kind, Entity, Grant
kind, Privilege, Grantable, Entity owner, Direct owner.
13 Dec 2024
12 Dec 2024
- Starburst Galaxy replaced the use of named cluster sizes (such as
small
,
large
, x-large
) with a slider that controls the number of worker
nodes
for a cluster between 1 and 20, or by entering that number in a text box. An
autoscaling
checkbox allows you to set different numbers for minimum and maximum worker
nodes.
November #
18 Nov 2024
4 Nov 2024
- Starburst Galaxy now publishes
specifications and limits for various
features.
- Galaxy now supports Azure Marketplace as a billing option, either
self-managed with PAYGO, or with a commit contract through the
Starburst deal desk.
September #
9 Sep 2024
- The Starburst Warp Speed feature previously named Index and cache resiliency
was renamed to Fast
warmup.
August #
26 Aug 2024
21 Aug 2024
20 Aug 2024
- Streaming
ingest is
released to public preview as part of Galaxy’s implementation of an
Icehouse architecture.
Early Aug 2024
- The IP allowlist for AWS
regions
was updated to remove the
eu-west-3
region.
- The IP allowlist for Azure
regions
was updated to remove the
France Central
region and add the West US 2
region.
June #
27 Jun 2024
- Public preview support was added for using the
Databricks Unity Catalog as a metastore for AWS
S3
object storage catalogs.
24 Jun 2024
- In most cases, cluster configuration changes are now implemented without
requiring a cluster restart. See the Galaxy cluster
basics
for more information.
20 Jun 2024
- The Data quality
dashboard
is now available as a public preview feature.
- With the right privileges, administrators can now see the status of
Galaxy’s last
indexing
operation for catalogs, schemas, and tables. For index error cases,
administrators can initiate
reindexing.
6 Jun 2024
- The query history pane is now the query
insights pane. Use query
insights to review active and completed queries from the last 30 days.
April #
29 Apr 2024
9 Apr 2024
March #
28 Mar 2024
- Breaking change: The
Elasticsearch
catalog no longer supports Elasticsearch version 6.x or OpenSearch 1.x. Update
Elasticsearch to version 7.x or 8.x to continue using the catalog. To
connect to OpenSearch, use the
OpenSearch catalog.
27 Mar 2024
- Added the Network security
policy
feature, which appears for roles that have the Manage
security
privilege. This feature lets you control incoming traffic to one or more
clusters by specifying a list of allowed and blocked IP addresses.
21 Mar 2024
- Added a new access control privilege: View data
products.
Granting this privilege allows roles to access the description and metadata of
a data product, but not to query the underlying data.
11 Mar 2024
February #
9 Feb 2024
- Added the Allow username/password login account-level privilege, which
only appears on Galaxy accounts with
SSO
enabled. This allows or denies a role from logging in with username and
password when SSO is enabled. The privilege is enabled by default for the
accountadmin
and public
roles.
January #
17 Jan 2024
16 Jan 2024
- The new Jobs section of
the navigation menu leads to a pane where you can create a task to run SQL
data maintenance statements on a recurring schedule.
- Starburst Galaxy now supports SQL
routines, which are custom user-defined
functions written in SQL.
9 Jan 2024
- The query
editor’s
show SQL docs pane now has a new field, Search SQL documentation.
2023 #
December #
18 Dec 2023
- Added a new home page for all
Starburst Galaxy accounts, which welcomes new users and prompts returning
users to continue where they left off.
November #
2 Nov 2023
- The data
profiling feature
at the table and view level of the catalog explorer is now generally
available.
- The query editor
now has embedded SQL documentation, invoked from the Show SQL docs item in
the more_vert
options
menu.
The content is identical to the SQL documentation that is part of the overall
Starburst Galaxy documentation. This is a public
preview feature.
October #
16 Oct 2023
September #
15 Sep 2023
- Added private preview support for showing
data
lineage
in the catalog explorer to visualize the data flow between tables, views, and
materialized views for workloads carried out in Starburst Galaxy.
7 Sep 2023
- Starburst Galaxy now supports Python DataFrames by means of the
PyStarburst and
Ibis
Python libraries.
5 Sep 2023
- If editing a cluster’s configuration is initiated from a catalog explorer
pane, the focus now returns to the catalog explorer instead of to the clusters
pane.
August #
31 Aug 2023
- For new Galaxy accounts, the name of the default example cluster is
now
free-cluster
in place of the previous name, sample
. As before, this
cluster contains a catalog named sample
with schemas burstbank
and demo
.
Clusters named sample
in existing accounts are not automatically renamed.
- At the table and view level in catalog explorer, privileges were previously
shown as calculated for the active role
set
for the current login name. Now they are shown only for the current role.
- In the catalog explorer, a green dot next to a tab name now designates that
tab as a preview feature.
23 Aug 2023
22 Aug 2023
- The Starburst Galaxy UI was refreshed with new colors, fonts, and icons.
- FTE
support was updated with adaptive partitioning, which improves performance
by making sure that only the largest, most complex queries allocate the full
set of partitions.
17 Aug 2023
- In Starburst Galaxy documentation, scroll bars were added to the navigation
menu and to the current page menu for tall pages.
11 Aug 2023
1 Aug 2023
- Added public preview support for column
masks. Add column masks to a policy to
further define access control permissions by determining how a column’s value
is displayed to users.
July #
28 July 2023
- The following Starburst Galaxy features have emerged from public preview
status and are now generally available:
- Added support for materialized views in Great Lakes
connectivity.
Galaxy distinguishes materialized views from tables and views in the
query editor and catalog explorer.
27 July 2023
- Clicking a tag in Access control > Tags or anywhere in the catalog
explorer results in
a universal search for that tag name, which shows all the places that tag is
assigned.
19 July 2023
11 July 2023
- Updated content of the CSV file generated by clicking Download in the
Admin > Usage and billing >
Usage
tab to include a daily breakdown of cluster usage.
10 July 2023
- Added support for assigning default roles from the options menu in the
Users
pane.
June #
22 June 2023
20 June 2023
- Renamed global search to universal search.
16 June 2023
- Added support for Druid
catalogs.
- Added support for policy expirations. An expiration date and time can be added
when creating or editing a
policy.
- Added public preview support for Row filters,
allowing you to further define access control conditions to determine which
rows of data a user can see, as part of attribute-based access control
policies.
13 June 2023
- Added support for assigning multiple roles for Service
accounts.
- Added support for Apache Pinot
catalogs.
- Added page titles to Galaxy panes to improve navigation in browser history and
to provide titles for browser tabs.
- Improved usability and updated the look of dialogs in the Notification
settings pane.
- Fixed issue with the Asset owner checkbox in Notification
settings, no longer
forced to receive notifications.
May #
26 May 2023
25 May 2023
24 May 2023
16 May 2023
12 May 2023
- Fixed usability issues when attempting to add a contact to the Contacts
metadata field in catalog explorer panes, if the contact is not already
present in the account’s list of users.
10 May 2023
- Added public preview support for schema discovery. Use schema discovery even
on suspended clusters to find new files and changes in your object storage
locations.
- Added daily usage
reports
for admins in table and chart formats.
9 May 2023
4 May 2023
- Added public preview support for schema-based data
products. Data
products provide a collection of curated, high-quality related datasets and
relevant metadata.
- Improved responsiveness and updated the look of the Cluster
list.
- Added support for
MariaDB
catalogs.
- Added the ability to revoke catalog, schema, and table privileges from
catalog explorer
panes.
April #
25 Apr 2023
- Removed support for deprecated connection formats in MongoDB catalogs.
- Fixed an issue that caused buttons to overlap in the
clusters pane on small width screens.
20 Apr 2023
- Added Audit log panes to the
schema and
table levels of the catalog
explorer.
- Replaced the Start and Stop actions for clusters with a new
Enabled
switch in the clusters list. The Stopped cluster state was renamed to
Not enabled. See Cluster status and
transitions
for more information.
18 Apr 2023
- Fixed an issue that allowed users who were denied access to a cluster to
start and stop the cluster.
17 Apr 2023
11 Apr 2023
- Added Zing Data to the Connection information.
Only Copy details are available. Downloading the connection file is not
supported by Zing Data.
- Added a collapse and expand icon for the results panel in the Query
editor.
- Fixed an issue that caused the display of incorrect column names in the roles
and privileges pane.
6 Apr 2023
- Enabled case-insensitive name matching for MongoDB objects.
- Added catalog logos to the query editor to visually
indicate
each cluster’s connected data sources.
5 Apr 2023
- Added public preview support for global
search. Use global search to search through
your data entities across Starburst Galaxy.
- Added public preview support for schema, table, view, and column name
auto-completion
in the query editor.
4 Apr 2023
- Added support for AWS access key authentication to the Amazon
Redshift catalog.
- Fixed an issue that prevented the Google
Sheets
catalog from being linked to any cluster regions.
- Added display for the definition of
schemas, tables and
views in the catalog
explorer.
March #
31 Mar 2023
29 Mar 2023
- Added public preview support for tags. Assign
tags to entities in the catalog explorer.
- Added public preview support for attribute-based access control
policies.
Combine policies and attributes, such as tags, to further manage role access
to your entities.
27 Mar 2023
- Added support for
Tabular
catalogs.
22 Mar 2023
- In lists, the more_vert options menu moved to the right side of each
row and the redundant edit pen icon was removed. This
applies to the lists of Saved
queries,
Users,
Roles,
and service
accounts.
- Added the ability to preserve the collapsed or expanded state of nodes when
switching between tabs in the query
editor.
- In the catalog explorer, selecting a node now automatically opens the detail
pane for that node. Likewise, selecting a data entity in the detail pane now
highlights that node in the explorer tree.
20 Mar 2023
- Fixed an issue that caused the Add privilege dialog to close if it opened
before metadata was loaded in the catalog
explorer.
16 Mar 2023
- The cluster
explorer
in the query editor no longer needs clusters to be running to expand the
cluster. This lets you write a full query without a running cluster, waiting
to start the cluster until you are ready to execute the query.
- Added support for Google
Sheets
catalogs.
14 Mar 2023
February #
27 Feb 2023
16 Feb 2023
- Added a View details option to the query editor options
menu that opens
the explorer page for the current catalog, schema, table, view, or column.
15 Feb 2023
10 Feb 2023
- Fixed issue with autoscaling clusters not scaling up correctly.
9 Feb 2023
January #
25 Jan 2023
- Added a notification system shown as a bell icon in Galaxy’s banner
header.
17 Jan 2023
6 Jan 2023
- Added support for editing shared
query access rights based on role.
- Added auto-completion support for table aliases in the query
editor.
2022 #
December #
13 Dec 2022
- Fixed behavior issue with the < Back button on the query details page.
- Fixed bug that caused clusters to be de-selected when refreshing the edit
cluster schedule page.
8 Dec 2022
- Changed the navigation menu to be
collapsible into icons only. Submenus are still visible by hovering over an
icon.
- Fixed an issue that caused the Top tables metric to report the wrong
number when grouped by queries.
- Fixed bugs related to browser back button usage.
- Added SSH tunnel support for Elasticsearch.
6 Dec 2022
- Added a warning banner to the cluster creation dialog when enabling resource
intensive query processing mode.
- Fixed bug that prevented access control rules from correctly limiting the
list.
- Fixed issue that caused the MongoDB edit connection form to fail.
- Fixed issue that prevented users from deleting certain cluster schedules.
November #
28 Nov 2022
- Added public preview support for catalog
explorer, which allows users to discover data
without running a cluster.
10 Nov 2022
8 Nov 2022
- Fixed bug that caused the delete button to hang when deleting a custom
cluster autoscale configuration.
4 Nov 2022
- Added read-write access to MongoDB catalogs that
are configured with single node deployment or that configure replica sets
across the same cloud provider region.
1 Nov 2022
- Added a new catalog: public preview support for
Elasticsearch
data platforms, including Amazon OpenSearch Service.
October #
25 Oct 2022
- Fixed bug that prevented granting the same privilege to more than one entity
in certain cases.
20 Oct 2022
- Updated the Show/Hide filters UI on the Query
history panel. A date selection is now required
with Today as the default. Simplified and clarified adding other filter
criteria.
- Restricted query history to 90 days back from today’s date.
18 Oct 2022
- Added public preview support for read-only access to existing
Hudi tables in the supported cloud object
stores Amazon S3, Azure ADLS, and Google Cloud.
- Added support for connecting to MongoDB instances using an SSH tunnel to a
bastion host.
- Added a link to these release notes in the Starburst Galaxy Help menu.
11 Oct 2022
- Extended single sign-on support to include custom identity providers.
- Fixed a bug that allowed creation of privileges for write operations in
read-only catalogs.
4 Oct 2022
- Added support for Google BigQuery catalogs to read views (but not materialized
views).
September #
29 Sep 2022
- Added another tutorial, Federate multiple data
sources that shows how to join two data
sources in different catalogs with the same query.
- Reorganized the Admin > Cloud settings panes, with new SSH tunnels
sections added for both AWS and Azure.
- Renamed the built-in metastore option for object storage catalogs to the
Starburst Galaxy metastore.
26 Sep 2022
- Added a tutorial, Query the COVID-19 data
lake that shows how to use the free
research datasets provided by AWS.
- Added support for the SQL MERGE statement.
- Added Shared with me in the Saved queries pane that allows you to
share saved queries with one or more roles for editing collaboration.
22 Sep 2022
- Added support for read-only
Snowflake
catalogs on Google Cloud.
15 Sep 2022
- Added a new location
privilege
which allows you to restrict or allow access to object storage locations.
14 Sep 2022
August #
26 Aug 2022
- Added a new catalog: public preview, read-only support for Google
BigQuery
warehouses.
- Added a new catalog: public preview, support for MongoDB or MongoDB
Atlas
data platforms.
- Added a Run all (limit 1000) option to the Run button so that
selecting the queries to run is no longer required.
18 Aug 2022
- Added an onboarding workflow when signing up for a new Galaxy
account that gathers information on Galaxy use cases and preferred
data sources.
- Updated the UI that manages roles and privileges to clarify the process.
11 Aug 2022
- Added customization of the cluster autoscaling feature from navigation menu
Admin > Cluster configuration, which allows you to create a named set of
minimum and maximum number or worker nodes. This is a public preview feature.
4 Aug 2022
2 Aug 2022
- Added support for connecting a Snowflake
database
as a data source. Supported as a public preview on AWS and Azure clouds.
- Added public preview support for schema
discovery
of catalogs in object store data sources only.
July #
30 July 2022
28 July 2022
- Added an option to never suspend a cluster.
26 July 2022
June #
28 June 2022
- Added support for connecting to Azure
Synapse.
- Added automatic persistence across sessions of catalog and schema selections
per tab in the query editor.
16 June 2022
14 June 2022
- Added support for table and view
privileges
and entities.
- Added the ability for users to save queries from the query editor to a
separate list of named queries.
May #
17 May 2022
4 May 2022
April #
29 Apr 2022
- Added autocomplete for SQL functions and inline documentation in the query
editor.
- Added dedicated Admin > Cloud settings section for AWS to manage IAM roles.
15 Apr 2022
- Added the ability to download a query result set directly from the query
editor. Result sets with more than 1000 rows are allowed.
March #
22 Mar 2022
- Added support for connecting to SQL
Server
data sources.
8 Mar 2022
- Added support for personal query history by role.
- Added support for autocomplete SQL grammar in the query editor. Valid keywords
such as
SELECT
, FROM
, WHERE
, LIKE
, and others are suggested when
appropriate to speed up your query writing.
3 Mar 2022
February #
18 Feb 2022
January #
Jan 2022
- Added support for authentication with a cross-account IAM role in S3
catalogs.
2021 #
Initial deployments to first public launch with cluster
management, a set of supported
catalogs, query
editor,
authentication and access control, and
more.
Is the information on this page helpful?