Release 429-e LTS (29 Nov 2023)#

Starburst Enterprise platform (SEP) 429-e LTS is the follow up release to the 429-e STS release and the 423-e LTS release.

This release is a promotion of the original 429-e STS release in November 2023 into a long term support (LTS) release.

The 429-e release includes all improvements from the following Trino releases:

It contains all improvements from the Starburst Enterprise releases since 423-e LTS:

Highlights since 423-e#

Breaking changes#

  • The SEP backend service has been updated to require PostgreSQL 12.0+ when using PostgreSQL as the underlying RDBMS.

  • TIMESTAMP type mapping between MySQL and Trino is no longer TIMESTAMP to TIMESTAMP. The new conversion is MySQL TIMESTAMP to Trino TIMESTAMP WITH TIMEZONE. Depending on the query, mapping from MySQL TIMESTAMP to Trino TIMESTAMP may result in an error message.

  • Privileged access to the attached storage on nodes is no longer required for Starburst Warp Speed cluster configuration in Helm deployments. Existing cluster configurations must be updated, with EKS deployments requiring the addition of a boostrap script. Review and follow the considerations for your platform in the Starburst Warp Speed documentation.

  • The deprecated.hive.metastore.glue-read-properties-based-column-statistics Hive Metastore configuration property and underlying functionality has been removed. You must remove this configuration property or the cluster fails to start.

  • The updated base Docker image for SEP no longer includes curl, vi, nano, sed, awk, grep, and other popular command line tools. Starburst recommends using an init container with a base image that includes your needed command line tools. Guidance on using init containers and selecting suitable base images can be found in our init container documentation.

  • A new autoConfigure property was added to the Starburst Warp Speed Helm chart which defaults to false. Starburst Warp Speed deployments on AKS and GKE upgrading from 426-e that have already been reconfigured to use the filesystem instead of privileged mode must set this property to true or the filesystem is not created. Review and follow the migration guide for detailed instructions for your cloud platform.

  • SEP 427-e uses a base system image that does not contain a system-wide trust store. Trusted, self-signed certificates must now be added to the Java distribution CA certificates located under $JAVA_HOME/lib/security/cacerts.

  • The legacy parse-decimal-literals-as-double configuration property has been removed. Clusters that use this property must have it removed from configuration or the cluster does not start.

  • The following deprecated task writer configuration properties have been removed:

    • task.writer-count, replaced by prop-task-min-writer-count.

    • task.partitioned-writer-count, replaced by prop-task-max-writer-count.

    • task.scale-writers.max-writer-count, replaced by prop-task-max-writer-count.

    • writer-min-size, replaced by writer-scaling-min-data-processed.

    You must remove these properties from the cluster configuration and replace them with these replacement properties, or the cluster does not start.

  • The Snowflake distributed connector is now deprecated and is planned to be removed in a future SEP release, in favor of the improved Snowflake parallel connector. Existing catalogs that use the Snowflake distributed connector must be migrated to the Snowflake parallel connector.

  • The RPM package service daemon script is now deprecated and is planned to be removed in a future SEP release. Configurations that rely on this script must be updated to use the systemctl daemon script instead.

  • As of the 429-e release, table functions such as query are qualified with the system.builtin schema. This change results in Access Denied errors in circumstances where a role was granted a privilege to execute table functions not qualified under a schema. Permissions for these roles must now be updated accordingly to execute table functions when qualified with an appropriate schema.

429-e initial changes#

General#

  • Added support for publishing data products that contain decimal literals.

  • Updated usage metrics to upload data collected between previous upload and the coordinator shutdown or restart.

  • Fixed issue that prevented the Run and troubleshoot option in the query editor from working when built-in access control is enabled.

Security#

  • Added session logout to OAuth 2.0 providers when logging out from the SEP web UI.

  • Fixed issue that prevented tables and columns inside information_schema from being displayed when built-in access control is used.

  • Fixed JavaScript policy evaluation in Ranger and Privacera.

Hive connector#

Delta Lake connector#

MongoDB connector#

Snowflake connector#

  • Updated connectors to use fully parallel mode by default for more query shapes.

SQL Server connector#

  • Added the sqlserver.database-prefix-for-schema.enabled catalog configuration property that allows SQL Server catalogs to access multiple databases.

429-e.0 changes (29 Nov 2023)#

  • Improved support for concurrent updates of table statistics in Glue.

  • Added masking for additional sensitive values in log files.

  • Added casting of char fields, if necessary, to varchar type in Hive view translations.

  • Added support for RENAME SCHEMA and RENAME TABLE when the snowflake.database-prefix-for-schema.enabled property is set to true.

  • Remediated CVE-2023-41900

  • Fixed incorrect results for queries involving an aggregation in a correlated subquery.

  • Fixed incorrect results for queries involving ORDER BY and window functions with ordered frames.

  • Fixed launcher start command not working with default directories.

  • Fixed possible JVM crash when reading short decimal columns in parquet files created by Impala. Applies to the Hive, Hudi, Delta, and Iceberg connectors.

  • Fixed incorrect results when a query contains several != or NOT IN predicates in MongoDB catalogs.