Clusters with fault tolerant execution #

Fault-tolerant execution (FTE) allows a cluster to retry queries or parts of query processing in the event of failures without having to start the whole query from the beginning.

In fault-tolerant execution mode, intermediate exchange data is spooled and can be re-used by another worker. When queries require more memory than currently available in the cluster, they are still able to succeed. Multiple queries are able to share resources in a fair way, and make steady progress.

Do not use fault-tolerant execution if most queries in the cluster are short-running, typically less than one minute for completion, and require smaller amounts of memory. Query processing in fault-tolerant execution mode can be slightly slower than normal operation.

In Starburst Galaxy, specify fault-tolerant execution mode when creating or editing a cluster by selecting Fault tolerant in the Execution mode drop-down menu. No other configuration is required.

To take a cluster back to standard processing, select Standard from the same menu and restart the cluster.

Standard execution is a general purpose, ad-hoc analytics mode for queries that require a few minutes to run.

Accelerated execution enables Starburst Warp Speed’s smart indexing and caching to improve query performance. For more information, see Starburst Warp Speed.

Fault-tolerant execution is not designed to recover from broken queries or incorrect SQL.