Integration with CloudWatch logs#

Starburst’s CloudFormation template automatically integrates with CloudWatch Logs. Logs from Starburst Enterprise platform (SEP) nodes are uploaded to log streams in a /starburstdata/enterprise/STACK_NAME log group. Additionally, log files are stored and rotated on nodes themselves. Log stream names us a format STREAM-ROLE-INSTANCEID where:

  • ROLE is either coordinator or worker

  • INSTANCEID is an instance ID designated by AWS

STREAM can be one of:

  • starburst stream contains the SEP server logs

  • autoconfiguration stream contains auto-configuration script logs

  • security stream contains query and user information for queries issued to the coordinator (see Query audit)

  • graceful-scaledown stream contains graceful scale down handling script logs (there is a separate stream for each worker instance)

  • ha-heartbeat stream contains HA heartbeat script logs (there is a separate stream for each worker instance)