Starburst Documentation
Starburst Galaxy
  •  Get started
  •  Working with data
  •  Data engineering
  •  Developer tools
  •  Cluster administration
  •  Security and compliance
  •  Troubleshooting
  • Galaxy status
  •  Reference

    • starburst galaxy > security and compliance > manage cluster connectivity > private connections > Azure Private Link for ADLS

    Azure Private Link for ADLS #

    Use the following steps to securely connect your Starburst Galaxy cluster to Azure Data Lake Storage (ADLS) using Azure Private Link.

    Prepare to configure #

    You must work with a Starburst technical resource to complete your Private Link configuration. Contact your account team for more information.

    You must configure a separate Azure Private Link connection for each catalog you want to connect to Starburst Galaxy.

    Configure ADLS Gen2 #

    1. Go to the Azure portal.

    2. Navigate to your storage account, or create a new storage account.

    3. Enable hierarchical namespace functionality for your storage account.

    4. Enable or disable the appropriate public network access settings. For assistance, see the Azure documentation.

    Obtain Azure storage account ID #

    1. Copy your storage account resource ID.

    2. Provide your storage account resource ID to your Starburst technical resource.

    Create private endpoints #

    1. Create two private endpoints. For assistance, see the Azure documentation.

    2. Contact your Starburst technical resource for assistance.

    Approve private endpoint connections #

    1. Select your private endpoint connections.

    2. Approve your private endpoint connections. For assistance, see the Azure documentation.

    If you plan to use the Hive Metastore Service (HMS) with your ADLS using Private Link, your virtual machine must have two load balancers, one for public connectivity and one for internal connectivity.

    If your virtual machine does not have two load balancers, use the following steps to create them.

    Create a public load balancer #

    1. Create a new load balancer. For assistance, see the Azure documentation.

    2. Set the load balancer to public.

    3. Enter 443 for both the port and the backend port.

    4. Add a new outbound rule.

    5. Configure the outbound rule using the maximum number of ports per instance.

    Create an internal load balancer #

    1. Create a new load balancer.

    2. Set the load balancer to internal.

    3. Enter 9083 for both the port and the backend port.

    1. Create a new Private Link service. For assistance, see the Azure documentation.

    2. Select your internal load balancer.

    3. Select a subnet that can route to your load balancer.

    4. Provide your Private Link service alias to your Starburst technical resource.

    See also #