starburst galaxy > security and compliance > manage cluster connectivity > private connections > Azure Private Link for ADLS

Azure Private Link for ADLS #

Use the following steps to securely connect your Starburst Galaxy cluster to Azure Data Lake Storage (ADLS) using Azure Private Link.

Note: Starburst Galaxy’s support for Azure Private Link is a private preview feature. To participate in the preview, contact Starburst support for current preview status.

Prepare to configure #

You must work with a Starburst technical resource to complete your Private Link configuration. Contact your account team for more information.

Note: See the tutorial for step-by-step instructions.

Before you begin:
This topic assumes you have an ADLS account.

Configure ADLS Gen2 #

Go to the Azure portal.
Navigate to your storage account, or create a new storage account.
Enable hierarchical namespace functionality for your storage account.
Enable or disable the appropriate public network access settings. For assistance, see the Azure documentation.

Obtain Azure storage account ID #

Copy your storage account resource ID.
Provide your storage account resource ID to your Starburst technical resource.

Create private endpoints #

Create two private endpoints. For assistance, see the Azure documentation.
Contact your Starburst technical resource for assistance.

Approve private endpoint connections #

Select your private endpoint connections.
Approve your private endpoint connections. For assistance, see the Azure documentation.

Configure HMS for Private Link #

If you plan to use the Hive Metastore Service (HMS) with your ADLS using Private Link, your virtual machine must have two load balancers, one for public connectivity and one for internal connectivity.

If your virtual machine does not have two load balancers, use the following steps to create them.

Create a public load balancer #

Create a new load balancer. For assistance, see the Azure documentation.
Set the load balancer to public.
Enter 443 for both the port and the backend port.
Add a new outbound rule.
Configure the outbound rule using the maximum number of ports per instance.

Create an internal load balancer #

Create a new load balancer.
Set the load balancer to internal.
Enter 9083 for both the port and the backend port.

Create a Private Link service #

Create a new Private Link service. For assistance, see the Azure documentation.
Select your internal load balancer.
Select a subnet that can route to your load balancer.
Provide your Private Link service alias to your Starburst technical resource.

Starburst Galaxy