Google BigQuery catalogs #

Use a BigQuery catalog to configure access to a Google BigQuery warehouse, which is a product offered on Google Cloud.

Follow these steps to create a catalog for BigQuery:

1. In the navigation menu, select Data, then Catalogs.
2. Click Create catalog.
3. On the Select a data source pane, click the BigQuery icon.

4. Configure the catalog as prompted in the dialog.
5. Test the connection.
6. Connect the catalog.
7. Set any required permissions.
8. Add the new catalog to a cluster.

The following sections provide more detail for creating BigQuery catalog connections.

Define catalog name and description #

The Catalog name is visible in the query editor and other clients. It is used to identify the catalog when writing SQL or showing the catalog and its nested schemas and tables in client applications.

The name is displayed in the query editor, and in the output of a SHOW CATALOGS command. It is used to fully qualify the name of any table in SQL queries following the catalogname.schemaname.tablename syntax. For example, you can run the following query in the sample cluster without first setting the catalog or schema context: SELECT * FROM tpch.sf1.nation;.

The Description is a short, optional paragraph that provides further details about the catalog. It appears in the Starburst Galaxy user interface and can help other users determine what data can be accessed with the catalog.

Multiple connections #

The BigQuery catalog can only access a single BigQuery database within a single catalog. If you have multiple BigQuery databases, or want to connect to multiple BigQuery instances, you must configure additional instances of the BigQuery catalog.

Credentials configuration #

To configure the connection to your BigQuery warehouse, you must Create a JSON-formatted API key for your Google Cloud account.

Test the connection #

Once you have configured the connection details, click Test connection to confirm data access is working. If the test is successful, you can save the catalog.

If the test fails, look over your entries in the configuration fields, correct any errors, and try again. If the test continues to fail, Galaxy provides diagnostic information that you can use to fix the data source configuration in the cloud provider system.

Connect catalog #

Click Connect catalog, and proceed to set permissions where you can grant access to certain roles.

Set permissions #

Use the following steps to assign read-only access to a specified set of roles:

1. Select the Read-only catalog switch to grant a set of roles read-only access to the catalog’s schemas, tables, and views. For catalogs that are pre-set to read-only, this switch is already set and is disabled.
2. Next, use the drop-down menu in the Role-level permissions section to specify the roles that have read-only access.
3. Click Save access controls.

Add to cluster #

You can add your catalog to a cluster later by editing a cluster. Click Skip to proceed to the catalogs page.

Use the following steps to add your catalog to an existing cluster or create a new cluster in the same cloud region:

• In the Add to cluster section, expand the menu in the Select cluster field.
• Select one or more existing clusters from the drop down menu.
• Click Create a new cluster to create a new cluster in the same region, and add it to the cluster selection menu.

• Click Add to cluster to view your new catalog’s configuration.

   

SQL support #

The catalog provides read access and write access to data and metadata in the BigQuery database. It supports the following features:

• Globally available statements
• Read operations
• Write operations:
  • Data management:
    • INSERT
    • TRUNCATE
  • Schema and table management:
    • CREATE TABLE
    • CREATE TABLE AS
    • DROP TABLE
    • CREATE SCHEMA
    • DROP SCHEMA
    • COMMENT