BigQuery

Overview

You can create a BigQuery Source Connector to read from your Google BigQuery table(s).
To set up this Connector using a GCP Service Account Key, you will need a GCP Service Account that has access to the project(s) where the resources reside. To learn more about creating and managing service accounts within GCP, visit: https://cloud.google.com/iam/docs/creating-managing-service-accounts.
To set up this Connector using Single Sign-On, your Google account will need access to the BigQuery table(s) you are connecting to.
If your Google account has multi-factor authentication enabled, we recommend creating a Connector using a GCP Service Account instead to avoid disruptions from re-authentication.
The schema for this Connector is defined by the selected columns from the query. The schema cannot be changed after saving the Connector.

Prerequisites

Information needed:
  • Single Sign-On credentials OR Service Account Key
  • Project ID
  • SQL Query

Creating a BigQuery Source Connector

Step 1: Navigate to the Connectors list page, then click + New Connector
Step 2: Under the System prompt, click BigQuery
Step 3: Enter a Connector Name
Step 4: Select Source Connector

Authentication

There are two options for authentication: Single Sign-On and Service Account. You can choose to authenticate through your Google account using single sign-on, or by providing a Google Cloud Platform service account JSON key.
  1. 1.
    To authenticate using Single Sign-On, you will be prompted to sign into your Google Account after entering the required information and clicking Grant Access.
  2. 2.
    To authenticate using Service Account, you will be prompted to enter the Service Account Key. Provide the Service Account JSON key for the account you wish to connect to.
Creating a Service Account Key in the Google Cloud Console
  1. 1.
    To create a Service Account JSON key, first navigate to the Service Accounts page in the Google Cloud Console.
  2. 2.
    Click the project dropdown in the top navigation bar to view all of your projects, choose the project you want to create a service account key for, and then click Open.
  3. 3.
    Find the row of the service account that you want to create a key for. In that row, click the More button, and then click Create key.
  4. 4.
    Select the JSON Key type and click Create.
Note: to set up a Connector using your service account, the service account you select needs to have access to the project you want to connect to, and needs to have both a BigQuery Data Editor role and BigQuery Job User role.

Project ID

Step 1: To find the Project ID, first select the project dropdown in the top navigation bar to view all of your projects.
Step 2: Find the corresponding ID for the project, copy the Project ID and paste it into the Project ID field.

SQL Query

Provide a query to access the data in your BigQuery. You can query against multiple tables and projects, and your query can be as complex as you need it to be.
Note: the schema for this source Connector is defined by the selected columns from the query. The schema cannot be changed after saving the Connector, so please confirm it is accurate before proceeding.
For more information about writing a query, visit: https://cloud.google.com/bigquery/docs/query-overview
Last modified 5mo ago