BigQuery

Overview

You can create a BigQuery Destination Connector to write to a Google BigQuery table.
To set up this Connector using a GCP Service Account Key, you will need a GCP Service Account that has access to the project(s) where the resources reside. To learn more about creating and managing service accounts within GCP, visit: https://cloud.google.com/iam/docs/creating-managing-service-accounts.
To set up this Connector using Single Sign-On, your Google account will need access to the BigQuery table(s) you are connecting to.
The schema for this Connector is defined by the BigQuery table schema. The schema cannot be changed after saving the connector.

Prerequisites

Information needed:
  • Single Sign-On credentials OR Service Account Key
  • Project ID
  • Dataset
  • Table

Creating an BigQuery Destination Connector

Step 1: Click New Connector.
Step 2: Under the System prompt, click BigQuery.
Step 3: Provide a Connector Name.
Step 4: Select Destination Connector.

Authentication

There are two options for authentication: Single Sign-On and Service Account. You can choose to authenticate through your Google account using single sign-on, or by providing a Google Cloud Platform service account JSON key.
  1. 1.
    To authenticate using Single Sign-On, you will be prompted to sign into your Google Account after entering the required information and clicking Grant Access
  2. 2.
    To authenticate using Service Account, you will be prompted to enter the Service Account Key. Provide the Service Account JSON key for the account you wish to connect to.
Creating a Service Account Key in the Google Cloud Console
  1. 1.
    To create a Service Account JSON key, first navigate to the Service Accounts page in the Google Cloud Console.
  2. 2.
    Click the project dropdown in the top navigation bar to view all of your projects, choose the project you want to create a service account key for, and then click Open.
  3. 3.
    Find the row of the service account that you want to create a key for. In that row, click the More button, and then click Create key.
  4. 4.
    Select the JSON Key type and click Create

Project ID

Step 1: To find the Project ID, first select the project dropdown in the top navigation bar to view all of your projects.
Screenshot of Google Cloud project dropdown
Step 2: Find the corresponding ID for the project, copy the Project ID and paste it into the Project ID field.
Screenshot of Google Cloud project list showing where to copy the project ID from

Dataset

Provide the name of the dataset that contains the table you want to connect to.
  1. 1.
    To find the dataset information, first Navigate to the BigQuery page in the Cloud Console.
  2. 2.
    In the navigation menu, click SQL Workspace
  3. 3.
    In the Explorer panel, expand the project name to see the datasets in that project. Copy the dataset name and paste it into the Dataset field.
A screenshot of the Google Cloud UI showing where to find the SQL workspace
For more information about creating a new Dataset, visit: https://cloud.google.com/bigquery/docs/datasets

Table

Step 1: Provide the name of the table you want to connect to. To find the table name, expand the dataset from the step above to see all of the associated tables, and copy the table name and paste it into the Table field.
Last modified 6mo ago