Google BigQuery Data Export Connector
Visier can send data through this connector if the following requirements are met.
Prerequisites
- Create a service account in Google Cloud Platform (GCP). For more information, see Create service accounts.
- Generate a service account key in JSON format. For more information, see Create and delete service account keys.
- Enable the Data Lineage API in your project. For more information, see View data lineage for Google Cloud systems.
- Allow network and data traffic between Visier and your source system. For more information, see Allow Visier Connections.
Service account
Assign the appropriate security access to the service account. For more information about dataset level permissions, see Grant access to a dataset. For more information about project level permissions, see Manage access to projects, folders, and organizations.
|
Access level |
Role |
|---|---|
|
Project |
|
|
Dataset |
|
GRANT `roles/bigquery.dataEditor`
ON SCHEMA `your_project_id.your_dataset_name`
TO "serviceAccount:your-service-account@your-project-id.iam.gserviceaccount.com";
Connector credentials
Provide the following credentials in Visier. For more information, see Add data export connector credentials in Visier.
|
Credential |
Description |
Example |
|---|---|---|
|
Dataset ID |
The BigQuery dataset that holds the destination tables. |
dataset123 |
|
Project ID |
The Google Cloud Project that owns the data and is billed for the export. |
project456 |
|
Client email |
The Google BigQuery service account email address. |
example@bigquery-ID123.iam.gserviceaccount.com |
|
Client ID |
The OAuth client ID to authenticate with Google BigQuery. |
gbqClient |
|
Private key ID |
The unique identifier of the private key. |
key789 |
|
Private key |
The private key to authenticate with Google BigQuery. |
-----BEGIN PRIVATE KEY----- ... -----END PRIVATE KEY----- |
