Set Up Data Export Connectors

Learn how to set up a connector that exports data from Visier to an external system.

Limited Availability

Access requirements

Profiles: Data Engineer

Custom profile with these capabilities: Data (Write, Detailed) and Manage Jobs

Data required: Access to all data such as the Super Admin permission

Reach out to your administrator for access.

Overview

Data export connectors use Data Exports to send Visier data directly to an external system, such as Databricks or Snowflake.

To set up data export connectors, do the following:

  1. Create a Data Export to use for the export. The Data Export must be versioned and set to Active. Data Exports define the attributes to send to your target system. For more information, see Create a Data Export.

    Caution: Editing or deleting a Data Export that is linked to a data export connector can impact the schema or data written to the destination.

  2. In your target system, create a service account. The service account gives Visier the ability to send data to the system. For more information, see Set up a service account.
  3. In Visier, provide connector credentials for the service account. The credentials authenticate the service account in Visier so that we can send data to your target system. For more information, see Add data export connector credentials in Visier.
  4. In Visier, create a connector. The connector defines the data tables to send to your target system. For more information, see Create a data export connector.
  5. In the connector, configure the tables and attributes to include in the data export connector job. For more information, see Customize a data export connector.
  6. When finished, run a data connector extraction job. The extraction job retrieves data from your target system and processes the data in Visier. For more information, see Run a data export connector job.

Set up a service account

To start using Visier's data export connectors, you must first create a service account in your target system that enables Visier to connect to the system.

Caution: We do not recommend running integrations with an employee's user account because:

  • All operations performed by the user will be logged under this employee instead of a user account dedicated to integration.
  • If the security profile of the employee changes, or if the employee exits the organization, integrations that depend on this user will no longer function.

Please refer to your target system's documentation to create a service account and provide the account with all the required permissions to perform integration actions.

Add data export connector credentials in Visier

Note: This feature is also available through Visier's public APIs. For more information, see Data Export Connectors API.

Your service account must be connected to Visier to allow us to send data to the target system.

  1. On the global navigation bar, click Data > Connector Credentials.
  2. Click Add Connector Credential > Data out credential.
  3. Select a data provider and then click Next > Let's Start.
  4. Type a display name and description.
  5. Enter the connector credentials. This differs by provider.
  6. Click Authenticate Credential to ensure your credentials are valid.
  7. Click Save.

To update existing data export connector credentials:

  1. On the global navigation bar, click Data > Connector Credentials.
  2. Click Data out.
  3. In the Actions column, click Update.
  4. Enter the updated connector credentials.
  5. Click Save.

To view all the destinations that this credential writes data to:

  1. On the global navigation bar, click Data > Connector Credentials.
  2. Click Data out.
  3. Select a data export connector.
  4. Click Destination. This lists the data export connectors that write data out using this credential.
  5. Optional: To go to a data export connector that uses this credential, click Open. The connector opens in a new tab.

Create a data export connector

  1. In a project, on the navigation bar, click Data > Export Connectors > Create Export Connector.
  2. Select a data provider and then click Next > Let's Start.
  3. Type a display name and description.
  4. Select a credential. If you haven't created a credential yet, click Create a new credential.
  5. Click Next.
  6. Select one or more Data Exports to use in the export connector. The Data Export must be versioned and set to Active.
  7. Click Continue to Naming.
  8. For each Data Export that you selected, set a table name. Each Data Export sends data to exactly one table. Table names are permanent, must be unique within the connector, and are applied to all destinations in the connector.
  9. Click Next > Run Now.

    Result: A data export connector job runs. This syncs the tables from Visier to your destination. After the job succeeds, you can set up a job schedule for the connector.

Customize a data export connector

In an existing data export connector, you can:

  • Add destinations. Each destination is a target system in which to write Visier data.
  • Link additional Data Exports. The Data Export must be versioned and set to Active. Each Data Export sends data to exactly one table. Table names are permanent, must be unique within the connector, and are applied to all destinations in the connector.
  • Manage credentials.
  • Change the display name or description.
  • Delete the connector.

Run a data export connector job

Data export connector jobs run using the security of the user who executes the job. The user must have access to all data.

Note: This feature is also available through Visier's public APIs. For more information, see Data Export Connectors API.

To run a job immediately:

  1. In a project, on the navigation bar, click Data > Export Connectors.
  2. Select a data export connector.
  3. Click Run Now.

To schedule a data export connector job, the data export connector must be published to production. For more information, see Publish Project Changes.

  1. In the production project, on the navigation bar, click Data > Export Connectors.
  2. Select a data export connector.
  3. Click Schedule. For more information, see Schedule a Job.