Run a Job

Learn how to run a job to generate a new data version in a project or for production.

Overview

When you add new data to Visier or change your transformation logic, you can run a job to generate a new data version. Depending on your needs, you can run a job in the production project or a draft project. Alternatively, you can set up a recurring job schedule to run jobs regularly. For more information, see Schedule a Job.

Note: Tenants can have a maximum of 500 active processing jobs at any time, except free trial tenants, which have a maximum of 5 active processing jobs. An active processing job is running, pending, or rescheduled. These maximums are the default, however, contact Visier Technical Support to request limit adjustments.

Run a job in a project

Who can use this feature?

Users with the following:

  • Profiles: Data Engineer
  • Profile capabilities: Data (Write, Detailed)

Users with the following can access the Jobs room in a project:

  • Additional capabilities: Manage Jobs

Not sure if you have this feature or capability? Reach out to your administrator.

Depending on your needs, you can run a job in the production or draft project. For example, quickly resolve a scheduled job failure by uploading a new file and running a job in production. When updating transformation logic, such as changing an extraction rule, run a job in your draft project to validate the data version before releasing it to users.

Jobs can be run in the Data Categories or Jobs room. When running a job in the Data Categories room, you can generate a partial data version and enable features such as alerts and the normalizer cache.

Note:  

  • Generated data versions may cause issues and warnings. For more information, see Data Issues.
  • Data versions generated in a draft project will not be published to production. To make the data version available in production, you must publish the project.
  • Run job for partial data version is a special data load job that allows you to select specific analytic objects to include in the job, rather than all the data in your tenant. This is useful for faster data testing because you can select only the data you're interested in validating. Partial data versions are only valid in a project; they cannot be published to production.

Run a job in the Data Categories room

  1. In a project, on the navigation bar, click Data > Data Categories.
  2. On the data category you want to create a new data version, click the More button .
  3. Click Run job or Run job for partial data version.
  4. In the Run job dialog, do the following:
    1. In Generate debugging info, select one of the following:
      • None: No debugging information is generated about the job. This is the default behavior.
      • For stages and records: Debugging information is generated at the end of each stage and provides the final result of a stage.
      • For stages, records, and rules: Debugging information is generated for all rules in each stage: business rules, system rules, and multi-subject rules. Jobs set to For stages, records, and rules run for longer because there is more information to generate.
    2. If For stages and records or For stages, records, and rules, select one of the following to define the level of detail to return about the debugging information:
      • Show file and line: Returns the file and line values for the data in the debugging information.
      • Show mapping: Returns the mapping names that correspond to the data in the debugging information.
    3. Enable or disable Use alerts. If enabled, all enabled alerts check the data in the job. For more information, see Data Alerts.
    4. Enable or disable Enable normalizer cache. If enabled, the normalizer cache minimizes source upload processing to improve job performance. We recommend always enabling the normalizer cache.
  5. If running a partial job, click Next and then select the analytic objects to include in the job.
  6.  Click Run Job.

    Result: After a job processes data successfully, a new data version is available. To view the new data version in a project, you may need to change the project's data version. For more information, see Set the Data Version.

Run a job in the Jobs room

  1. In a project, on the navigation bar, click Data > Jobs.
  2. In the Schedule tab, click Schedule job.
  3. In the Run job dialog, do the following:
    1. Enable the Run now toggle.
    2. Enable the Process data toggle.
    3. Select the data category you want to create a new data version for.
    4. Set debugging options by expanding the Advanced section:
      1. In Generate debugging info, select one of the following:
        • None: No debugging information is generated about the job. This is the default behavior.
        • For stages and records: Debugging information is generated at the end of each stage and provides the final result of a stage.
        • For stages, records, and rules: Debugging information is generated for all rules in each stage: business rules, system rules, and multi-subject rules. Jobs set to For stages, records, and rules run for longer because there is more information to generate.
      2. If For stages and records or For stages, records, and rules, select one of the following to define the level of detail to return about the debugging information:
        • Show file and line: Returns the file and line values for the data in the debugging information.
        • Show mapping: Returns the mapping names that correspond to the data in the debugging information.
  4. Click Schedule.

    Result: After a job processes data successfully, a new data version is available. To view the new data version in a project, you may need to change the project's data version. For more information, see Set the Data Version.

Run a job in the global workspace

Who can use this feature?

Users with the following:

  • Profile capabilities: Data (Write, Simple)

Not sure if you have this feature or capability? Reach out to your administrator.

Select administrators have access to the Jobs room in the global workspace. They can upload new files and run jobs to resolve scheduled job failures without the help of Visier Technical Support. If you don't see the Jobs room in the global workspace, you may have the ability to run jobs within a project instead. For more information, see Run a job in a project.

Note: Jobs in the global workspace will follow the release behavior defined for your scheduled jobs. For more information about your settings, see Release Behavior.

  1. On the global navigation bar, click Data > Jobs.
  2. Click Run Job.

    Result: A data load job starts. If successful, the data load job generates a new data version. If your release behavior is set to Auto-release latest, the new data version is immediately available in production.

You can monitor the progress of your job in the Jobs room. For more information, see Jobs. If the Jobs room doesn't list a job that you just started, the job may still be in the queue. Wait a few minutes and then refresh the Jobs list. When the job begins running, it will appear in the list.