Vee Logs

The logs track information about the questions your users are asking and the feedback provided.

Overview

Tracking question logs will help you understand the usage of Vee in your organization. As part of user management, download the logs to monitor user activity and the types of questions users are asking.

The log is generated as a .xlsx file and contains two sheets with the following information:

Queries sheet: Provides information about the individual questions asked.
Feedback sheet: Provides information about the usage of the Helpful button or Wasn't Helpful button and comments.

Queries sheet

The queries sheet provides information about the individual questions asked.

Column	Description
Time (UTC)	The time the question was asked in Coordinated Universal Time (UTC).
Client Type	The type of client application that made the request. For example, web or ms-teams
User	The email address of the user who asked the question.
Question	The question that was asked in natural language.
Query	The translated query that Vee used to answer the question. If Vee failed to understand the question or return a response, this value is empty.
Thread	The chain of questions.
Status	Whether or not the question was answered. For example, success or error
Error Reason	If the Status is error, this is the reason the question could not be answered.
Processing Time (ms)	The time it took for the query to be processed in milliseconds.

Feedback sheet

The feedback sheet provides information about the usage of the Helpful button or Wasn't Helpful button and comments.

Column	Description
Time (UTC)	The time the feedback was given in Coordinated Universal Time (UTC).
Client Type	The type of client application that made the request. For example, web or ms-teams
User	The email address of the user who gave the feedback.
Is Approved	Whether the feedback was a thumbs up (true) or thumbs down (false).
Thread	The chain of questions.
Queries	The translated queries for each question in the thread.
Description	The comment that the user gave with the thumbs down response.

Download the Vee logs

Do one of the following:
Option
Do this
In the global workspace
On the global navigation bar, click Tenant, and then click the Users tab.
In a project
On the navigation bar, click Security > Users.
Click the More button > Download Vee Logs in the upper-right corner of the Users room.
In the Download Vee Logs dialog, select the date range for the log.
Click Download.
Result: The log is generated as an .xlsx file and automatically begins downloading.

Option	Do this
In the global workspace	On the global navigation bar, click Tenant, and then click the Users tab.
In a project	On the navigation bar, click Security > Users.

Interpret the Vee Logs

When reviewing the feedback logs and investigating why a question got a thumbs down, ask yourself the following:

Can the question be answered by a chart in Explore? If it cannot, Vee won’t be able to answer it either. Make sure you can create a chart that can answer the question, and that the data needed to answer it has been loaded. This feedback is useful because it tells you what your users are interested in that you don’t have yet, and can guide future customizations.
Does the user have the right permissions to the required data? If they don’t have permissions to the data required to answer the question, then they won't see the expected response.
Did the user write an effective question? For more information, see "Write effective questions" in Get Started with Vee.
Did the user use terminology different from the names and definitions in Visier? If so, add synonyms where applicable. If the user is asking about populations that aren’t defined in Visier, you may need to create new concepts to define those.
Is there ambiguity about which metrics, dimensions, or concepts to return in the response? If so, see "Dealing with ambiguity" in Prompt Tuning Vee.
Is the chat context very long? If the user has a long chat context with Vee, performance can degrade. Try clearing the chat and test if the problem persists.

For complex or nuanced questions, try adding a Vee example. For more information, see "Create an analysis tagged with Vee Examples" in Prompt Tuning Vee.