Insights

In Insights, you can get detailed information about the performance of your annotation team as well as your dataset's health.

llm insights

The Insights feature is a flexible and easy to use tool for measuring and reviewing your team’s performance and project status in an in-depth manner during project curation. You also have the ability to compare data through different charts to help you visualize the information easily.

Measure

Through this parameter, you can look into the different measurements of your items, such as count, time spent, and some component values.

Measure (y-axis)	Aggregation methods
Items Count	Sum.
Annotation Time	Sum, mean, median, min, and max.
QA Time	Sum, mean, median, min, and max.
Admin Time	Sum, mean, median, min, and max.
Total Time	Sum, mean, median, min, and max.
Component Values	- Count, Sum, mean, median, min, and max. - Component Values can only be viewed for the value of the Number, Slider, and Rating components, as well as the character length of the Text input, Text Area, Markdown, and Code components. This will display the data belonging to each individual component's ID.

Breakdown

Breakdown (x-axis)	Parameter
None	—
Status	The item's current status.
Folder name	The item's current folder.
Category Name	The item’s assigned category.
Approval status	The item's current approval status.
Annotator name	Users with the Annotator role that have worked on the item in the editor.
QA name	Users with the QA role that have worked on the item in the editor.
Admin name	Users with the Admin role that have worked on the item in the editor.
Annotation date	A timestamp on when an Annotator last worked on the item in the editor.
QA date	A timestamp on when an QA last worked on the item in the editor.
Last action date	A timestamp on when the last action was taken on an item in the editor.
Component options	Break down the data by the Select, Checkbox, Radio, Voting, Rating, and Date component options for each individual component's ID.

Compare by

Insights gives you the ability to compare your metrics in a number of ways and display the differences clearly. The parameters you can select from are the same as the Breakdown list, excluding: Annotation date, QA date, and Last action date.

Chart types

You can display the information using a number of different chart types: Bar chart (default), Stacked bar chart (available only if comparison is selected), Horizontal bar chart, Stacked horizontal bar chart (available only if comparison is selected), and Line chart (available only when the breakdown selection is Annotation date, QA date, or Last action date).

Filter items

Filter	Description
Item → Status	Users can select one or multiple statuses from the following: `Not Started`, `In Progress`, `Quality Check`, `Returned`, `Completed`, `Skipped`.
Item → Folder	Users can select one or multiple folders.
Item → Category	Users can select one or multiple item categories.
Item → Subset	Users can select one or multiple subsets.
Item → Approval Status	Users can select one or multiple approval statuses from the following: `Approved`, `Disapproved`, `None`.
Item → Annotator	Users can select one or multiple annotators.
Item → QA	Users can select one or multiple QAs.
Item → Admin	Users can select one or multiple Admins.
Item → Annotation Date	Indicates the time when the last annotation was made on an item in the editor by an Annotator. - Users can select a date range by providing `From` and `To` dates. - In case only the `From` date is provided, then all the items that have been annotated since the `From` date should be shown. - In case only the `To` date is provided, then all the items that have been annotated since the project start till the `To` date should be shown.
Item → QA Date	Indicates the time when an item was last reviewed in the editor by a QA. - Users can select a date range by providing `From` and `To` dates. - In case only the `From` date is provided, then all the items that have been reviewed by the QA since the `From` date should be shown. - In case only the `To` date is provided, then all the items that have been reviewed by the QA since the project start till the `To` date should be shown.
Item → Last Action Date	Indicates the time when the last action was taken on an item. - Users can select a date range by providing `From` and `To` dates. - In case only the `From` date is provided, then all the items that have a last action date since the `From` date should be shown. - In case only the `To` date is provided, then all the items that have a last action date since the project start till the `To` date should be shown.
Component → Created At	- Users can select a date range by providing `From` and `To` dates. - In case only the `From` date is provided, then all the items that have a last action date since the `From` date should be shown. - In case only the `To` date is provided, then all the items that have a last action date since the project start till the `To` date should be shown.
Component → Created By	Users can select one or multiple creators.
Component → Creator Role	Users can select one or multiple creator roles from the following: `Annotator`, `QA`, `Admin`.
Component → Updated At	- Users can select a date range by providing `From` and `To` dates. - In case only the `From` date is provided, then all the items that have a last action date since the `From` date should be shown. - In case only the `To` date is provided, then all the items that have a last action date since the project start till the `To` date should be shown.
Component → Updated By	Users can select one or multiple updaters.
Component → Updater Role	Users can select one or multiple updater roles from the following: `Annotator`, `QA`, `Admin`.
[COMPONENT_VALUE]	The name of this filter and its data will be based on each individual component's ID. - One or multiple options of the Select, Checkbox, Radio, Voting, and Rating components. - Numerical value of the Number and Slider components, using the following operators: `Equal`, `Not equal`, `Greater than`, and `Less than`. For the Range slider component, users can make use of the following operators: `Greater than` and `Less than`. - Date range of the Date component by providing the `From` and `To` parameters.