Insights - Text Projects (Beta)

In Insights, you can get detailed information about the performance of your annotation team as well as your dataset's health.

📘
The Insights tab is available for the following roles: Team Owners, Team Admins, and Project Admins.

Generate insights

To generate insights:

Go to the Insights tab.
Click Generate.

Refresh insights

Click Refresh to see the most up-to-date information.

Parameters for items

Measure (y-axis)

Parameter

Count (default parameter)
Instance Count
Text length
Annotation Time
QA Time
Admin Time
Total Time

Formula

Sum
Mean
Median
Max
Min

Breakdown (x-axis)

Status (default parameter)
Folder Name
Annotator Name
QA Name
Admin Name
Annotation Date
QA Date
Last Action Date
Instance Count

Bin size

The bin size can be:

Day (default bin size)
Week
Month

📘
Bin size is available if one of the following breakdown parameters is selected: Annotation date, QA date, or Last action date.

Parameters for instances

Measure (y-axis)

Parameter

Count (default parameter)
Number of Attributes
Instance length (text length)

Formula

Sum
Mean
Median
Max
Min

Breakdown (x-axis)

None
Instance Type
Class Name (default parameter)
Creation Type
Created At
Creator Name
Creator Role
Updated At
Updater Name
Updater Role

Bin size

The bin size can be:

Hour
Day (default bin size)
Week
Month

📘
Bin size is available if one of the following breakdown parameters is selected: Created At or Updated At.

Filters for items and instances

Filter	Description
Item → Status	Users can select all or multi-select any of the statuses (Not Started, In Progress, Quality Check, Returned, Completed, Skipped)
Item → Folder	Users can select all or multi-select any of the folders
Item → Annotator	Users can select all or multi-select any of the annotators
Item → QA	Users can select all or multi-select any of the QAs
Item → Admin	Users can select all or multi-select any of the Admins
Item → Annotation Date	Users can select a date range by providing `From` and `To` dates. In case only the `From` date is provided, then all the items that have been annotated since the `From` date should be shown. * In case only the `To` date is provided, then all the items that have been annotated since the project start till the `To` date should be shown.
Item → QA Date	Users can select a date range by providing `From` and `To` dates. In case only the `From` date is provided, then all the items that have been reviewed by the QA since the `From` date should be shown. * In case only the `To` date is provided, then all the items that have been reviewed by the QA since the project start till the `To` date should be shown.
Item → Last Action Date	Users can select a date range by providing `From` and `To` dates. In case only the `From` date is provided, then all the items that have a last action date since the `From` date should be shown. * In case only the `To` date is provided, then all the items that have a last action date since the project start till the `To` date should be shown.
Item → Instance Count	Users can select one of the logical operators (equal, not equal, greater than, less than) and provide a number.
Item → Text Length	Users can select one of the logical operators (equal, not equal, greater than, less than) and provide a number.
Instance → Instance Type	Users can select all or multi-select any of the annotation types (Entity or Tag).
Instance → Class Name	Users can select all or multi-select any of the classes in the project.
Instance → Creation Type	Users can select all or multi-select any of the creation types (Manual, Prediction, Pre-annotation)
Instance → Created At	Users can select a date range by providing From and To dates. In case only the `From` date is provided, then all the items that have instances which were created since the `From` date should be shown. * In case only the `To` date is provided, then all the items that have instances which were created since the project start till the `To` date should be shown.
Instance → Created By	Users can select all or multi-select any of the names of the instance creators.
Instance → Creator Role	Users can select all or multi-select any of the roles of the instance creators (Annotator, QA, Admin).
Instance → Updated At	Users can select a date range by providing the `From` and `To` dates. In case only the `From` date is provided, then all the items that have instances which were updated since the `From` date should be shown. * In case only the `To` date is provided, then all the items that have instances which were updated since the project start till the `To` date should be shown.
Instance → Updated By	Users can select all or multi-select any of the names of instance updaters.
Instance → Updater Role	Users can select all or multi-select any of the roles of instance updaters (Annotator, QA, Admin).

Chart types

Bar chart (default chart type)
Stacked bar chart (available only if a comparison is selected)
Horizontal bar chart
Stacked horizontal bar chart (available only if a comparison is selected)
Line chart

Bin size

The bin size can be:

Hour (available only for instance type graphs)
Day (default bin size)
Week
Month

📘
This filter is only available if one of the following breakdown parameters is selected:

For items: Annotation date, QA date, or Last action date.

For instances: Created At or Updated At.

Compare by

You can compare items and instances in the chart. You need to select a breakdown parameter to be able to compare.

You can compare items by:

Folder name
Annotator name
Admin name
QA name
Instance count

You can compare instances by:

Instance type
Creation type
Creator name
Creator role
Updater name
Updater role

Download data

To download your data, click the download button in the top right corner. The download file is a CSV file which consists of a table with 2 columns if no comparison is selected.

Column 1: Breakdown parameter
Column 2: Calculation parameter + calculation method

The number of rows is equal to the count of breakdown parameters for each item/instance.

If you have a comparison parameter selected, the downloaded CSV file is a matrix where the rows represent the breakdown parameters and the columns represent the comparison parameters.

The data in each cell of a matrix represents the calculation parameter + the calculation method for each item/instance group of the (breakdown + comparison) parameter.