About Insights

In Insights, you can get detailed information about the performance of your annotation team as well as your dataset's health.

The Insights feature is a flexible and easy to use tool for measuring and reviewing your team’s performance and project status in an in-depth manner during project curation. You also have the ability to compare data through different charts to help you visualize the information easily.

📘

The Insights tab is available for the following roles: Team Owners, Team Admins, and Project Admins.

🚧

In case of group projects, the Insights tab will only show information on the project visible within the group’s data scope.

Generate Insights

  1. Select the project you want to generate insights for.
  2. In the left panel, click on Explore.
  3. Go to the Insights tab in the top right.
  4. Click Generate.

📘

Refresh

Click Refresh to see the most up-to-date information.

Items

Parameters

You can look into your project’s item status thoroughly using Insights. You can do so by setting a number of parameters to filter the status and information on all items within your project. These are the parameters available.

Measure

Through this parameter, you can look into the different measurements of your items, such as count, time spent, metadata, and the length or duration of item.

Measure (y-axis)ImageTextVideo
Count (default parameter):white-check-mark::white-check-mark::white-check-mark:
Instance Count:white-check-mark::white-check-mark::white-check-mark:
Annotation Time:white-check-mark::white-check-mark::white-check-mark:
QA Time:white-check-mark::white-check-mark::white-check-mark:
Admin Time:white-check-mark::white-check-mark::white-check-mark:
Total Time:white-check-mark::white-check-mark::white-check-mark:
Custom metadata (number type):white-check-mark::white-check-mark::white-check-mark:
Text length:x::white-check-mark::x:
Video Duration:x::x::white-check-mark:

Breakdown

You can get a breakdown of your items by looking into the general information about them, including their current status, the folder they belong to, the contributors that worked on them, and more.

Breakdown (x-axis)ImageTextVideo
None:white-check-mark::white-check-mark::white-check-mark:
Status (default parameter):white-check-mark::white-check-mark::white-check-mark:
Folder Name:white-check-mark::white-check-mark::white-check-mark:
Approval Status:white-check-mark::white-check-mark::white-check-mark:
Annotator Name:white-check-mark::white-check-mark::white-check-mark:
QA Name:white-check-mark::white-check-mark::white-check-mark:
Admin Name:white-check-mark::white-check-mark::white-check-mark:
Annotation Date:white-check-mark::white-check-mark::white-check-mark:
QA Date:white-check-mark::white-check-mark::white-check-mark:
Last Action Date:white-check-mark::white-check-mark::white-check-mark:
Custom metadata (strings):white-check-mark::white-check-mark::white-check-mark:
Instance Count:white-check-mark::white-check-mark::white-check-mark:
Keyframe Count:x::x::white-check-mark:

Compare by

Insights gives you the ability to compare your items with each other in a number of ways and display the differences between them clearly.

Compare byImageTextVideo
Status:white-check-mark::white-check-mark::white-check-mark:
Folder name:white-check-mark::white-check-mark::white-check-mark:
Approval status:white-check-mark::white-check-mark::white-check-mark:
Annotator name:white-check-mark::white-check-mark::white-check-mark:
Admin name:white-check-mark::white-check-mark::white-check-mark:
QA name:white-check-mark::white-check-mark::white-check-mark:
Instance count:x::white-check-mark::white-check-mark:
Keyframe count:x::x::white-check-mark:

Filter

You can filter your items thoroughly by their status and information. Each option has further selections to refine your filter to suit your needs.

FilterDescriptionImageTextAudio
Item → StatusUsers can select all or multi-select any of the statuses (Not Started, In Progress, Quality Check, Returned, Completed, Skipped).:white-check-mark::white-check-mark::white-check-mark:
Item → FolderUsers can select all or multi-select any of the folders.:white-check-mark::white-check-mark::white-check-mark:
Item → Approval StatusUsers can select all or multi-select any of the approval statuses (Approved, Disapproved, None).:white-check-mark::white-check-mark::white-check-mark:
Item → AnnotatorUsers can select all or multi-select any of the annotators.:white-check-mark::white-check-mark::white-check-mark:
Item → QAUsers can select all or multi-select any of the QAs.:white-check-mark::white-check-mark::white-check-mark:
Item → AdminUsers can select all or multi-select any of the Admins.:white-check-mark::white-check-mark::white-check-mark:
Item → Annotation Date- Users can select a date range by providing From and To dates.
- In case only the From date is provided, then all the items that have been annotated since the From date should be shown.
- In case only the To date is provided, then all the items that have been annotated since the project start till the To date should be shown.
:white-check-mark::white-check-mark::white-check-mark:
Item → QA Date- Users can select a date range by providing From and To dates.
- In case only the From date is provided, then all the items that have been reviewed by the QA since the From date should be shown.
- In case only the To date is provided, then all the items that have been reviewed by the QA since the project start till the To date should be shown.
:white-check-mark::white-check-mark::white-check-mark:
Item → Last Action Date- Users can select a date range by providing From and To dates.
- In case only the From date is provided, then all the items that have a last action date since the From date should be shown.
- In case only the To date is provided, then all the items that have a last action date since the project start till the To date should be shown.
:white-check-mark::white-check-mark::white-check-mark:
Item → Instance CountUsers can select one of the logical operators (equal, not equal, greater than, less than) and provide a number.:white-check-mark::white-check-mark::white-check-mark:
Item → Text LengthUsers can select one of the logical operators (equal, not equal, greater than, less than) and provide a number.:x::white-check-mark::x:
Item → Keyframe CountUsers should be able to select one of the logical operators (equal, not equal, greater than, less than) and provide a number.:x::x::white-check-mark:
Item → Video DurationUsers should be able to select one of the logical operators (equal, not equal, greater than, less than) and provide a number.:x::x::white-check-mark:
Item → Custom metadataUsers can select one of the logical operators (equal, not equal, greater than, less than) and provide a number.:white-check-mark::white-check-mark::white-check-mark:

Instances

Parameters

You can look into your project’s instance status thoroughly using Insights. You can do so by setting a number of parameters to filter the status and information on all instances within your project. These are the parameters available.

Measure

Through this parameter, you can look into the different measurements of your instances, such as count, probability, attribute count, polygon and point count, and length or duration of instance.

Measure (y-axis)ImageTextVideo
Count (default parameter):white-check-mark::white-check-mark::white-check-mark:
Probability:white-check-mark::x::x:
Number of Attributes:white-check-mark::white-check-mark::x:
Number of Polygon Points (only for Polygons and Polylines):white-check-mark::x::x:
Instance length (text length):x::white-check-mark::x:
Instance Duration:x::x::white-check-mark:

Breakdown

You can get a breakdown of your instances by looking into the general information about them, including their current status, their class name, the contributors that worked on them, and more.

Breakdown (x-axis)ImageTextVideo
None:x::x::white-check-mark:
Annotation Type:white-check-mark::x::x:
Approval Status:white-check-mark::x::x:
Class Name (default parameter):white-check-mark::white-check-mark::white-check-mark:
Creation Type:white-check-mark::white-check-mark::x:
Created At:white-check-mark::white-check-mark::white-check-mark:
Creator Name:white-check-mark::white-check-mark::white-check-mark:
Creator Role:white-check-mark::white-check-mark::white-check-mark:
Group ID:white-check-mark::x::white-check-mark:
Updated At:white-check-mark::white-check-mark::white-check-mark:
Updater Name:white-check-mark::white-check-mark::white-check-mark:
Updater Role:white-check-mark::white-check-mark::white-check-mark:
Instance Type:white-check-mark::white-check-mark::white-check-mark:

Compare by

Insights gives you the ability to compare your instances with each other in a number of ways and display the differences between them clearly.

Compare byImageTextVideo
Class name:white-check-mark::x::white-check-mark:
Instance type:white-check-mark::white-check-mark::white-check-mark:
Approval status:white-check-mark::x::x:
Creation type:white-check-mark::white-check-mark::x:
Creator name:white-check-mark::white-check-mark::white-check-mark:
Creator role:white-check-mark::white-check-mark::white-check-mark:
Group ID:white-check-mark::x::white-check-mark:
Updater name:white-check-mark::white-check-mark::white-check-mark:
Updater role:white-check-mark::white-check-mark::white-check-mark:

Filter

You can filter your instances thoroughly by their status and information. Each option has further selections to refine your filter to suit your needs.

FilterDescriptionImageTextVideo
Instance → Instance TypeUsers can select all or multi-select any of the annotation types (Polyline, Polygon, Bounding Box, Rotated Bounding Box, Ellipse, Point, Cuboid, Tag, and Relationship).:white-check-mark::white-check-mark::white-check-mark:
Instance → Approval StatusUsers can select all or multi-select any of the approval statuses (Approved, Disapproved, None).:white-check-mark::x::x:
Instance → Class NameUsers can select all or multi-select any of the classes in the project.:white-check-mark::white-check-mark::white-check-mark:
Instance → Creation TypeUsers can select all or multi-select any of the creation types (Manual, Prediction, Preannotation).:white-check-mark::white-check-mark::x:
Instance → Created At- Users can select a date range by providing From and To dates.
- In case only the From date is provided, then all the items that have instances which were created since the From date should be shown.
- In case only the To date is provided, then all the items that have instances which were created since the project start till the To date should be shown.
:white-check-mark::white-check-mark::white-check-mark:
Instance → Created ByUsers can select all or multi-select any of the names of the instance creators.:white-check-mark::white-check-mark::white-check-mark:
Instance → Creator RoleUsers can select all or multi-select any of the roles of the instance creators (Annotator, QA, Admin).:white-check-mark::white-check-mark::white-check-mark:
Instance → Group IDUsers can provide Group IDs (separated by commas).:white-check-mark::x::white-check-mark:
Instance → Updated At- Users can select a date range by providing the From and To dates.
- In case only the From date is provided, then all the items that have instances which were updated since the From date should be shown.
- In case only the To date is provided, then all the items that have instances which were updated since the project start till the To date should be shown.
:white-check-mark::white-check-mark::white-check-mark:
Instance → Updated ByUsers can select all or multi-select any of the names of instance updaters.:white-check-mark::white-check-mark::white-check-mark:
Instance → Updater RoleUsers can select all or multi-select any of the roles of instance updaters (Annotator, QA, Admin).:white-check-mark::white-check-mark::white-check-mark:

Chart types

You can display the information using a number of different chart types: Bar chart (default), Stacked bar chart (available only if comparison is selected), Horizontal bar chart, Stacked horizontal bar chart (available only if comparison is selected), and Line chart.

Bin size

The bin size can be:

  1. Hour (available only for instance type graphs)
  2. Day (default bin size)
  3. Week
  4. Month

📘

This filter is only available if one of the following breakdown parameters is selected:

  • For items: Annotation date, QA date, or Last action date.
  • For instances: Created At or Updated At.

Download data

To download your data, click the download button in the top right corner. The download file is a CSV file which consists of a table with 2 columns if no comparison is selected.

  • Column 1: Breakdown parameter
  • Column 2: Calculation parameter + calculation method

The number of rows is equal to the count of breakdown parameters for each item/instance.

If you have a comparison parameter selected, the downloaded CSV file is a matrix where the rows represent the breakdown parameters and the columns represent the comparison parameters.

The data in each cell of a matrix represents the calculation parameter + the calculation method for each item/instance group of the (breakdown + comparison) parameter.