Insights (Beta)

In Insights, you can get detailed information about the performance of your annotation team as well as your dataset's health.

πŸ“˜

The Insights tab is available for Image Projects only and for the following roles: Team Owners, Team Admins, and Project Admins.

Generate insights

To generate insights:

  1. Go to the Insights tab.
  2. Click Generate.

Refresh insights

Click Refresh to see the most up-to-date information.

Parameters for items

Measure (y-axis)

Parameter

  • Count (default parameter)
  • Instance Count
  • Annotation Time
  • QA Time
  • Admin Time
  • Total Time

Formula

  • Sum
  • Mean
  • Median
  • Max
  • Min

Breakdown (x-axis)

  • None
  • Status (default parameter)
  • Folder Name
  • Approval Status
  • Annotator Name
  • QA Name
  • Admin Name
  • Annotation Date
  • QA Date
  • Last Action Date

Bin size

The bin size can be:

  • Day (default bin size)
  • Week
  • Month

πŸ“˜

Bin size is available if one of the following breakdown parameters is selected: Annotation date, QA date, or Last action date.

Parameters for instances

Measure (y-axis)

Parameter

  • Count (default parameter)
  • Probability
  • Number of Attributes
  • Number of Polygon Points (only for Polygons and Polylines)

Formula

  • Sum
  • Mean
  • Median
  • Max
  • Min

Breakdown (x-axis)

  • Annotation Type
  • Approval Status
  • Class Name (default parameter)
  • Creation Type
  • Created At
  • Creator Name
  • Creator Role
  • Group ID
  • Updated At
  • Updater Name
  • Updater Role

Bin size

The bin size can be:

  • Hour
  • Day (default bin size)
  • Week
  • Month

πŸ“˜

Bin size is available if one of the following breakdown parameters is selected: Created At or Updated At.

Filters for items and instances

FilterDescription
Item β†’ StatusUsers can select all or multi-select any of the statuses (Not Started, In Progress, Quality Check, Returned, Completed, Skipped)
Item β†’ FolderUsers can select all or multi-select any of the folders
Item β†’ Approval StatusUsers can select all or multi-select any of the approval statuses (Approved, Disapproved, None)
Item β†’ AnnotatorUsers can select all or multi-select any of the annotators
Item β†’ QAUsers can select all or multi-select any of the QAs
Item β†’ AdminUsers can select all or multi-select any of the Admins
Item β†’ Annotation Date Users can select a date range by providing From and To dates.
In case only the From date is provided, then all the items that have been annotated since the From date should be shown.
* In case only the To date is provided, then all the items that have been annotated since the project start till the To date should be shown.
Item β†’ QA Date Users can select a date range by providing From and To dates.
In case only the From date is provided, then all the items that have been reviewed by the QA since the From date should be shown.
* In case only the To date is provided, then all the items that have been reviewed by the QA since the project start till the To date should be shown.
Item β†’ Last Action Date Users can select a date range by providing From and To dates.
In case only the From date is provided, then all the items that have a last action date since the From date should be shown.
* In case only the To date is provided, then all the items that have a last action date since the project start till the To date should be shown.
Item β†’ Instance CountUsers can select one of the logical operators (equal, not equal, greater than, less than) and provide a number.
Instance β†’ Instance TypeUsers can select all or multi-select any of the annotation types (Polyline, Polygon, Bounding Box, Rotated Bounding Box, Ellipse, Point, Cuboid, and Tag).
Instance β†’ Approval StatusUsers can select all or multi-select any of the approval statuses (Approved, Disapproved, None).
Instance β†’ Class NameUsers can select all or multi-select any of the classes in the project.
Instance β†’ Creation TypeUsers can select all or multi-select any of the creation types (Manual, Prediction, Pre-annotation)
Instance β†’ Created At Users can select a date range by providing From and To dates.
In case only the From date is provided, then all the items that have instances which were created since the From date should be shown.
* In case only the To date is provided, then all the items that have instances which were created since the project start till the To date should be shown.
Instance β†’ Created ByUsers can select all or multi-select any of the names of the instance creators.
Instance β†’ Creator RoleUsers can select all or multi-select any of the roles of the instance creators (Annotator, QA, Admin).
Instance β†’ Group IDUsers can provide Group IDs (separated by commas).
Instance β†’ Updated At Users can select a date range by providing the From and To dates.
In case only the From date is provided, then all the items that have instances which were updated since the From date should be shown.
* In case only the To date is provided, then all the items that have instances which were updated since the project start till the To date should be shown.
Instance β†’ Updated ByUsers can select all or multi-select any of the names of instance updaters.
Instance β†’ Updater RoleUsers can select all or multi-select any of the roles of instance updaters (Annotator, QA, Admin).