Insights - Image Projects
In Insights, you can get detailed information about the performance of your annotation team as well as your dataset's health.
The Insights tab is available for the following roles: Team Owners, Team Admins, and Project Admins.
In case of group projects, the Insights tab will only show information on the project visible within the group’s data scope.
Generate insights
To generate insights:
- Go to the Insights tab.
- Click Generate.
Refresh insights
Click Refresh to see the most up-to-date information.
Parameters for items
Measure (y-axis)
Parameter
- Count (default parameter)
- Instance Count
- Annotation Time
- QA Time
- Admin Time
- Total Time
- Custom metadata (number type)
Formula
- Sum
- Mean
- Median
- Max
- Min
Breakdown (x-axis)
- None
- Status (default parameter)
- Folder Name
- Approval Status
- Annotator Name
- QA Name
- Admin Name
- Annotation Date
- QA Date
- Last Action Date
- Custom metadata (strings)
Parameters for instances
Measure (y-axis)
Parameter
- Count (default parameter)
- Probability
- Number of Attributes
- Number of Polygon Points (only for Polygons and Polylines)
Formula
- Sum
- Mean
- Median
- Max
- Min
Breakdown (x-axis)
- Annotation Type
- Approval Status
- Class Name (default parameter)
- Creation Type
- Created At
- Creator Name
- Creator Role
- Group ID
- Updated At
- Updater Name
- Updater Role
Filters for items and instances
Filter | Description |
---|---|
Item → Status | Users can select all or multi-select any of the statuses (Not Started, In Progress, Quality Check, Returned, Completed, Skipped) |
Item → Folder | Users can select all or multi-select any of the folders |
Item → Approval Status | Users can select all or multi-select any of the approval statuses (Approved, Disapproved, None) |
Item → Annotator | Users can select all or multi-select any of the annotators |
Item → QA | Users can select all or multi-select any of the QAs |
Item → Admin | Users can select all or multi-select any of the Admins |
Item → Annotation Date | - Users can select a date range by providing From and To dates.- In case only the From date is provided, then all the items that have been annotated since the From date should be shown.- In case only the To date is provided, then all the items that have been annotated since the project start till the To date should be shown. |
Item → QA Date | - Users can select a date range by providing From and To dates.- In case only the From date is provided, then all the items that have been reviewed by the QA since the From date should be shown.- In case only the To date is provided, then all the items that have been reviewed by the QA since the project start till the To date should be shown. |
Item → Last Action Date | - Users can select a date range by providing From and To dates.- In case only the From date is provided, then all the items that have a last action date since the From date should be shown.- In case only the To date is provided, then all the items that have a last action date since the project start till the To date should be shown. |
Item → Instance Count | Users can select one of the logical operators (equal, not equal, greater than, less than) and provide a number. |
Item → Custom metadata | Users can select one of the logical operators (equal, not equal, greater than, less than) and provide a number. |
Instance → Instance Type | Users can select all or multi-select any of the annotation types (Polyline, Polygon, Bounding Box, Rotated Bounding Box, Ellipse, Point, Cuboid, and Tag). |
Instance → Approval Status | Users can select all or multi-select any of the approval statuses (Approved, Disapproved, None). |
Instance → Class Name | Users can select all or multi-select any of the classes in the project. |
Instance → Creation Type | Users can select all or multi-select any of the creation types (Manual, Prediction, Pre-annotation) |
Instance → Created At | - Users can select a date range by providing From and To dates. - In case only the From date is provided, then all the items that have instances which were created since the From date should be shown.- In case only the To date is provided, then all the items that have instances which were created since the project start till the To date should be shown. |
Instance → Created By | Users can select all or multi-select any of the names of the instance creators. |
Instance → Creator Role | Users can select all or multi-select any of the roles of the instance creators (Annotator, QA, Admin). |
Instance → Group ID | Users can provide Group IDs (separated by commas). |
Instance → Updated At | - Users can select a date range by providing the From and To dates.- In case only the From date is provided, then all the items that have instances which were updated since the From date should be shown.- In case only the To date is provided, then all the items that have instances which were updated since the project start till the To date should be shown. |
Instance → Updated By | Users can select all or multi-select any of the names of instance updaters. |
Instance → Updater Role | Users can select all or multi-select any of the roles of instance updaters (Annotator, QA, Admin). |
Chart types
- Bar chart (default chart type)
- Stacked bar chart (available only if a comparison is selected)
- Horizontal bar chart
- Stacked horizontal bar chart (available only if a comparison is selected)
- Line chart
Bin size
The bin size can be:
- Hour (available only for instance type graphs)
- Day (default bin size)
- Week
- Month
This filter is only available if one of the following breakdown parameters is selected:
- For items: Annotation date, QA date, or Last action date.
- For instances: Created At or Updated At.
Compare by
You can compare items and instances in the chart. You need to select a breakdown parameter to be able to compare.
You can compare items by:
- Status
- Folder name
- Approval status
- Annotator name
- Admin name
- QA name
You can compare instances by:
- Class name
- Instance type
- Approval status
- Creation type
- Creator name
- Creator role
- Group ID
- Updater name
- Updater role
Download data
To download your data, click the download button in the top right corner. The download file is a CSV file which consists of a table with 2 columns if no comparison is selected.
- Column 1: Breakdown parameter
- Column 2: Calculation parameter + calculation method
The number of rows is equal to the count of breakdown parameters for each item/instance.
If you have a comparison parameter selected, the downloaded CSV file is a matrix where the rows represent the breakdown parameters and the columns represent the comparison parameters.
The data in each cell of a matrix represents the calculation parameter + the calculation method for each item/instance group of the (breakdown + comparison) parameter.
Updated about 1 month ago