Annotation

Once a form has been built and published, you can use the editor for your annotation process. You can further manage your Multimodal project through Settings.

Comments

To leave a comment on the item:

1. In the editor, click Comment in the left panel or press C on the keyboard.
2. Select a component on the form.
3. Type in your text.
4. Click the send button or press Enter on the keyboard.

🚧

• You can only place a comment on the Input, Select, and Media component types, and only on components that haven’t been excluded from the form.
• Each component can only have one comment at a time.

To reply to a comment:

1. Click on the comment you want to reply to.
2. Type in your reply.
3. Click the send button or press Enter on the keyboard.

To resolve a comment:

1. Click on the comment on the form or find it in the right panel.
2. Click the Resolve arrow.

Approve/Disapprove item

You can approve or disapprove each item when in the Multimodal editor.

To approve an item, you can click the corresponding thumbs up button in the top panel or press Ctrl + Shift + ↑ on the keyboard.

To disapprove an item, you can click the corresponding thumbs down button in the top panel or press Ctrl + Shift + ↓ on the keyboard.

Switch to another item

To switch to a specific item:

1. In the editor, find your item's name in the top panel.
2. Click the item name to open a dropdown menu.
3. Select the item you want to switch to.

To switch to the previous item, press the ← key on the keyboard.

To switch to the next item, press the → key on the keyboard.

Item status

When in the editor, you can change the item's status. In the top panel, find the status buttons on the right side:

• Skip: To skip an item because it's not useful to your model.
• Quality Check: To send an item to the QA.
• Return: To return a text to the Annotator.
• Complete: To complete an item.

🚧

If you try to click Quality Check or Complete to change the item's status and there’s a required field left blank, the status won't change. All required fields must be filled.

Item information

When you click on the item dropdown menu in the top left, you can see all the items in the project. When you hover over the information icon, you can see the following:

• Item name (which you can copy).
• Project name: Name of the project to which the item belongs.
• QA: The assigned QA. If there's no QA assigned to the item, then the name would be Unassigned.
• Annotator: The assigned Annotator. If there's no Annotator assigned to the item, then the name would be Unassigned.