All: Viewing task list

The Tasks page is used to search for specific tasks and view detailed information about them.

By default, tasks are sorted by the last submitted date and created date. The results are paginated and include the following details:

Below, we dig into more information on specific actions.

Filtering tasks

Find specific tasks by opening the Filter menu. Results update dynamically as you adjust filter values. The results are paginated.

Upload tasks

Tasks are typically uploaded using CSV or JSON files. Ensure your file meets the platform's input requirements. Read more  

Task bulk actions

Use the Bulk Action menu to update the state or queue of a task, as well as the client patch ID. You can also use this menu to export or archive tasks.

Below, we dig into more details on certain specific actions.

Prioritizing tasks

Tasks are assigned priority numbers to determine their order of allocation to annotators. By default, all tasks are assigned a priority value of 0

A priority value can be any whole number, either positive or negative. The system allocates tasks to annotators in the following order:

• Tasks with the lowest priority number are allocated first
• If multiple tasks share the same priority, the oldest task is allocated first

Adding Priority to a Task
To add a priority to a task:

1. Select the task(s) from the list using the checkbox
   1. Once you select a task, the bulk action menu will become enabled and purple instead of grey.
2. Select Queue item and on  Prioritize option
3. A window will open where you can enter the priority number:
   1. Use the up and down arrows to adjust the priority value
4. Click Cancel to ignore the action or Prioritize to confirm the change

The new priority values will be displayed for the tasks in the Priority column. 

📘 Note

You can assign priority numbers to tasks when you upload the tasks To learn more, see Uploading tasks.

 

Prioritizing tasks in additional steps

In complex annotation projects, it's common to have multiple steps for each stage of the project. This allows your assets to be annotated, your annotations to be reviewed, and your revisions to have final notes added. Each task you prioritize in the project will carry its assigned priority level forward through all project steps.

This means that when you're establishing the priority of your tasks, you need to consider the impact across all steps. For example, one task may be important to annotate, but less important to review or to QA, meaning that its overall priority should be set relatively lower compared to a task that has a higher priority across all steps.

📘 Note

Along with determining the average priority of your tasks, you can also change the priority of tasks as they move through the different steps, following the original steps for prioritizing a task.

 

 

 

Exporting tasks

You can export tasks at any time to work on them in other software, store them for your records, or share them with others.

1. Apply the filters to narrow down the tasks you want to export.
2. Select the tasks you need using the checkboxes, or click the first checkbox to select all tasks.
3. Use the “Bullk Action" menu and click the Export option.
4. In the Export Tasks window, choose the desired export type and file format.
5. Click Export to initiate the process.
6. Once the export is complete, click Download to save the file to your device.

 

 

Archive History

The archive history is shown as a table, which contains the archive ID, the date the archive was done, who archived the tasks, and the number of tasks archived. From the table, it is possible to download the data for the archived tasks in order to recreate them or investigate more information about the tasks.

For tasks automatically archived after the inactivity period configured in projects, the Created By column will show N/A.

 

 

Reservations

When you click this option in the menu, you’ll access a table showing all reserved tasks. Each row represents a user, making it easy to spot when someone has multiple reserved tasks within a project. From this view, you can also release reserved tasks by simply clicking the "Release" button.

Upload

From this section, you can review the upload task history, which is displayed in a table that includes the upload ID, creation date, creator, number of successfully processed tasks, and the upload status.

Uploads can have the following statuses:

• Complete: The upload process has completed. It is still possible that some tasks could not be created because of errors.
• Starting: The upload job is starting.
• Preprocessing: The task assets are getting preprocessed.
• Canceled: The task creation job was cancelled by the user.
• Error: The job could not be completed because of an error.
• Waiting Upload: The job is still waiting for the user to upload a task creation file.

For jobs in the Error state or the Completed state for which not all tasks were successfully created, error details can be expanded by clicking on the arrow at the right of the upload row.

Archive

From this section, you can review archived tasks. The archive is displayed in a table that includes task details such as archive ID, the creation date, the user who create it.

Viewing a Task

To view a task in read-only mode:

1. Click the task ID.
2. Review progress without making any changes.
3. You can even view tasks being actively worked on by annotators.

To compare annotations or model predictions:

1. Open the Submission History dropdown in the navigation bar.
2. Select Compare Answers.
3. Use the menu to toggle between submissions.
   1. D represents default answers.
   2. Other options correspond to manually annotated answers per workflow step and round.
      1. Rounds increment when a task is rejected and requires re-annotation.
4. While toggling between answers, your context (frame, zooming, panning, and selected shape) will remain intact, allowing for easy comparison across submissions.