Managing Tasks in the Platform
Updated at January 8th, 2025
This document provides a comprehensive guide to the platform's task management features, covering how to view, filter, prioritize, and perform actions on tasks. Whether you're monitoring progress, adjusting priorities, or exporting data, these tools help streamline workflows and improve overall productivity.
Viewing task list
The Tasks page is used to search for specific tasks and view detailed information about them.
By default, tasks are sorted by last submitted date and created date. The results are paginated and include the following details:
Detail |
Description |
||||
ID | The unique identifier for the task | ||||
Created | The date the task was created | ||||
Last Submitted | The date the task was last submitted by an annotator | ||||
State |
The current status of the task, which could be New, Rejected, In Progress, Completed, Delivered, or Acknowledged. If a task is set to be delivered but still processing, you may encounter the following sub-states:
|
||||
Priority | The priority assigned to the task. Default is 0, but it can be set to positive or negative values. Tasks with lower priority numbers are processed first | ||||
Client Batch ID | The batch ID the task belongs to |
Filtering tasks
Find specific tasks by opening the Filter menu. Results update dynamically as you adjust filter values. The results are paginated.
Taking actions on tasks
You can perform various actions on tasks by filtering, selecting tasks, and applying specific actions. These actions are grouped into categories:
Detail |
Description |
||||
States |
Actions that modify the task state:
|
||||
Queue |
Actions that manage task availability in the queue:
|
||||
Update Client Batch ID | Modify the batch ID associated with the selected tasks | ||||
Archive | Move tasks that are no longer needed to the archives |
Below, we dig into more details on certain specific actions.
Prioritizing tasks
Tasks are assigned priority numbers to determine their order of allocation to annotators. By default, all tasks are assigned a priority value of 0
A priority value can be any whole number, either positive or negative. The system allocates tasks to annotators in the following order:
- Tasks with the lowest priority number are allocated first
- If multiple tasks share the same priority, the oldest task is allocated first
Adding Priority to a Task
To add a priority to a task:
- Select the task(s) from the list using the checkbox
- Once you select a task, the top action bar will become enabled and purple instead of grey.
- Click on the Prioritize icon
- A window will open where you can enter the priority number:
- Use the up and down arrows to adjust the priority value
- Click Cancel to ignore the action or Prioritize to confirm the change
The new priority values will be displayed for the tasks in the Priority column.
📘 Note
You can assign priority numbers to tasks when you upload the tasks To learn more, see Uploading tasks.
Prioritizing tasks in additional steps
In complex annotation projects, it's common to have multiple steps for each stage of the project. This allows your assets to be annotated, your annotations to be reviewed, and your revisions to have final notes added. Each task you prioritize in the project will carry its assigned priority level forward through all project steps.
This means that when you're establishing the priority of your tasks, you need to consider the impact across all steps. For example, one task may be important to annotate, but less important to review or to QA, meaning that its overall priority should be set relatively lower compared to a task that has a higher priority across all steps.
📘 Note
Along with determining the average priority of your tasks, you can also change the priority of tasks as they move through the different steps, following the original steps for prioritizing a task.
Exporting tasks
You can export tasks at any time to work on them in other software, store them for your records, or share them with others.
- Apply the filters to narrow down the tasks you want to export.
- Select the tasks you need using the checkboxes, or click the first checkbox to select all tasks.
- Use the top action tools bar and click the Export button.
- In the Export Tasks window, choose the desired export type and file format.
- Click Export to initiate the process.
- Once the export is complete, click Download to save the file to your device.
Upload tasks
Tasks are typically uploaded using CSV or JSON files. Ensure your file meets the platform's input requirements. Read more
Viewing task history
It is possible to view the history of actions taken on tasks. To do so, click the View task history link above the task table. Within the history screen, you can view the upload history or archive history for the project.
Upload History
The upload history is shown as a table, which contains the upload ID, the date the upload was created, who created it, the number of tasks which successfully passed, and the status of the upload.
Uploads can have the following statuses:
- Complete: The upload process has completed. It is still possible that some tasks could not be created because of errors.
- Starting: The upload job is starting.
- Preprocessing: The task assets are getting preprocessed.
- Canceled: The task creation job was cancelled by the user.
- Error: The job could not be completed because of an error.
- Waiting Upload: The job is still waiting for the user to upload a task creation file.
For jobs in the Error state or the Completed state for which not all tasks were successfully created, error details can be expanded by clicking on the arrow at the right of the upload row.
Archive History
The archive history is shown as a table, which contains the archive ID, the date the archive was done, who archived the tasks, and the number of tasks archived. From the table, it is possible to download the data for the archived tasks in order to recreate them or investigate more information about the tasks.
For tasks automatically archived after the inactivity period configured in projects, the Created By column will show N/A.
Viewing a task
To view a task in read-only mode:
- Click the task ID.
- Review progress without making any changes.
- You can even view tasks being actively worked on by annotators.
Comparing sets of answers
To compare annotations or model predictions:
- Open the Submission History dropdown in the navigation bar.
- Select Compare Answers.
- Use the menu to toggle between submissions.
- D represents default answers.
- Other options correspond to manually annotated answers per workflow step and round.
- Rounds increment when a task is rejected and requires re-annotation.
- While toggling between answers, your context (frame, zooming, panning, and selected shape) will remain intact, allowing for easy comparison across submissions.