Copied
Docs

Contact Us

If you still have questions or prefer to get help directly from an agent, please submit a request.
We’ll get back to you as soon as possible.

Please fill out the contact form below and we will reply as soon as possible.

EMPLOYEE LOGIN
  • Home
  • Getting Started
  • Annotate
  • Tasks
  • API
  • Recipes
  • Tutorials
  • Integrations

Managing Tasks in the Platform

Updated at April 4th, 2025

This document provides a comprehensive guide to the platform's task management features, covering how to view, filter, prioritize, and perform actions on tasks. Whether you're monitoring progress, adjusting priorities, or exporting data, these tools help streamline workflows and improve overall productivity.

Navigating the Task Page: Side Bar Menu

This sidebar menu helps you navigate through the task page.

All: View a list of all tasks.

Reservations: See a list of reserved tasks.

Upload: Review the history of uploaded tasks.

Archive: Review the history of archived tasks.

This sidebar helps you move between different parts of the app. Each item has an icon and a label. In the next sections, we'll go through each one to explain what it does.

All: Viewing task list

The Tasks page is used to search for specific tasks and view detailed information about them.

By default, tasks are sorted by the last submitted date and created date. The results are paginated and include the following details:

Detail

Description

ID The unique identifier for the task
Created The date the task was created
Last Submitted The date the task was last submitted by an annotator
State

The current status of the task, which could be New, Rejected, In Progress, Completed, Delivered, or Acknowledged. If a task is set to be delivered but still processing, you may encounter the following sub-states:

  • Delivering Now: Scheduled for delivery, but the process is not yet complete (e.g., due to webhook processing)
  • Sent to CSE: Undergoing the post-processing flow configured for this project
Priority The priority assigned to the task. Default is 0, but it can be set to positive or negative values. Tasks with lower priority numbers are processed first
Client Batch ID The batch ID the task belongs to

Below, we dig into more information on specific actions.

 

Filtering tasks

Find specific tasks by opening the Filter menu. Results update dynamically as you adjust filter values. The results are paginated.

Upload tasks

Tasks are typically uploaded using CSV or JSON files. Ensure your file meets the platform's input requirements. Read more  

Task bulk actions

Use the Bulk Action menu to update the state or queue of a task, as well as the client patch ID. You can also use this menu to export or archive tasks.

Detail

Description

States

Actions that modify the task state:

  • Reject: Reject tasks back to the annotation queue.
  • Deliver: Mark the task as delivered. 
  • Acknowledge: Confirm that the task has been processed.
Queue

Actions that manage task availability in the queue:

  • Park: Make tasks unavailable to be picked up for annotation.
  • Unpark. Put the tasks back into the queue to be picked up for annotation.
  • Prioritize. Change the priority of the tasks. A lower priority value means they will be picked up first.
  • Reserve. Reserve tasks to a specific user. Only this user will be able to pick up the tasks for annotation.
Update Client Batch ID Modify the batch ID associated with the selected tasks
Archive Move tasks that are no longer needed to the archives

Detail

Description

States

Actions that modify the task state:

  • Reject: Reject tasks back to the annotation queue.
  • Deliver: Mark the task as delivered. 
  • Acknowledge: Confirm that the task has been processed.
Queue

Actions that manage task availability in the queue:

  • Park: Make tasks unavailable to be picked up for annotation.
  • Unpark. Put the tasks back into the queue to be picked up for annotation.
  • Prioritize. Change the priority of the tasks. A lower priority value means they will be picked up first.
  • Reserve. Reserve tasks to a specific user. Only this user will be able to pick up the tasks for annotation.

Below, we dig into more details on certain specific actions.

Prioritizing tasks

Tasks are assigned priority numbers to determine their order of allocation to annotators. By default, all tasks are assigned a priority value of 0

A priority value can be any whole number, either positive or negative. The system allocates tasks to annotators in the following order:

  • Tasks with the lowest priority number are allocated first
  • If multiple tasks share the same priority, the oldest task is allocated first

Adding Priority to a Task
To add a priority to a task:

  1. Select the task(s) from the list using the checkbox
    1. Once you select a task, the bulk action menu will become enabled and purple instead of grey.
  2. Select Queue item and on  Prioritize option
  3. A window will open where you can enter the priority number:
    1. Use the up and down arrows to adjust the priority value
  4. Click Cancel to ignore the action or Prioritize to confirm the change

 

The new priority values will be displayed for the tasks in the Priority column. 

📘 Note

You can assign priority numbers to tasks when you upload the tasks To learn more, see Uploading tasks.

 

Prioritizing tasks in additional steps

In complex annotation projects, it's common to have multiple steps for each stage of the project. This allows your assets to be annotated, your annotations to be reviewed, and your revisions to have final notes added. Each task you prioritize in the project will carry its assigned priority level forward through all project steps.

This means that when you're establishing the priority of your tasks, you need to consider the impact across all steps. For example, one task may be important to annotate, but less important to review or to QA, meaning that its overall priority should be set relatively lower compared to a task that has a higher priority across all steps.

📘 Note

Along with determining the average priority of your tasks, you can also change the priority of tasks as they move through the different steps, following the original steps for prioritizing a task.

 
 
 

Exporting tasks

You can export tasks at any time to work on them in other software, store them for your records, or share them with others.

  1. Apply the filters to narrow down the tasks you want to export.
  2. Select the tasks you need using the checkboxes, or click the first checkbox to select all tasks.
  3. Use the “Bullk Action" menu and click the Export option.
  4. In the Export Tasks window, choose the desired export type and file format.
  5. Click Export to initiate the process.
  6. Once the export is complete, click Download to save the file to your device.
 
 

Archive History

The archive history is shown as a table, which contains the archive ID, the date the archive was done, who archived the tasks, and the number of tasks archived. From the table, it is possible to download the data for the archived tasks in order to recreate them or investigate more information about the tasks.

For tasks automatically archived after the inactivity period configured in projects, the Created By column will show N/A.

 
 

Reservations

When you click this option in the menu, you’ll access a table showing all reserved tasks. Each row represents a user, making it easy to spot when someone has multiple reserved tasks within a project. From this view, you can also release reserved tasks by simply clicking the "Release" button.

Upload

From this section, you can review the upload task history, which is displayed in a table that includes the upload ID, creation date, creator, number of successfully processed tasks, and the upload status.

Uploads can have the following statuses:

  • Complete: The upload process has completed. It is still possible that some tasks could not be created because of errors.
  • Starting: The upload job is starting.
  • Preprocessing: The task assets are getting preprocessed.
  • Canceled: The task creation job was cancelled by the user.
  • Error: The job could not be completed because of an error.
  • Waiting Upload: The job is still waiting for the user to upload a task creation file.

For jobs in the Error state or the Completed state for which not all tasks were successfully created, error details can be expanded by clicking on the arrow at the right of the upload row.

Archive

From this section, you can review archived tasks. The archive is displayed in a table that includes task details such as archive ID, the creation date, the user who create it.

Viewing a Task

To view a task in read-only mode:

  1. Click the task ID.
  2. Review progress without making any changes.
  3. You can even view tasks being actively worked on by annotators.

Comparing sets of answers 

 

 

 

 

 

To compare annotations or model predictions:

  1. Open the Submission History dropdown in the navigation bar.
  2. Select Compare Answers.
  3. Use the menu to toggle between submissions.
    1. D represents default answers.
    2. Other options correspond to manually annotated answers per workflow step and round.
      1. Rounds increment when a task is rejected and requires re-annotation.
  4. While toggling between answers, your context (frame, zooming, panning, and selected shape) will remain intact, allowing for easy comparison across submissions.
     
task status task viewing sama validate

Was this article helpful?

Yes
No
Give feedback about this article
Navigating the Task Page: Side Bar Menu All: Viewing task list Filtering tasks Upload tasks Task bulk actions Reservations Upload Archive Viewing a Task Comparing sets of answers

The first B Corp-certified AI company

  • Security
  • Terms
  • Privacy
  • Quality & Information

Copyright © 2023 Samasource Impact Sourcing, Inc. All rights reserved.


Knowledge Base Software powered by Helpjuice

Expand