Create Consensus Project - UI - Images and Videos
Learn how to create a Consensus Annotate Project with a Default Consensus Workflow.
You’ve got your data into the Encord, and now you want to evaluate inter-annotator agreement. This is where Consensus Projects come into play.
Consensus Projects consist of Ontologies, Consensus Workflows, Datasets, and Collaborators.
We’ve already got the E2E Fruit Dataset, so we’re going to make the Ontology. We’ll use the default Consensus workflow
and add some Collaborators.
In Consensus Projects, each data unit needs to be annotated and submitted by multiple Annotators before the data unit moves to the REVIEW stage. The default Consensus workflow
requires 3 Annotators to annotate and submit a data unit before the data unit moved to the REVIEW stage. The number of Annotators required for a data unit can be adjusted, but we will use the default value (3 Annotators).
Create Ontology
Our Ontology E2E Fruit Ontology
is going to have a number of object label types and classifications.
This Ontology is used for all Project creation types, from Basic to SOTA.
Class name | Label Type | Attributes |
---|---|---|
Blueberries | Polygon | Radio button: Type?
|
Cherries | Bounding box | Radio button: Type?
|
Apples | Bitmask | Radio button: Types?
|
Bananas | Polygon | Radio button: Type?
|
Kiwi | Bounding Box | Radio button: Type?
|
Persimmons | Bounding Box | Radio button: Type?
|
Strawberries | Bounding Box | Radio button: Type?
|
Ripe? | Classification | Radio button:
|
Type of fruit? | Classification | Radio button:
|
Start Ontology Creation
Add Objects
Add Classifications
Save Ontology
Create Project
This step brings the Dataset and Ontology you created together with Collaborators and the Workflow.
We’ll use the default Consensus workflow
for this Consensus Project. This is what the Consensus workflow
looks like:
To create the Consensus Project:
-
Click Projects > New annotation project.
-
Add the following:
- Project name:
E2E - Fruit - Project I
- Ontology:
E2E Fruit Ontology
- Dataset:
E2E Fruit Dataset
- Collaborators: Add your Annotators (label data), Reviewers (review labels), Team Managers (manage Annotators and Reviewers), and Project Admins (manage Project and export labels).
- Workflow: We’ll use the default
Consensus workflow
for the Project. This means 3 Annotators are required to annotate and submit a data unit before the data unit moves to the REVIEW stage.
- Project name:
Label Data
With your Consensus Project creation complete, you and your team are now ready to label your data.
Was this page helpful?