Image and Video Annotation
What are we doing?
Using a very small dataset of fruit (apples, bananas, blueberries, cherries, kiwi, persimmons, and strawberries) you will learn how to use Encord with images and videos.
For all the tasks in this end-to-end process, all artifacts, relevant information, and code is provided. How you want to proceed is up to you. Each section provides a path to use Encord from basic use to SOTA (state-of-the-art) complexity. Pick the path at each STEP that suits your needs best.
Our Goals
Our basic goals are this:
-
Import data: Get our data into Encord. We might want to manage and curate our data, but that is going to depend on how much data we have or how complex our Projects are.
-
Label data: Label our data and export the labels. This is going to involve creating a Project and then actually labelling and reviewing our labels. Once our labels are okay we can export them from Encord.
-
Validate our labels: At scale, using Active streamlines and significantly speeds up validating our labels.
-
Evaluate our model: Compare and optimize our model’s performance using Active.
How you intend to use your data in Encord dictates the best way to use Encord. Using cloud integrations, the SDK, or Task Agents adds complexity to using Encord, but at scale, this complexity adds significant value.
STEP 1: Import Data
Performing ANY of these tasks results in creating the Dataset E2E Fruit Dataset for use with the Project.
Import Local Data - UI
Testing and basic annotation Projects using local data.
Import/Register Cloud Data - UI - Cloud-synced
Testing and basic annotation Projects using cloud data.
Import/Register Cloud Data - UI
Testing and basic annotation Projects using cloud data.
Import/Register Cloud Data - SDK
Programmatic testing and basic annotation Projects using cloud data.
Import + Curate Cloud Data - UI
Manage and curate large amounts of data for one or more Projects, using Index Premium.
Import + Curate Cloud Data - SDK
Programmatic managing and curating large amounts of data for one or more Projects, using Index Premium.
STEP 2: Create Project
Performing ANY of these tasks results in creating the Project E2E Fruit Project to annotate.
- The Ontology is the same for ALL tasks.
- The Workflow varies depending on the task.
Create Project - UI
Create Projects (Ontologies, Workflows, and Projects) using the Encord UI.
Create Project - SDK
Create Projects (Ontologies, Workflows, and Projects) using the SDK.
Create Consensus Project - UI
Create Consensus Projects (Ontologies, Workflows, and Projects) using the UI.
Create Consensus Project - SDK
Create Consensus Projects (Ontologies, Workflows, and Projects) using the UI.
Create Project - Import Labels
Create Projects (Ontologies, Workflows, and Projects) for use with your own labels.
Create Project - Import Predictions
Create Projects (Ontologies, Workflows, and Projects) for use with your own model predictions.
Create Project - Task Agents
Create Projects (Ontologies, Workflows, and Projects) for use with Task Agents.
STEP 3: Label Data
Performing ANY of these tasks results in labelling the data and reviewing the labels on the data in the Project E2E Fruit Project.
Manually Label
Manually annotate and review your data and then export your labels.
Use SAM 2
Use SAM 2 and SAM 2 tracking to annotate your data, review using humans, and then export your labels using the UI or the SDK.
Use SAM 2 - Consensus
Use SAM 2 and SAM 2 tracking to annotate your data on a Consensus Project, review using humans, and then export your labels using the UI or the SDK.
Import Labels
Use your model’s labels and review your data (with humans in the loop).
Import Predictions
Use your model’s predictions.
Use Task Agents
Use Task Agents to annotate and review your data (with humans in the loop), then use the SDK to export your labels.
STEP 4: Label Verification
Label verification can be performed visually in Annotate as a reviewer. However, at scale, using Active to verify the quality of your labels significantly improves the effectiveness and speed of label verification.
Label Verification - UI
Verify the quality of your labels using Active.
Label Verification - SDK
Programmatically verify the quality of your labels using Active.
STEP 5: Model Evaluation
Use Active to compare and optimize your model’s performance.