Active FAQ
Are Annotate and Active Projects the same?
The short answer is no. Here are the differences:
- Annotate Projects are made of Datasets (data), Ontologies, and Workflows. Once Annotation Projects get underway, labels and comments also become part of the Annotate Projects.
Active is integrated with the Encord platform, which by extension means Active is also integrated with Annotate. Active Projects import portions of Annotate Projects. Active Projects import Annotate Project data, Ontologies, labels, and comments but not Workflows.
What is a quality metric?
A quality metric is a function that can be applied to your data, labels, and model predictions to assess their quality and rank them accordingly.
Encord Active uses these metrics to analyze and decompose your data, labels, and predictions.
Here is a blog post on how we like to think about quality metrics.
To learn more about quality metrics, go here.
Quality metrics are not only limited to those that ship with Encord Active. In fact, the power lies in defining your own quality metrics for indexing your data just right. Here is the documentation for writing your own metrics.
How do I write my own quality metrics?
See our documentation on writing your own metrics.
How do I use Encord Active for active learning?
Encord Active supports the active learning process by allowing you to
- Explore your data to select what to label next
- Employ acquisition functions to automatically select what to label next
- Find label errors that potentially harm your model performance
- Sending data to Encord’s Annotation module for labeling
- Automatically decompose your model performance to help you determine where to put your focus for the next model iteration
- Tag subsets of data to set aside test sets for specific edge cases for which you want to maintain your model performance between each production model
//: # (Uploading your data to Encord Annotate is as simple as clicking the Export to Encord button on the Filter and Export page. This creates an Ontology, a Dataset, and a Project on Encord Annotate as well as provide you with links to all three.)
//: # (1. Add your public ssh key to Encord Annotate)
How do I import my model predictions?
Active supports importing predictions in the following ways:
-
Use the Active UI to import your model predictions.
-
Use the Active API to import your model predictions.
How can I do dataset management with Encord Active?
Use Collections in your Active Projects to handle all your Project data (not just Dataset) needs.
Once you’ve created a Collection, you can send the Collection to Annotate in the following ways:
-
Apply the Collection directly to your existing Annotate Projects
-
Create a new Dataset and attached Annotate Project off of your Collection
-
Apply classifications to all frames/images in your Collections directly to your existing Annotate Projects
How do I version my data and labels through Encord Active?
While you can version your data and labels using Active, Annotate supports data versioning and label versioning.
You can use Collections to version your Projects using Active.
How do I use Encord Active to find label errors?
Use Label Overview shortcuts and Label Quality Metrics to find label errors.
Can I use Encord Active without an Encord account
You need an Annotate account to use Active.
Does data stay within my local environment/cloud?
Yes!
If your data is stored in cloud storage (AWS, GCP, Azure, OTC), your data remains there.
How do I add my own embeddings?
Contact your Encord representative for more information to add embeddings to Active.
What should I do if I encounter an error?
If you come across an error, don’t worry! We’re here to assist you. Reach out to us on Slack or shoot us an email, and we’ll promptly address your concern.
Additionally, we greatly appreciate it if you could report the issue on GitHub. Your feedback and bug reports help us improve Encord Active for everyone.