Annotate Projects are made of Datasets (data), Ontologies, and Workflows. Once Annotation Projects get underway, labels and comments also become part of the Annotate Projects.
Active is integrated with the Encord platform, which by extension means Active is also integrated with Annotate. Active Projects import portions of Annotate Projects. Active Projects import Annotate Project data, Ontologies, labels, and comments but not Workflows.
A quality metric is a function that can be applied to your data, labels, and model predictions to assess their quality and rank them accordingly.Encord Active uses these metrics to analyze and decompose your data, labels, and predictions.Here is a blog post on how we like to think about quality metrics.To learn more about quality metrics, go here.Quality metrics are not only limited to those that ship with Encord Active. In fact, the power lies in defining your own quality metrics for indexing your data just right. Here is the documentation for writing your own metrics.
Encord Active supports the active learning process by allowing you to
Explore your data to select what to label next
Employ acquisition functions to automatically select what to label next
Find label errors that potentially harm your model performance
Sending data to Encord’s Annotation module for labeling
Automatically decompose your model performance to help you determine where to put your focus for the next model iteration
Tag subsets of data to set aside test sets for specific edge cases for which you want to maintain your model performance between each production model
//: # (Uploading your data to Encord Annotate is as simple as clicking the Export to Encord button on the Filter and Export page. This creates an Ontology, a Dataset, and a Project on Encord Annotate as well as provide you with links to all three.)//: # (1. Add your public ssh key to Encord Annotate)
How can I do dataset management with Encord Active?
Use Collections in your Active Projects to handle all your Project data (not just Dataset) needs.Once you’ve created a Collection, you can send the Collection to Annotate in the following ways:
Apply the Collection directly to your existing Annotate Projects
Create a new Dataset and attached Annotate Project off of your Collection
Apply classifications to all frames/images in your Collections directly to your existing Annotate Projects
How do I version my data and labels through Encord Active?
While you can version your data and labels using Active, Annotate supports data versioning and label versioning.You can use Collections to version your Projects using Active.
If you come across an error, don’t worry! We’re here to assist you.
Reach out to us on Slack or shoot us an email, and we’ll promptly address your concern.Additionally, we greatly appreciate it if you could report the issue on GitHub. Your feedback and bug reports help us improve Encord Active for everyone.