Quality metrics

Quality metrics evaluate the quality of various components in your computer vision infrastructure, and therefore constitute the foundation of Encord Active. They are additional parameterization options added onto your data, labels, and models; they are ways of indexing your data, labels, and models in semantically interesting and relevant ways.

Encord Active (EA) is designed to compute, store, inspect, manipulate, and use quality metrics for a wide array of functionality. It hosts a library of these quality metrics, and importantly allows you to customize by writing your own “Quality Metrics” to calculate/compute QMs across your dataset.

We have split the metrics into the following categories:

• Video Quality Metrics: For analyzing and working with your video data. These metrics operate on images or individual video frames and are heuristic in the sense that they depend on the image content without labels.

  • Example metrics: Green Value, Contrast, Sharpness

• Data Quality Metrics: For analyzing and working with your frame-level data. These metrics operate on images or individual video frames and are heuristic in the sense that they depend on the image content without labels.

  • Example metrics: Area, Brightness, Green Value, Sharpness.

• Label Quality Metrics: For analyzing and working with your labels. These metrics operate on the geometries of objects, like bounding boxes, polygons, segmentations and polylines, and the heuristics of classifications.

  • Example metrics: Aspect Ratio, Classification Quality, Occlusion Risk.