Skip to main content

CircleDict Objects

x

normalized center x [0, 1]

y

normalized center y [0, 1]

r

primary semi-axis radius, normalized to image width

stretch

ratio of secondary semi-axis to primary (1.0 = circle, !=1 = ellipse)

theta

rotation in degrees, clockwise in screen space (matches RBB convention)

EllipseDict Objects

x

normalized center x [0, 1]

y

normalized center y [0, 1]

rx

horizontal semi-axis, normalized to image width

ry

vertical semi-axis, normalized to image height

theta

rotation in degrees, clockwise in screen space

PointFrameCoordinatesDict Objects

point

Actually the key here is always ‘0’, but no way to type that.

Point3DFrameCoordinatesDict Objects

point

Actually the key here is always ‘0’, but no way to type that.

PolygonDict

Introduced to support complex polygons

PolygonFrameCoordinatesDict Objects

polygons

This was introduced to support complex polygons.

Cuboid2DPerspectiveDict Objects

Perspective projection cuboid dict with vanishing point and scale ratio.

front

Flat array of coordinates [x1, y1, x2, y2, …]

Cuboid2DIsometricDict Objects

Isometric projection cuboid dict with offset.

front

Flat array of coordinates [x1, y1, x2, y2, …]

Cuboid2DDict

Union type for 2D cuboid dict - either perspective or isometric projection.

AnswerDict Objects

Answer for attributes/classifications.

BaseFrameObjectRequired Objects

Required fields for frame object in label blob.

BaseFrameObject Objects

All fields for base frame object in label blob. Shape data is not included here.

createdBy

This is optional because we set the default to the current user on the BE

lastEditedBy

This is optional because we set the default to the current user on the BE

reviews

TODO: Remove this as its deprecated

isDeleted

TODO: Remove this as its deprecated, although its still being sent out

event

Only present on event-based (continuous scene) label rows, where an entry is a sparse event on a continuous timeline rather than a label on a frame. Missing reads as "upsert".

interpolate

Reserved per-keyframe field on continuous scenes, in practice unset. Unset, null and "hold" all mean no interpolation; every other mode is refused, as the SDK would have to interpolate to read it correctly.

SegmentationObject Objects

segmentation

RLE encoded segmentation string

FrameObject

Frame object in the label blob. Contains shape data, and is differentiated by the ‘shape’ field.

FrameClassification Objects

Frame classification in label blob. No answers here, they are in the ClassificationAnswer

createdBy

This can be optional because we set the default to current the user at the BE

AttributeDict Objects

Attribute for a classification OR an object. Note that these are inappropriately called “classifications” in ObjectAnswer and ClassificationAnswer.

DynamicAttributeObjectRequired Objects

Required fields for dynamic attribute object in object_actions.

DynamicAttributeObject Objects

All fields for dynamic attribute object in object_actions.

ClassificationAnswer Objects

Classification answer that contains attributes for the classification

reviews

TODO: Remove this as its deprecated

ObjectAnswerForNonGeometric Objects

For non-geometric modalities, metadata is contained in object answers, instead of frame

spaces

Important for non-geometric shapes, where space info must live on ObjectAnswer

LabelRowDict Objects

Work in progress type definition of a label row