Label logs allow you to view a log of actions taken in the label editor within the Encord web-app.
Viewing label logs
Our recipe for viewing label logs provides step-by-step instructions on how to:
- View label logs for all data units in a project, within a specified time frame.
- View label logs for particular data units in a project.
🗒️
Viewing label logs via the SDK
Open Recipe
Content
Note
Actions do not need to be submitted to appear in the log
Logs are generated in chronological order and contain the following:
| Log entry | Description | Note |
|---|---|---|
| log_hash | This log entry's ID | |
| user_hash | The user's ID | |
| user_email | The user's email address | |
| annotation_hash | The label instance's ID | "None" for actions that aren't labels or attributes |
| identifier | The label instance's ID | "None" for actions that aren't labels or Attributes |
| data_hash | The data unit's ID | |
| feature_hash | The ontology feature's ID | A feature can have multiple instances. Equivalent to the featureNodeHash found in the ontology's JSON |
| action | The action this log entry refers to | Please see the actions section for full details |
| label_name | The label's name | As specified in the ontology. Attributes are not named. |
| time_taken | The time taken to create the label (in milliseconds) | "None" for non-labeling related actions |
| created_at | The date and time the label action made | Date and time are given in the UTC time zone for all users |
| frame | The frame number the action was taken on | "None" refers to the first frame |
Log actions
The table below provides descriptions of all log actions.
| Action | Description |
|---|---|
| 0 | Add a label |
| 1 | Edit a label |
| 2 | Delete a label |
| 3 | Start labeling |
| 4 | End labeling |
| 11 | Submit a task |
| 12 | Approve a label |
| 13 | Reject a label |
| 14 | Click Save |
| 15 | Click Undo |
| 16 | Click Redo |
| 17 | Using bulk label operations |
| 19 | Zoom into the frame |
| 20 | Adjust the brightness |
| 21 | Using hotkeys |
| 22 | Open the editor settings |
| 23 | Add a classification or attribute |
| 24 | Edit a classification or attribute |
| 25 | Delete a classification or attribute |
| 26 | Approve a classification or attribute |
| 27 | Reject a classification or attribute |
| 28 | Submit an object or a classification label for review |
| 29 | Submit an attribute for review |
| 30 | The buffering icon appeared when the video was loading |
| 31 | A bitrate warning was shown |
| 32 | The 'Seeking' overlay way shown when skipping to a specific frame in a video |
Working with label logs
Tutorial: Checking Rejection and Approval rates for a project
Label logs provide a detailed record of actions taken during the labeling process. You can use these logs to analyze the rejection and approval rates of labels.
-
Use the recipe provided above to view label logs.
-
Filter log entries related to the actions "Approve a label" (Action 12) and "Reject a label" (Action 13).
-
Calculate Rejection and Approval Rates.
- Divide the number of approved or rejected tasks by the total number of reviewed tasks.
- To see the rate as a percentage, multiply the result by 100.
