Main Content

Image and Video Ground Truth Labeling

Interactive image and video labeling for object detection, semantic segmentation, instance segmentation, and image classification

Use the Image Labeler and Video Labeler apps to interactively label ground truth data in a collection of images, a video, or a sequence of images. You can label rectangular regions of interest (ROIs) or polylines for object detection, pixels for semantic segmentation, polygons for instance segmentation, and scenes for image classification. The apps also include computer vision algorithms to automate the labeling of ground truth data for use with detection and tracking algorithms. They also provide an API and workflow that enables you to import your own algorithms to automate the labeling of ground truth data.

To get started labeling a collection of images, see Get Started with the Image Labeler. To get started labeling a video or sequence of images, see Get Started with the Video Labeler.

Apps

Image LabelerLabel images for computer vision applications
Video LabelerLabel video for computer vision applications

Functions

expand all

Load Data

groundTruthDataSourceObject for storing ground truth data sources
pixelLabelDatastoreDatastore for pixel label data
boxLabelDatastoreDatastore for bounding box label data
groundTruthGround truth label data

Create Label Definitions

labelDefinitionCreatorObject for storing, modifying and creating label definitions table
create Create label definitions table from the label definition creator object
infoDisplay information about a label, sublabel, or attribute stored in label definition creator object

Add

addLabelAdd label to label definition creator object
addSublabelAdd sublabel to label in label definition creator object
addAttributeAdd attributes to label or sublabel in label definition creator object

Edit

editLabelGroupModify a label group name
editGroupNameChange group name
editLabelDescriptionModify description of label or sublabel in label definition creator object
editAttributeDescriptionModify description of attribute in label definition creator object

Remove

removeLabelRemove label from label definition creator object
removeSublabelRemove sublabel from label in label definition creator object
removeAttributeRemove attribute from label or sublabel in label definition creator object

Action Flags

initializeInitialize state for algorithm execution (optional)
runRun label automation on every frame in interval
terminateTerminate automated algorithm (optional)

Validation

checkSetupSet up validation (optional)
checkLabelDefinitionValidate label definition

Algorithm

vision.labeler.AutomationAlgorithmInterface for algorithm automation in ground truth labeling
settingsDialogDisplay algorithm settings (optional)
vision.labeler.mixin.TemporalMixin interface for adding temporal context to automation algorithms
vision.labeler.mixin.BlockedImageAutomationMixin interface for performing blocked image automation
blockedImageAutomationAlgorithmImplements the blocked image automation algorithm
supportsReverseAutomationSet reverse algorithm automation flag

Store Data

groundTruthGround truth label data
pixelLabelDatastoreDatastore for pixel label data
boxLabelDatastoreDatastore for bounding box label data
changeFilePathsChange file paths in ground truth data

Select Labels

selectLabelsByGroupSelect ground truth labels by label group
selectLabelsByTypeSelect ground truth labels by label type
selectLabelsByNameSelect ground truth labels by label name

Enumerate Attribute and Label Types

attributeTypeAttribute type enumerations for labeling
labelTypeLabel type enumerations for labeling

Create Training Data for Object Detectors

objectDetectorTrainingDataCreate training data for an object detector
pixelLabelTrainingDataCreate training data for semantic segmentation from ground truth

Topics

Get Started

Choose an App to Label Ground Truth Data

Decide which app to use to label ground truth data: Image Labeler, Video Labeler, Ground Truth Labeler, Lidar Labeler, Signal Labeler, or Audio Labeler.

Get Started with the Image Labeler

Interactively label rectangular ROIs for object detection, pixels for semantic segmentation, polygons for instance segmentation, and scenes for image classification.

Get Started with the Video Labeler

Interactively label rectangular ROIs for object detection, pixels for semantic segmentation, polygons for instance segmentation, and scenes for image classification in a video or image sequence.

Keyboard Shortcuts and Mouse Actions for Image Labeler

Use keyboard shortcuts and mouse actions to increase productivity while using the Image Labeler app.

Keyboard Shortcuts and Mouse Actions for Video Labeler

Use keyboard shortcuts and mouse actions to increase productivity while using the Video Labeler app.

Load Ground Truth Data Sources

Use Custom Image Source Reader for Labeling

Create a reader function to load a custom image data source into the Ground Truth Labeler or Video Labeler.

Label Ground Truth

Label Pixels for Semantic Segmentation

Label pixels for training a semantic segmentation network by using a labeling app.

Label Objects Using Polygons

Label objects using polygons.

Use Sublabels and Attributes to Label Ground Truth Data

Learn how ROI sublabels and attributes work in labeling apps.

View Summary of Ground Truth Labels

View a summary of ROI and scene labels in a labeling app session.

Label Large Images in Image Labeler

This section describes the differences with using the Image Labeler app with blocked images.

Automate Labeling

Create Automation Algorithm for Labeling

Create a custom automation algorithm to use in a labeling app.

Temporal Automation Algorithms

Create a time-based custom tracking algorithm to import into a labeling app.

Blocked Image Automation Algorithms

Create a blocked image custom automation algorithm to import into a labeling app.

Use Ground Truth Labels

Share and Store Labeled Ground Truth Data

Share and store labeled ground truth data exported from labeling apps.

How Labeler Apps Store Exported Pixel Labels

Learn how the labeling apps store pixel label data.

Training Data for Object Detection and Semantic Segmentation

Create training data for object detection or semantic segmentation using the Image Labeler or Video Labeler.

Featured Examples