Find Mislabeled Data Using Visual Layer Auto-Detection

Understand why data was detected as "mislabeled" by Visual Layer

Visual Layer analyzes the data in order to detect and surface suspected mislabeled data. This process involves identifying discrepancies between the Visual Layer analysis and the provided labeled.

Both Images and objects can be detected as mislabeled. Unlike image mislabels, object mislabels can result from incorrectly positioned or sized bounding boxes, leading to the capture of partial, occluded or multiple objects.

Visual Layer provides an explanation for the mis-detection of objects in the following form:

  • Object likely mislabeled as cup, possible correction "bowl".

  1. Go to Dataset Inventoryview and select a dataset by clicking on it
  2. Select the required view: Images view or Objects view
  3. In the top filter bar, go to "Issues" filter, select "mislabeled" and apply the filter. Alternatively, use the right pane "Issues" section and select "mislabeled".

πŸ“˜
  • The logical operator between items listed in the dropdown list of filters and within a section in the right pane is "OR".

  • The logical operator between the filter types (User tags, Labels, Issues, etc.) is "AND", as well as for items selected in multiple separate sections in the right pane.

Coco Dataset: "mislabels" filter in top bar

Coco Dataset: "mislabels" filter in top bar


Coco Dataset: "mislabels" filter in right pane

Coco Dataset: "mislabels" filter in right pane


  1. The returned results comprise clusters of images or objects, depending on the selected view, each containing mislabeled item.
Coco Dataset: Objects view, clusters consist of objects that were mislabeled

Coco Dataset: Objects view, clusters consist of objects that were mislabeled


  1. Explore the cluster view to find the objects that were detected as mislabeled.
Coco Dataset: mislabeled objects are highlighted in the selected cluster view

Coco Dataset: mislabeled objects are highlighted in the selected cluster view


Visual Layer Explainability

  1. Navigate to the Image screen by clicking on an image. Identify any mislabels and review the explanation under the "Issues" section. Take note of the confidence level provided by Visual Layer.
Coco Dataset: Image view with explainability on the mislabeled object

Coco Dataset: Image view with explainability on the mislabeled object


What’s Next

To select data to send for relabeling using Visual Layer continue to the next page.