---
_id: '18248'
abstract:
- lang: eng
  text: Learning an object detection or retrieval system requires a large data set
    with manual annotations. Such data are expensive and time-consuming to create
    and therefore difficult to obtain on a large scale. In this work, we propose using
    the natural correlation in narrations and the visual presence of objects in video
    to learn an object detector and retriever without any manual labeling involved.
    We pose the problem as weakly supervised learning with noisy labels, and propose
    a novel object detection and retrieval paradigm under these constraints. We handle
    the background rejection by using contrastive samples and confront the high level
    of label noise with a new clustering score. Our evaluation is based on a set of
    ten objects with manual ground truth annotation in almost 5000 frames extracted
    from instructional videos from the web. We demonstrate superior results compared
    to state-of-the-art weakly- supervised approaches and report a strongly-labeled
    upper bound as well. While the focus of the paper is object detection and retrieval,
    the proposed methodology can be applied to a broader range of noisy weakly-supervised
    problems.
article_number: '9150938'
article_processing_charge: No
author:
- first_name: Elad
  full_name: Amrani, Elad
  last_name: Amrani
- first_name: Rami
  full_name: Ben-Ari, Rami
  last_name: Ben-Ari
- first_name: Inbar
  full_name: Shapira, Inbar
  last_name: Shapira
- first_name: Tal
  full_name: Hakim, Tal
  last_name: Hakim
- first_name: Alexander
  full_name: Bronstein, Alexander
  id: 58f3726e-7cba-11ef-ad8b-e6e8cb3904e6
  last_name: Bronstein
  orcid: 0000-0001-9699-8730
citation:
  ama: 'Amrani E, Ben-Ari R, Shapira I, Hakim T, Bronstein AM. Self-supervised object
    detection and retrieval using unlabeled videos. In: <i>2020 IEEE/CVF Conference
    on Computer Vision and Pattern Recognition Workshops (CVPRW)</i>. IEEE; 2020.
    doi:<a href="https://doi.org/10.1109/cvprw50498.2020.00485">10.1109/cvprw50498.2020.00485</a>'
  apa: 'Amrani, E., Ben-Ari, R., Shapira, I., Hakim, T., &#38; Bronstein, A. M. (2020).
    Self-supervised object detection and retrieval using unlabeled videos. In <i>2020
    IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)</i>.
    Seattle, WA, United States: IEEE. <a href="https://doi.org/10.1109/cvprw50498.2020.00485">https://doi.org/10.1109/cvprw50498.2020.00485</a>'
  chicago: Amrani, Elad, Rami Ben-Ari, Inbar Shapira, Tal Hakim, and Alex M. Bronstein.
    “Self-Supervised Object Detection and Retrieval Using Unlabeled Videos.” In <i>2020
    IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)</i>.
    IEEE, 2020. <a href="https://doi.org/10.1109/cvprw50498.2020.00485">https://doi.org/10.1109/cvprw50498.2020.00485</a>.
  ieee: E. Amrani, R. Ben-Ari, I. Shapira, T. Hakim, and A. M. Bronstein, “Self-supervised
    object detection and retrieval using unlabeled videos,” in <i>2020 IEEE/CVF Conference
    on Computer Vision and Pattern Recognition Workshops (CVPRW)</i>, Seattle, WA,
    United States, 2020.
  ista: Amrani E, Ben-Ari R, Shapira I, Hakim T, Bronstein AM. 2020. Self-supervised
    object detection and retrieval using unlabeled videos. 2020 IEEE/CVF Conference
    on Computer Vision and Pattern Recognition Workshops (CVPRW). IEEE/CVF Conference
    on Computer Vision and Pattern Recognition Workshops, 9150938.
  mla: Amrani, Elad, et al. “Self-Supervised Object Detection and Retrieval Using
    Unlabeled Videos.” <i>2020 IEEE/CVF Conference on Computer Vision and Pattern
    Recognition Workshops (CVPRW)</i>, 9150938, IEEE, 2020, doi:<a href="https://doi.org/10.1109/cvprw50498.2020.00485">10.1109/cvprw50498.2020.00485</a>.
  short: E. Amrani, R. Ben-Ari, I. Shapira, T. Hakim, A.M. Bronstein, in:, 2020 IEEE/CVF
    Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), IEEE,
    2020.
conference:
  end_date: 2020-06-19
  location: Seattle, WA, United States
  name: IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops
  start_date: 2020-06-14
date_created: 2024-10-08T13:05:08Z
date_published: 2020-07-28T00:00:00Z
date_updated: 2024-12-12T09:59:41Z
day: '28'
doi: 10.1109/cvprw50498.2020.00485
extern: '1'
language:
- iso: eng
month: '07'
oa_version: None
publication: 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops
  (CVPRW)
publication_identifier:
  eissn:
  - 2160-7516
  isbn:
  - '9781728193618'
publication_status: published
publisher: IEEE
quality_controlled: '1'
scopus_import: '1'
status: public
title: Self-supervised object detection and retrieval using unlabeled videos
type: conference
user_id: 3E5EF7F0-F248-11E8-B48F-1D18A9856A87
year: '2020'
...