RESEARCH PAPERYear 2021

Learning Transferable Visual Models From Natural Language Supervision

Alec Radford; Jong Wook Kim; Chris Hallacy; Aditya Ramesh; Gabriel Goh; Sandhini Agarwal; Girish Sastry; Amanda Askell; Pamela Mishkin; Jack Clark; Gretchen Krueger; Ilya Sutskever

Read paper PDF

Classification

View four quadrants

Major category: Components of WAMs
Quadrant: Not applicable
Architecture: Not applicable
Prediction paradigm: Not applicable
Subcategories: Visual encoders & representations Language & VLM backbones
Source review status: Explicit in survey

Category review. CLIP learns transferable image/text encoders and aligned normalized embeddings. The manuscript explicitly uses these as global text conditioning and visual semantic representation components. Reading evidence

AT A GLANCE

Contribution

A contribution summary has not been added yet.

Abstract

An abstract has not been added yet.

Affiliations

Not listed in the collection.

BibTeX

@inproceedings{clip,
  author       = {Alec Radford and
                  Jong Wook Kim and
                  Chris Hallacy and
                  Aditya Ramesh and
                  Gabriel Goh and
                  Sandhini Agarwal and
                  Girish Sastry and
                  Amanda Askell and
                  Pamela Mishkin and
                  Jack Clark and
                  Gretchen Krueger and
                  Ilya Sutskever},
  title        = {Learning Transferable Visual Models From Natural Language Supervision},
  booktitle    = {ICML},
  pages        = {8748--8763},
  year         = {2021},
}

Classification

Contribution

Abstract

Affiliations

BibTeX

More in this category

V-JEPA 2.1: Unlocking Dense Features in Video Self-Supervised Learning

DINOv3

World Simulation with Video Foundation Models for Physical AI