RESEARCH PAPERYear 2023

Sigmoid Loss for Language Image Pre-Training

Xiaohua Zhai; Basil Mustafa; Alexander Kolesnikov; Lucas Beyer

Classification

Major category: Components of WAMs
Quadrant: Not applicable
Architecture: Not applicable
Prediction paradigm: Not applicable
Subcategories: Visual encoders & representations Language & VLM backbones
Source review status: Verified from primary sources

Category review. SigLIP provides pretrained image/text encoders with aligned embeddings learned through pairwise sigmoid supervision. These transferable features are explicitly named as representation components in the manuscript. Reading evidence

AT A GLANCE

Contribution

A contribution summary has not been added yet.

Abstract

An abstract has not been added yet.

Affiliations

Not listed in the collection.

BibTeX

@inproceedings{siglip,
  author       = {Xiaohua Zhai and
                  Basil Mustafa and
                  Alexander Kolesnikov and
                  Lucas Beyer},
  title        = {Sigmoid Loss for Language Image Pre-Training},
  booktitle    = {ICCV},
  pages        = {11941--11952},
  year         = {2023},
  
}

Classification

Contribution

Abstract

Affiliations

BibTeX

More in this category

V-JEPA 2.1: Unlocking Dense Features in Video Self-Supervised Learning

DINOv3

World Simulation with Video Foundation Models for Physical AI