data2vec-vision-large

Papers using or citing this model 2

• BEiT: BERT Pre-Training of Image Transformers 4K citations · 2021 · arXiv (Cornell University) · arXiv

  We introduce a self-supervised vision representation model BEiT, which stands for Bidirectional Encoder representation from Image Transformers. Following BERT developed in the natural language processing area, we propose a masked image...

• data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language 1.3K citations · 2022 · International Conference on Machine Learning · arXiv

  While the general idea of self-supervised learning is identical across modalities, the actual algorithms and objectives differ widely because they were developed with a single modality in mind. To get us closer to general...