Video-LLaVA-7B-hf

Papers using or citing this model 2

• Video-LLaVA: Learning United Visual Representation by Alignment Before Projection 1.9K citations · 2023 · arXiv (Cornell University) · arXiv

  The Large Vision-Language Model (LVLM) has enhanced the performance of various downstream tasks in visual-language understanding. Most existing approaches encode images and videos into separate feature spaces, which are then fed as...

• LanguageBind: Extending Video-Language Pretraining to N-modality by Language-based Semantic Alignment 494 citations · 2023 · arXiv (Cornell University) · arXiv

  The video-language (VL) pretraining has achieved remarkable improvement in multiple downstream tasks. However, the current VL pretraining framework is hard to extend to multiple modalities (N modalities, N>=3) beyond vision and...