opt-125m

Papers using or citing this model 2

• Language Models are Few-Shot Learners 64.8K citations · 2020 · arXiv (Cornell University) · arXiv

  Recent work has demonstrated substantial gains on many NLP tasks and benchmarks by pre-training on a large corpus of text followed by fine-tuning on a specific task. While typically task-agnostic in architecture, this method still...

• OPT: Open Pre-trained Transformer Language Models 5K citations · 2022 · arXiv

  Large language models, which are often trained for hundreds of thousands of compute days, have shown remarkable capabilities for zero- and few-shot learning. Given their computational cost, these models are difficult to replicate...