Nemotron-Mini-4B-Instruct

2.8K downloads 0 likes on ModelScope updated

Papers using or citing this model 2

  • Compact Language Models via Pruning and Knowledge Distillation 203 citations · 2024 · arXiv (Cornell University) · arXiv

    Large language models (LLMs) targeting different deployment scales and sizes are currently produced by training each variant from scratch; this is extremely compute-intensive. In this paper, we investigate if pruning an existing LLM and...

  • Nemotron-4 15B Technical Report 36 citations · 2024 · arXiv (Cornell University) · arXiv

    We introduce Nemotron-4 15B, a 15-billion-parameter large multilingual language model trained on 8 trillion text tokens. Nemotron-4 15B demonstrates strong performance when assessed on English, multilingual, and coding tasks: it...