SmolLM-1.7B-Instruct-quantized.w4a16

Papers using or citing this model 1

• GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformers 2.8K citations · 2022 · arXiv (Cornell University) · arXiv

  Generative Pre-trained Transformer models, known as GPT or OPT, set themselves apart through breakthrough performance across complex language modelling tasks, but also by their extremely high computational and storage costs....