Draco-CoderMini-3B

Papers using or citing this model 2

• Qwen2.5 Technical Report 5.5K citations · 2024 · arXiv (Cornell University) · arXiv

  In this report, we introduce Qwen2.5, a comprehensive series of large language models (LLMs) designed to meet diverse needs. Compared to previous iterations, Qwen 2.5 has been significantly improved during both the pre-training and...

• YaRN: Efficient Context Window Extension of Large Language Models 690 citations · 2023 · arXiv (Cornell University) · arXiv

  Rotary Position Embeddings (RoPE) have been shown to effectively encode positional information in transformer-based language models. However, these models fail to generalize past the sequence length they were trained on. We present YaRN...