deepseek-coder-v2-instruct-awq
247 downloads
2 likes
on ModelScope
updated
Papers using or citing this model 1
-
DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Models
In the era of large language models, Mixture-of-Experts (MoE) is a promising architecture for managing computational costs when scaling up model parameters. However, conventional MoE architectures like GShard, which activate the top-$K$...