ChatGLM-6B

Papers using or citing this model 2

• GLM: General Language Model Pretraining with Autoregressive Blank Infilling 2K citations · 2021 · arXiv (Cornell University) · arXiv

  There have been various types of pretraining architectures including autoencoding models (e.g., BERT), autoregressive models (e.g., GPT), and encoder-decoder models (e.g., T5). However, none of the pretraining frameworks performs the...

• GLM-130B: An Open Bilingual Pre-trained Model 1.3K citations · 2022 · arXiv (Cornell University) · arXiv

  We introduce GLM-130B, a bilingual (English and Chinese) pre-trained language model with 130 billion parameters. It is an attempt to open-source a 100B-scale model at least as good as GPT-3 (davinci) and unveil how models of such a...