byt5-small

Papers using or citing this model 2

• ByT5: Towards a token-free future with pre-trained byte-to-byte models 804 citations · 2021 · arXiv (Cornell University) · arXiv

  Most widely-used pre-trained language models operate on sequences of tokens corresponding to word or subword units. By comparison, token-free models that operate directly on raw text (bytes or characters) have many benefits: they can...

• TWEETQA: A Social Media Focused Question Answering Dataset 87 citations · 2019 · arXiv (Cornell University) · arXiv

  With social media becoming increasingly pop-ular on which lots of news and real-time eventsare reported, developing automated questionanswering systems is critical to the effective-ness of many applications that rely on real-time...