gemma-tokenizer

796 downloads 1 likes on Hugging Face updated 2024-08-02

Model card

Copy of the Gemma tokenizer to use for CI / testing without an access token.

Get this model

hp get pcuenq/gemma-tokenizer

The huggingpeers CLI is not released yet. Once it ships, the command above will download the model. Until then, download the weights from Hugging Face.

Details

HuggingPeers ID: ID hpm-5uYPSN0xF43
Provider: Hugging Face
Revision: 2d1305b81caf
Organization: pcuenq
Pipeline: text-generation
Library: transformers
Published: 2024-08-02

Files 7

Total size: 20.8 MiB
LFS files: 2
Revision: 2d1305b81caf

Browse files & hashes →

Sources

Hugging Face · pcuenq/gemma-tokenizer (this)

View on Hugging Face ↗