Hugging Peers

miniLLM_tokenizer

☆ Save
by kayson2026 word-segmentation
0 downloads 0 likes on ModelScope updated

ModelScope

kayson2026/miniLLM_tokenizer · model repository official

Open upstream ↗
Revision
master
Files
9
Downloaded from this source
0

Provider-specific. This path, revision and file list belong to ModelScope alone. A different source for the same model may publish different files, or the same names with different contents — which is why nothing here is merged across providers.

Files 9 · revision master

Hashes: Git OID identifies the file in the repository; LFS SHA256 is the fingerprint of a large file's contents; Xet is the provider's own content fingerprint. Expand “hashes” on any row for the full values.

  • .gitattributes 2.1 KiB 6e0d4a1b0ac7
    hashes
    LFS SHA256
    6e0d4a1b0ac7a815d39ab2aedbb6e5695c9688b440104c0976bc06cb7fd079bf
  • chat_template.jinja 2.2 KiB 86c83879b300
    hashes
    LFS SHA256
    86c83879b300f09612f65526b8fb53818546fae88d396598b294d0d8048e1ebf
  • configuration.json 28 B f229f6328d58
    hashes
    LFS SHA256
    f229f6328d580bab5aa762d2fc15acc88aef1b8a2a2c771d6e5461c3bf0f5ab2
  • merges.txt 77.3 KiB 67d18e6c0320
    hashes
    LFS SHA256
    67d18e6c032086d468b3cf97da663be717fd97efbc53fa68ed20d1425dd94f56
  • README.md 13.6 KiB 7337605bfff6
    hashes
    LFS SHA256
    7337605bfff6ef0e239b1ccbc5415c9f9a96ffe88d07af70eafc9435914643f5
  • tokenizer.json LFS 566 KiB e185a8dd405f
    hashes
    LFS SHA256
    e185a8dd405fd2093d74b326ad6036202ab12a21b9b5d977655838ba85b26c90
  • tokenizer_config.json 272 B 0f4fbe05fa7c
    hashes
    LFS SHA256
    0f4fbe05fa7cb91b44070d0ab0937f69ca3392e74f5942b022b076d3b1b19f21
  • tokenizer_metadata.json 3.3 KiB e6808adbd7de
    hashes
    LFS SHA256
    e6808adbd7de81ad44aaa9c3dcd8bdc5da616cd3260611f4c972a9e51193c6ae
  • vocab.json LFS 125.5 KiB ddb0ff4cc859
    hashes
    LFS SHA256
    ddb0ff4cc859e018fe48a49afa191d791b024d848043db92adf5c89b6fc32feb