tiny-llama-fast-tokenizer

42 downloads 0 likes on Hugging Face updated

Hugging Face

SystemAdmin123/tiny-llama-fast-tokenizer · model repository official

Open upstream ↗
Revision
354a52020b98
Files
26
Downloaded from this source
42

Provider-specific. This path, revision and file list belong to Hugging Face alone. A different source for the same model may publish different files, or the same names with different contents — which is why nothing here is merged across providers.

Tensor information · safetensors

Parameters
1M
Precision · BF16
1M params

Parameter counts and precision come from the provider's safetensors metadata. Per-tensor shapes live in the file header and are not part of our index.

Files 26 · revision 354a52020b98

Hashes: Git OID identifies the file in the repository; LFS SHA256 is the fingerprint of a large file's contents; Xet is the provider's own content fingerprint. Expand “hashes” on any row for the full values.

  • last-checkpoint/
    • config.json 747 B
      hashes
      Git OID
      090fdfb274725033e9bda8c6f6cfb7cb97bc5d37
    • generation_config.json 153 B
      hashes
      Git OID
      64d3ae0544da19904ff8220ec8971d35ac382233
    • model.safetensors LFS 2 MiB 25a257c5b2e3
      hashes
      Git OID
      234a5e53d76b7efc66240e596e3c186b2e7f7a92
      LFS SHA256
      25a257c5b2e34eda80e3d84f1a8cc4247ba163d63b057609915a20d5c03487fe
      Xet hash
      f237b8fa3de4ac4bc3563f5a3910167cb6ca952d3ff744e35114b69622a1052e
      Pointer size
      132 B
    • optimizer.pt LFS 2.1 MiB bec191f34319
      hashes
      Git OID
      608d9056498ed7b7bb3ae4ade363d6a9dc44f58a
      LFS SHA256
      bec191f34319615e7969a7a94942c2ab6e19f09ef79ad5cfbca9b840fe7e04f4
      Xet hash
      367709628d38c08c0fecbc315233de6e28cce09da994b8a323083de44a2d6b12
      Pointer size
      132 B
    • rng_state_0.pth LFS 14.7 KiB a4651e32e118
      hashes
      Git OID
      7af0087a4d4e08430c86ce7ec582ae8077630fbc
      LFS SHA256
      a4651e32e118f1ea1a8e26dfbbe64298593e12e6a71bcd36cb77f04f86d3f86d
      Xet hash
      e1d89f91bb641a95ef6bc385b8697c741e2afef9688b336d176e1e02db24bf24
      Pointer size
      130 B
    • rng_state_1.pth LFS 14.7 KiB f0c1eba909fb
      hashes
      Git OID
      fc5919fd8e8641b4e4debc5695d470927029d7c1
      LFS SHA256
      f0c1eba909fbb51daca773a25c075f182b4096aff21c9b4ff19dbada2080ac99
      Xet hash
      6ad13ac13ec612e21b50d643ef1d42d5f2b63043a485236a13efc67dce023d51
      Pointer size
      130 B
    • rng_state_2.pth LFS 14.7 KiB 28adb9f06e22
      hashes
      Git OID
      ff17d12bbd6a31d8973de2e938b62248527794c7
      LFS SHA256
      28adb9f06e220aefdc723ea4380a84d42b8bfb87cc53ce65859d55ce1876f51c
      Xet hash
      18f893b0226365cff69d7ec3b2f513a3c83be3755d12f4e2bb76f2c19c7cff6b
      Pointer size
      130 B
    • rng_state_3.pth LFS 14.7 KiB 423c49ed521f
      hashes
      Git OID
      aa37c9360eedbcc3e08605bc113c99a4ffbdb7b7
      LFS SHA256
      423c49ed521f6986d20d8b29112b383f4b0f3f2e228084ef82c2ad7dcd5d1de8
      Xet hash
      d2fb986bc6561ae3857f933977f8a1ffecaa33cf59da52112f7ddff9c23464f9
      Pointer size
      130 B
    • scheduler.pt LFS 1 KiB 3a60c7d771c1
      hashes
      Git OID
      ceccbb51e159c99b7379c259fbb9bab8e6d6044b
      LFS SHA256
      3a60c7d771c1fd156acee762fba03c724cb41829a3f71df370ecd1d20b134982
      Xet hash
      c9511814ae522d9119f2ac8e1a4675696877645e8229ec181c3ff14e7f987402
      Pointer size
      129 B
    • special_tokens_map.json 548 B
      hashes
      Git OID
      7bb46ce4f0a2837a395d35b91b2a4f878f577132
    • tokenizer.json 3.5 MiB
      hashes
      Git OID
      c0bb973c4f434fb23bab75525daa7dcf55cf8a06
    • tokenizer.model LFS 488 KiB 9e556afd4421
      hashes
      Git OID
      6c00c742ce03c627d6cd5b795984876fa49fa899
      LFS SHA256
      9e556afd44213b6bd1be2b850ebbbd98f5481437a8021afaf58ee7fb1818d347
      Xet hash
      91bf184ab12793d0754344f9095332759432e666320cc6c07f637af50e36db6f
      Pointer size
      131 B
    • tokenizer_config.json 1.2 KiB
      hashes
      Git OID
      35f400a601c67b14443ba8f202fdd4d6df71526c
    • trainer_state.json 2.5 KiB
      hashes
      Git OID
      68efc5c6de97a711cf84f9ccecc0fbceacc1836f
    • training_args.bin LFS 6.7 KiB aaa4e9690097
      hashes
      Git OID
      8696d6dbd76a2dc735df44325fd6731e5d8f56aa
      LFS SHA256
      aaa4e96900978d3ffc6b4d538660eb0cf2fc137143c61a37b1d477787b8740ea
      Xet hash
      8dee19237f093b38df712cac7736c8f398ccc085598aff1e0106ad4d171d5171
      Pointer size
      129 B
  • .gitattributes 1.5 KiB
    hashes
    Git OID
    a6344aac8c09253b3b630fb776ae94478aa0275b
  • axolotl_config.yaml 1.4 KiB
    hashes
    Git OID
    b3f818dc8ec76db688b90d09138d1054a6878900
  • config.json 747 B
    hashes
    Git OID
    090fdfb274725033e9bda8c6f6cfb7cb97bc5d37
  • generation_config.json 153 B
    hashes
    Git OID
    64d3ae0544da19904ff8220ec8971d35ac382233
  • model.safetensors LFS 2 MiB 25a257c5b2e3
    hashes
    Git OID
    234a5e53d76b7efc66240e596e3c186b2e7f7a92
    LFS SHA256
    25a257c5b2e34eda80e3d84f1a8cc4247ba163d63b057609915a20d5c03487fe
    Xet hash
    f237b8fa3de4ac4bc3563f5a3910167cb6ca952d3ff744e35114b69622a1052e
    Pointer size
    132 B
  • README.md 3.3 KiB
    hashes
    Git OID
    846ee84593a7006a5a9730372557bf752669160a
  • special_tokens_map.json 548 B
    hashes
    Git OID
    7bb46ce4f0a2837a395d35b91b2a4f878f577132
  • tokenizer.json 3.5 MiB
    hashes
    Git OID
    c0bb973c4f434fb23bab75525daa7dcf55cf8a06
  • tokenizer.model LFS 488 KiB 9e556afd4421
    hashes
    Git OID
    6c00c742ce03c627d6cd5b795984876fa49fa899
    LFS SHA256
    9e556afd44213b6bd1be2b850ebbbd98f5481437a8021afaf58ee7fb1818d347
    Xet hash
    91bf184ab12793d0754344f9095332759432e666320cc6c07f637af50e36db6f
    Pointer size
    131 B
  • tokenizer_config.json 1.2 KiB
    hashes
    Git OID
    35f400a601c67b14443ba8f202fdd4d6df71526c
  • training_args.bin LFS 6.7 KiB aaa4e9690097
    hashes
    Git OID
    8696d6dbd76a2dc735df44325fd6731e5d8f56aa
    LFS SHA256
    aaa4e96900978d3ffc6b4d538660eb0cf2fc137143c61a37b1d477787b8740ea
    Xet hash
    8dee19237f093b38df712cac7736c8f398ccc085598aff1e0106ad4d171d5171
    Pointer size
    129 B