Meta-llama3-8b-Instruct-SmoothQuant-Fp8

27 downloads 0 likes on Hugging Face updated

Hugging Face

nm-testing/Meta-llama3-8b-Instruct-SmoothQuant-Fp8 · model repository official

Open upstream ↗
Revision
287eb602d806
Files
9
Downloaded from this source
27

Provider-specific. This path, revision and file list belong to Hugging Face alone. A different source for the same model may publish different files, or the same names with different contents — which is why nothing here is merged across providers.

Tensor information · safetensors

Parameters
8B
Precision · F8_E4M3
7B params
Precision · BF16
1.1B params

Parameter counts and precision come from the provider's safetensors metadata. Per-tensor shapes live in the file header and are not part of our index.

Files 9 · revision 287eb602d806

Hashes: Git OID identifies the file in the repository; LFS SHA256 is the fingerprint of a large file's contents; Xet is the provider's own content fingerprint. Expand “hashes” on any row for the full values.

  • .gitattributes 1.5 KiB
    hashes
    Git OID
    a6344aac8c09253b3b630fb776ae94478aa0275b
  • config.json 1.8 KiB
    hashes
    Git OID
    0f77af0c9e2d290156eecb4dd8dadaf7bcc2f418
  • generation_config.json 194 B
    hashes
    Git OID
    77789f31dc655efaa22536f25a29f61f860bae8b
  • model-00001-of-00002.safetensors LFS 4.7 GiB cd3337d883ef
    hashes
    Git OID
    8f6ec5de38bb86f3b05209a3af78d5d9c25773c6
    LFS SHA256
    cd3337d883eff20f362605869735a41d8b16106b258e4a12e49b57938fe39d72
    Xet hash
    a3f8776fb043f5e41ddf11e6a01fc1894b5ee084516e8d457f371c1c399040cc
    Pointer size
    135 B
  • model-00002-of-00002.safetensors LFS 3.8 GiB 4843c69a5f99
    hashes
    Git OID
    746e16654841760255cdeb3729a934fb2dc68d4b
    LFS SHA256
    4843c69a5f992a060ec481d86c88b3e6c73af1b57ee29a9781571e96173bba9a
    Xet hash
    5a178310be5398611c7c077ed13558eed3e0d3932308fbbc5b01f0da176b1cc1
    Pointer size
    135 B
  • model.safetensors.index.json 61.3 KiB
    hashes
    Git OID
    0d8fad753004eab47882086189569c56ad70051b
  • special_tokens_map.json 296 B
    hashes
    Git OID
    02ee80b6196926a5ad790a004d9efd6ab1ba6542
  • tokenizer.json 8.7 MiB
    hashes
    Git OID
    b197f72effb9d5ed16ee0f5663e11e4cfac2ba62
  • tokenizer_config.json 49.8 KiB
    hashes
    Git OID
    1bfd1146b7bde6168de7bb673bfe0acaea6e684c