Hugging Peers

Phi-3-mini-128k-instruct-imatrix-GGUF

☆ Save
by duyntnet text-generation transformers other
3.3K downloads 0 likes on Hugging Face updated

Hugging Face

duyntnet/Phi-3-mini-128k-instruct-imatrix-GGUF · model repository official

Open upstream ↗
Revision
cc13d4460ac1
Files
29
Downloaded from this source
3.3K

Provider-specific. This path, revision and file list belong to Hugging Face alone. A different source for the same model may publish different files, or the same names with different contents — which is why nothing here is merged across providers.

Tensor information · gguf

Parameters
3.8B
Architecture
phi3

Parameter counts and precision come from the provider's gguf metadata. Per-tensor shapes live in the file header and are not part of our index.

Files 29 · revision cc13d4460ac1

Hashes: Git OID identifies the file in the repository; LFS SHA256 is the fingerprint of a large file's contents; Xet is the provider's own content fingerprint. Expand “hashes” on any row for the full values.

  • .gitattributes 3.4 KiB
    hashes
    Git OID
    dc1b8095be1d96b7f4cbcb529339cba20fe08b6f
  • Phi-3-mini-128k-instruct-IQ1_M.gguf LFS 874.6 MiB 331ebae94124
    hashes
    Git OID
    1bda98d44d89a8fd8cd3cae27dee038f03f13908
    LFS SHA256
    331ebae94124971491c605f83da6f5a2663d5d0924b9e2dbe8a6c433e4f97d5a
    Xet hash
    0f61041051070de2778c81aa012ddf089a1e855e94994643b73dc14c9ac67b41
    Pointer size
    134 B
  • Phi-3-mini-128k-instruct-IQ1_S.gguf LFS 802.6 MiB 25a4e7621e09
    hashes
    Git OID
    afc3cb3accbc691cc2cf360c9358b654b3406880
    LFS SHA256
    25a4e7621e0940cefa46cf088c274a5dd274b4777e6a3e0ea4cf2ad964bb8c22
    Xet hash
    8c04911f70f3f8599a1d21e52cb1930fc2764e2f83b64dfdb34bac19b925e8ac
    Pointer size
    134 B
  • Phi-3-mini-128k-instruct-IQ2_M.gguf LFS 1.2 GiB 09a336d3cca2
    hashes
    Git OID
    71e30099f6d1fa562ce1da7e005adc104c964d04
    LFS SHA256
    09a336d3cca2f8f99254e9438cd22d2cf3a855d70c51311b8dea3bd4c04dc13b
    Xet hash
    ca0608e841da25085894faf81cbc61b10a5f1499927c66cfdd569171d098957c
    Pointer size
    135 B
  • Phi-3-mini-128k-instruct-IQ2_S.gguf LFS 1.1 GiB 60f210427c32
    hashes
    Git OID
    e94830705ccfa5f3b44682050240e6b3a5d79f87
    LFS SHA256
    60f210427c32c994efb00b1bcfc149b7d31db6c634e8b9a3973db3fb622c1f3a
    Xet hash
    4b8bafe0cd34ed0c0bca878f97b25e4aa582d9951c7c56b3fea7a392cfc5135c
    Pointer size
    135 B
  • Phi-3-mini-128k-instruct-IQ2_XS.gguf LFS 1.1 GiB c70a520f0db3
    hashes
    Git OID
    bdfa4bf5d643101f6490a797970557a1957c0024
    LFS SHA256
    c70a520f0db3528f32e8f26ab4ef20d85bef5cf445df749dc3b9dcd5067f85eb
    Xet hash
    df26c9218285ec1448c488c8dd2ecd417ff3fd09279fcd351c75d9435007e5f6
    Pointer size
    135 B
  • Phi-3-mini-128k-instruct-IQ2_XXS.gguf LFS 994.6 MiB 2cc71b6055e9
    hashes
    Git OID
    97ecc0d01c6416978faa3819db0f128a0689bc55
    LFS SHA256
    2cc71b6055e9c9a050472a2849d3b72b8cea7a6398e13e9ac18131a81f36df93
    Xet hash
    cee6a470b4dba632b7ba260628768dfefc207fd0b9b5d49cb8e2c1ea981df6b5
    Pointer size
    135 B
  • Phi-3-mini-128k-instruct-IQ3_M.gguf LFS 1.7 GiB 30d6966d9f5c
    hashes
    Git OID
    39b8cfca031a4b1ec3a89297026e4db74c81bcbd
    LFS SHA256
    30d6966d9f5c3fd6f87e520e7e41c76ba2a0755a8b2bcdd1a5ffc5717b9a3b16
    Xet hash
    4fe6a522c595ff3a13808957791577062bf83b9af1b6e5fc8974eefb726ce80b
    Pointer size
    135 B
  • Phi-3-mini-128k-instruct-IQ3_S.gguf LFS 1.6 GiB c44ce59cb194
    hashes
    Git OID
    27aa67b127259a1f6fbcf555bbca3ffaf7382c33
    LFS SHA256
    c44ce59cb19498219456f19561bb0c8be47c50f7e5eff6098ccbef85496849b0
    Xet hash
    a3a85ac676320a256b33d3a1b175f0d8cb0cf73557f032e70b1c1037ff00ca6a
    Pointer size
    135 B
  • Phi-3-mini-128k-instruct-IQ3_XS.gguf LFS 1.5 GiB 341e46a62275
    hashes
    Git OID
    f082be00ab1d9913d743aea59048e464cb45f7ef
    LFS SHA256
    341e46a6227595a7aa511251eac00f92aa97d157b2cc1f4cb92cc5ccf21a3ae1
    Xet hash
    25ceff78e0a6c137ae38027bcb834f5e39824cb9821d15b302ef1c604fa1a41e
    Pointer size
    135 B
  • Phi-3-mini-128k-instruct-IQ3_XXS.gguf LFS 1.4 GiB 0d897102ebe9
    hashes
    Git OID
    5ee157124685dd12649cc7787e0895f6a4688653
    LFS SHA256
    0d897102ebe9fb3f83c2d13ed057c3c6469ccac57f5722a23cde6d68fdc8f959
    Xet hash
    c7f9a500244112ac98fb958cde43c459b2f488a0def767e3b3f77f5eef6b45f4
    Pointer size
    135 B
  • Phi-3-mini-128k-instruct-IQ4_NL.gguf LFS 2 GiB d0cd0b858016
    hashes
    Git OID
    1afdcf14573d21724b1c1f3464d0a6a68a77dcd0
    LFS SHA256
    d0cd0b85801659aaa8af2c8250efa181ecc401e73f7cd5e01cde3a642131cc98
    Xet hash
    d60af93fa0505458643b23b10ee09c22e435b61bd44773da2f5c9e42fd011df0
    Pointer size
    135 B
  • Phi-3-mini-128k-instruct-IQ4_XS.gguf LFS 1.9 GiB 0251240a06ef
    hashes
    Git OID
    d7b101cdb76deffb1283c2ef0058304113add52f
    LFS SHA256
    0251240a06ef5108af054a940ba7dbbad7623a02cdc47f0df991c9cc22103b60
    Xet hash
    2bcaabd985e9b45eca50255cdfc8c1e745c15436d1eeb251bdf616614589f0ff
    Pointer size
    135 B
  • Phi-3-mini-128k-instruct-Q2_K.gguf LFS 1.3 GiB 9b8c5a7ef819
    hashes
    Git OID
    99cf459d2e5f3fa7609f1d214075e24d398e2975
    LFS SHA256
    9b8c5a7ef8191a6e6fd6bc5518b079392c30dab88ea6250e2198167c62df8080
    Xet hash
    1ef9140d11f1b5b48471fee8071d97dcccd047dcbfc231eddbc07e31d09793ab
    Pointer size
    135 B
  • Phi-3-mini-128k-instruct-Q2_K_S.gguf LFS 1.2 GiB aa5af06f36fc
    hashes
    Git OID
    89db7f964daa43abe14ba19f013eae70edcdecca
    LFS SHA256
    aa5af06f36fcd62787115b698bef79e92075eff2f032959d0d840a42f7a7b44f
    Xet hash
    447e6cd5f6b065001aca7c3020e5ca99a7999b1438a4d78a702998b25b2753c5
    Pointer size
    135 B
  • Phi-3-mini-128k-instruct-Q3_K_L.gguf LFS 1.9 GiB 7f8ceef0726a
    hashes
    Git OID
    1c076c5c99d4ffa7ecdf889ddb16413fbd415fd8
    LFS SHA256
    7f8ceef0726a61c44deef754ce2ec5c324fdca57aede83719115988546904720
    Xet hash
    1566df39c7e2918e44623b5916ea53676c015eac3df4a8e214d8ef9f70ea5657
    Pointer size
    135 B
  • Phi-3-mini-128k-instruct-Q3_K_M.gguf LFS 1.8 GiB 7f3918d5e681
    hashes
    Git OID
    f0545d7acc36baf604cf0fe15208525b1374a904
    LFS SHA256
    7f3918d5e68156e5304f62ecc0cda6245a18a41b6e92fa1b6a03132b4a4c9fbb
    Xet hash
    68f2c96b0ea864c66386bf81b7aac759696f960bd57daed1807736f99401548c
    Pointer size
    135 B
  • Phi-3-mini-128k-instruct-Q3_K_S.gguf LFS 1.6 GiB bd5720de4e71
    hashes
    Git OID
    d61dcc46d60d3242f8d81fb6493cd0ba57e9b098
    LFS SHA256
    bd5720de4e71d5f64455a2fda2b1c405dda9acc93a3ff6001839bc101b61dc29
    Xet hash
    f82088c9918a6b46f2e9a937c36c5820bfe5d1d923d28532d7c8a1c8542e8e02
    Pointer size
    135 B
  • Phi-3-mini-128k-instruct-Q4_0.gguf LFS 2 GiB d97e60ee8232
    hashes
    Git OID
    e05230109e10f9186ebc69605dc3520d925408d2
    LFS SHA256
    d97e60ee8232b8928efe5e497cc633b3ee18db092c705d3557adee8f15939687
    Xet hash
    7061bedf392886f1290b2f3566aa521a3420a9398bbf8d87c6f40103806d8041
    Pointer size
    135 B
  • Phi-3-mini-128k-instruct-Q4_1.gguf LFS 2.2 GiB 26d5336e4952
    hashes
    Git OID
    db25534db97111596ffd69ff99e8612b96af6849
    LFS SHA256
    26d5336e4952feedf0fd40c40ec65bc73e1f5581cf43dcfb7ead919e802e5fec
    Xet hash
    46bcb8b70c9773c45151dfdfee8338eb811ecb7b9df091b7d4b3648b8ca33f33
    Pointer size
    135 B
  • Phi-3-mini-128k-instruct-Q4_K_M.gguf LFS 2.2 GiB 0dd505004ba4
    hashes
    Git OID
    0330357a10c7bcc1836663a5f31fb336d8cedfeb
    LFS SHA256
    0dd505004ba4ec1d49880d7ad7f139ef1bb40be0c8e3015dd73f0c8bfaacbec0
    Xet hash
    6759670c772bc9dab80aeba0eaeca1510f114d8603ef7c1bf277b7c80f0980a1
    Pointer size
    135 B
  • Phi-3-mini-128k-instruct-Q4_K_S.gguf LFS 2 GiB f43d44380862
    hashes
    Git OID
    870deb133a42e6253f2ad89e08f9b7f3053cb035
    LFS SHA256
    f43d443808625f9e14eef24b94e47bf63c239eec9259215a55e3ebf90df5d13b
    Xet hash
    f75150243232c1e97193c15166fcdb9ff844f0e74151943a90ab61b9aa8ecaeb
    Pointer size
    135 B
  • Phi-3-mini-128k-instruct-Q5_0.gguf LFS 2.5 GiB 485a6c29416c
    hashes
    Git OID
    fee2fe2e57a43d0086afabb85389ed5de1812539
    LFS SHA256
    485a6c29416c8d35a7f6f052f9e77221a8d8ca129222267aa63085900ffd1e9f
    Xet hash
    373d75c83a9ebfe867b9ff7df06fc47500b5b9cc12b8dcaedec85ead887b979c
    Pointer size
    135 B
  • Phi-3-mini-128k-instruct-Q5_1.gguf LFS 2.7 GiB a8cc6b67ec56
    hashes
    Git OID
    15a5bfd6b241d26fd0e61e17732b0dc9f2191a2a
    LFS SHA256
    a8cc6b67ec56432683a5d1627777f4c3ea4eabfef5a83247d2c4a420c36f836c
    Xet hash
    c18b0c5ffc5db81cdc9e53140e7904b99cd70dbf8e6c481d3708ae27d6a690b0
    Pointer size
    135 B
  • Phi-3-mini-128k-instruct-Q5_K_M.gguf LFS 2.6 GiB 238c069495ad
    hashes
    Git OID
    3b914f39677ccd3b9e3ea0df453c9aa99c64ef04
    LFS SHA256
    238c069495ad49abdbfa9693032b85605d2ea41d82fdb1c15b091de32e2d43ae
    Xet hash
    5157ffd2ae9d323a77284844c98114b41b127d7d07f1103c1f637d9bb35bebdc
    Pointer size
    135 B
  • Phi-3-mini-128k-instruct-Q5_K_S.gguf LFS 2.5 GiB f68ef563abf2
    hashes
    Git OID
    b096a208df64d879d143042dee5e4a656efdad8d
    LFS SHA256
    f68ef563abf2e89cc74a056db6a75123bd7c518c70dc76fc4ea6076b8ae67b57
    Xet hash
    058c59927fe6dc5366f39e19436903c60363232fcee524619b7a6c5996d4538c
    Pointer size
    135 B
  • Phi-3-mini-128k-instruct-Q6_K.gguf LFS 2.9 GiB 263f0fb37ab3
    hashes
    Git OID
    43928c0e0cbf6c2cae69dcad08bc2b4ec7c364f3
    LFS SHA256
    263f0fb37ab3f3d5787c81930ad2a23b1cad9db2407f9e33e61107c03feeef12
    Xet hash
    78a6316814da0cc381c0301ac51f893921e4c2a74b3daf06d0b9567856de7fdc
    Pointer size
    135 B
  • Phi-3-mini-128k-instruct-Q8_0.gguf LFS 3.8 GiB 29ead5eaf60e
    hashes
    Git OID
    e51e85d7147bba9b7172550eddacbb48679fcdc6
    LFS SHA256
    29ead5eaf60eb2dbe8367f3c3bd80dcd513f9b472901bb378c3ef994a15fdf8a
    Xet hash
    c2ca5768a6d1c139c4108e7453807e609f1434fff9f3de2672477720e9418559
    Pointer size
    135 B
  • README.md 4.6 KiB
    hashes
    Git OID
    e49694a5cff2f3cab11fefa1b3d77d78110b99e3