Hugging Peers

Ultra-Instruct-12B-GGUF

☆ Save
by bartowski text-generation transformers cc-by-nc-4.0
649 downloads 1 likes on Hugging Face updated

Hugging Face

bartowski/Ultra-Instruct-12B-GGUF · model repository official

Open upstream ↗
Revision
537cfa3bd152
Files
23
Downloaded from this source
649

Provider-specific. This path, revision and file list belong to Hugging Face alone. A different source for the same model may publish different files, or the same names with different contents — which is why nothing here is merged across providers.

Tensor information · gguf

Parameters
12.2B
Architecture
llama

Parameter counts and precision come from the provider's gguf metadata. Per-tensor shapes live in the file header and are not part of our index.

Files 23 · revision 537cfa3bd152

Hashes: Git OID identifies the file in the repository; LFS SHA256 is the fingerprint of a large file's contents; Xet is the provider's own content fingerprint. Expand “hashes” on any row for the full values.

  • .gitattributes 2.8 KiB
    hashes
    Git OID
    d53e9442c1a9172dd224199f5bb2af20b72fdb5f
  • README.md 8.3 KiB
    hashes
    Git OID
    f72b18adb0a50768d8a39b3916a0185e73408960
  • Ultra-Instruct-12B-f16.gguf LFS 22.8 GiB 21363c1ef4d8
    hashes
    Git OID
    2b4d6346266a06af9929d99116b52990002a15ba
    LFS SHA256
    21363c1ef4d8d53e6f717817242464e16451afd710af2ff54065e584ffbb5dc6
    Xet hash
    e3d55e8e43ed528858703ab7cdeabed128ce682eb61d789f15818317dc7d8aa8
    Pointer size
    136 B
  • Ultra-Instruct-12B-IQ2_M.gguf LFS 4.1 GiB 212a32c7d979
    hashes
    Git OID
    593107e6908b20ea8bfb825e7c9944a5dde1a663
    LFS SHA256
    212a32c7d979a3e418f2358906893487f35cf2cd670c7699256e744c83f219cd
    Xet hash
    b3580ec384abf066de76a81e4253026fe074a5c14762fb70cdea53fd12d9c80b
    Pointer size
    135 B
  • Ultra-Instruct-12B-IQ3_M.gguf LFS 5.3 GiB 8abcb680d82c
    hashes
    Git OID
    45b781956f797999567cae933a1c45245740f30a
    LFS SHA256
    8abcb680d82c1f506ea4302ddf1aa10f93c640cb9bf219a84de4808fd09e4791
    Xet hash
    c4e5c1f91311c3e5f12e9233d09807acae152647f488c3fa3f5c9e623bcb30d7
    Pointer size
    135 B
  • Ultra-Instruct-12B-IQ3_XS.gguf LFS 4.9 GiB e2b4739e8f71
    hashes
    Git OID
    2abb117cb817a1e4db7756c45298f74dba7878b2
    LFS SHA256
    e2b4739e8f717e1c6ab4b80fd2e4026cc621cd6f889ff34118bfa8ae6c4a3675
    Xet hash
    caa124f4371c2056f59134a269e3eec24df5fc5cf34ad9836b4923fe2144b77b
    Pointer size
    135 B
  • Ultra-Instruct-12B-IQ4_XS.gguf LFS 6.3 GiB 09a8d265a3fd
    hashes
    Git OID
    d0043ce70fbf690dafc7106956e731dedf54363f
    LFS SHA256
    09a8d265a3fd86098fd10a4abc1c1f99ba5272e1d2c9faa6899b95b06b08ebd9
    Xet hash
    66a313ee92ce665f225719a3961c4053e895ca88ffea44048080db70679450dd
    Pointer size
    135 B
  • Ultra-Instruct-12B-Q2_K.gguf LFS 4.5 GiB 768275119565
    hashes
    Git OID
    c462fcc0336d7d877c2e8b606fba1e41efa873c4
    LFS SHA256
    7682751195655519896d148a089e2ccbbec6ea4ae917b989b66436fef68edfb8
    Xet hash
    69dc73cf2b5654e3721d15b8fde8c447acf83b6b5ba57df7a0b0a411299aac45
    Pointer size
    135 B
  • Ultra-Instruct-12B-Q2_K_L.gguf LFS 5.1 GiB 8ca33efa4e6d
    hashes
    Git OID
    b5c4561be0d7ad3c3876f5383959da84ec24116e
    LFS SHA256
    8ca33efa4e6d97cad21f952f8710c032fa768929ec649d5a3f4b4826aecd56ff
    Xet hash
    186d4126a31b7df69edde4f01514246806e4ef1f2ad4d2abc00a90d9d546d5b2
    Pointer size
    135 B
  • Ultra-Instruct-12B-Q3_K_L.gguf LFS 6.1 GiB 081c30977ff2
    hashes
    Git OID
    47827518b13399c77b903eb3df87c823f2347971
    LFS SHA256
    081c30977ff2a250031d8944d5771d23ab1d4131dd53a36950d3633ce2b6b26b
    Xet hash
    f001611f75591ef1673d20f52b8965c1faeefbdbaa93a24302fe91431cf35a95
    Pointer size
    135 B
  • Ultra-Instruct-12B-Q3_K_M.gguf LFS 5.7 GiB c2d2ed2da29b
    hashes
    Git OID
    e81a1c68937e8f362a078bc4477599b470f7cda0
    LFS SHA256
    c2d2ed2da29b93e1616a422cf237a09a5165dbeec4368ed46889957de81b5fb6
    Xet hash
    802f5ffdd6c66fa58bf66e68b121cbf6cddbe698b3b78053c3da8979fa3eb0f3
    Pointer size
    135 B
  • Ultra-Instruct-12B-Q3_K_S.gguf LFS 5.2 GiB fabb41bcc92e
    hashes
    Git OID
    1f3f9fc7dcc1097c3f283b385aa3d29f2e63e890
    LFS SHA256
    fabb41bcc92e9e67d52716a1f5ffc45423cca7ef4b01404f36923f213c349c03
    Xet hash
    351100fd544524262bf9db667815d6e306f1da719140d571e80c870cb8f24a9b
    Pointer size
    135 B
  • Ultra-Instruct-12B-Q3_K_XL.gguf LFS 6.7 GiB 9c7cfd060246
    hashes
    Git OID
    7ead86648888009bb04750772f8b07d65f878b5d
    LFS SHA256
    9c7cfd0602468875afdb0e7791497ee226c4c792e6dd6ba9e46164a5492b46f5
    Xet hash
    1f170c50de9cd58aafcbb2b24dba98439d07ee6c6036d03e620ea24d000aabce
    Pointer size
    135 B
  • Ultra-Instruct-12B-Q4_K_L.gguf LFS 7.4 GiB 9454b3c01537
    hashes
    Git OID
    17a7e65d5f7d7121994bf0e98c08bb8f66425877
    LFS SHA256
    9454b3c0153741539ef728eef9a1f7273e6e8eedfd76227de3f97426a51147fc
    Xet hash
    d56df1587d920ecb1311c34d02e2bab515f10541e067995c6893481bc505d5e2
    Pointer size
    135 B
  • Ultra-Instruct-12B-Q4_K_M.gguf LFS 7 GiB 88ec237f56ec
    hashes
    Git OID
    21aee56df45b10132c9b0dcfb48c3cc3450439ce
    LFS SHA256
    88ec237f56ec4d2899f3fbd06c4e84de8250d550cd63bd61ff29622ce2efc4e0
    Xet hash
    923793d3bfc12b5b46bc707caa07237f6d20e58a824a51b8b80026ef1ff9a85b
    Pointer size
    135 B
  • Ultra-Instruct-12B-Q4_K_S.gguf LFS 6.6 GiB fbfe7c51f072
    hashes
    Git OID
    809384be32693734e1ae03dbaafa41d2f089ccc5
    LFS SHA256
    fbfe7c51f072252ffbc6c5e94f2447e64ada33c9ba56f23e37eeb39940df0359
    Xet hash
    7adbb52b4cb922c67883b2c78505e1f03db47abd693abb86b73b18dde166ce9e
    Pointer size
    135 B
  • Ultra-Instruct-12B-Q5_K_L.gguf LFS 8.5 GiB b79186693a6c
    hashes
    Git OID
    d21ec1fab7e350a6367a2f2b2c444e88f7eca611
    LFS SHA256
    b79186693a6c43693ea53d8e304b838de48b40048863830cf06d7438ec473d31
    Xet hash
    d731464a767b3190ea75234c85f1f2bbf6e8141531b49d4a6b299f6c0780c8ca
    Pointer size
    135 B
  • Ultra-Instruct-12B-Q5_K_M.gguf LFS 8.1 GiB ae18fcb38f31
    hashes
    Git OID
    7f967760ad4afd101a7b0a2c0982a87ff2ee574f
    LFS SHA256
    ae18fcb38f314e80e56cfafc4a678b002ef915095687e4c1b28e4e7b66cd59c8
    Xet hash
    90a0964a765c3a0ad75b2c3a5b3822d59e2be76f3fb3372d33646c5159957a1c
    Pointer size
    135 B
  • Ultra-Instruct-12B-Q5_K_S.gguf LFS 7.9 GiB f611e6d9eb62
    hashes
    Git OID
    f8adb4ea8780f8f4097ac2caefe44e677816c8d0
    LFS SHA256
    f611e6d9eb6265d5f01ec30f26ddad49dc6635562033588eebf1b30285abdc6b
    Xet hash
    0c429e71d8ffcaf5b62d2e6c6bddddc616b6577907ce1723bbe22c550922de7b
    Pointer size
    135 B
  • Ultra-Instruct-12B-Q6_K.gguf LFS 9.4 GiB 9752a93ff470
    hashes
    Git OID
    689b35e8646f38f3a80260d8c814232039d82fe4
    LFS SHA256
    9752a93ff4701cceaf6d87063a02556e5e9219e90af06f76e52ef8032713dd31
    Xet hash
    a6bfa4a9cef70f7f75ceb613b7c0b9b875e9e6f71a42f1d12fc2d032d933fcb6
    Pointer size
    136 B
  • Ultra-Instruct-12B-Q6_K_L.gguf LFS 9.7 GiB 13fa7497c971
    hashes
    Git OID
    8be6e01a138ee8ac402de421796b28a3df5cf522
    LFS SHA256
    13fa7497c971e2bbfce6544d273a3fed30c440fbf74d9cb5124aabad5e9a1166
    Xet hash
    8be544f17f0e044400137895103dc86e42375078c61cb5ce87ea344d7f6d1a44
    Pointer size
    136 B
  • Ultra-Instruct-12B-Q8_0.gguf LFS 12.1 GiB 5dc5428fd816
    hashes
    Git OID
    ea4616d62e8edb53e77cca64f387809ad7248e9b
    LFS SHA256
    5dc5428fd816b91503b3453123ea47e042f066245a6755d590d02da487fab457
    Xet hash
    5d3e24b7d2cb157fbf9bb1708725bc78072962e34e83a1a782a4ca1a8097b6b3
    Pointer size
    136 B
  • Ultra-Instruct-12B.imatrix LFS 6.7 MiB 9ee22302f3a9
    hashes
    Git OID
    afaf636f8c82ff53e146cdb834b5e0776bc989d7
    LFS SHA256
    9ee22302f3a90ba6eac7e233a6e56049db11c672e4610439586aafa2fe51b355
    Xet hash
    66db9e120326df325c137d9758af49c03faedc031ce969766b5aab9b6f38714f
    Pointer size
    132 B