starcoder2-3b-instruct-GGUF
Hugging Face
QuantFactory/starcoder2-3b-instruct-GGUF · model repository
official
- Revision
-
6eb3cec2979e - Files
- 16
- Downloaded from this source
- 1.2K
Provider-specific. This path, revision and file list belong to Hugging Face alone. A different source for the same model may publish different files, or the same names with different contents — which is why nothing here is merged across providers.
Tensor information · gguf
- Parameters
- 3B
- Architecture
starcoder2
Parameter counts and precision come from the provider's gguf metadata. Per-tensor shapes live in the file header and are not part of our index.
Files 16
· revision 6eb3cec2979e
Hashes: Git OID identifies the file in the repository; LFS SHA256 is the fingerprint of a large file's contents; Xet is the provider's own content fingerprint. Expand “hashes” on any row for the full values.
-
starcoder2-3b-instruct.Q2_K.gguf LFS 1.1 GiB
6066bb911c95hashes
- Git OID
ecb879b40f98286882c8b1f2841b6f46bff526c0- LFS SHA256
6066bb911c95e30bcfef500892bd9f68d407950587aebb0fff6116c1fb9324ad- Xet hash
520109ae3b02397f5cf82a45dca715c34f0989430ff8e2bd2cb94644e9f404b6- Pointer size
- 135 B
-
starcoder2-3b-instruct.Q3_K_L.gguf LFS 1.6 GiB
58c9c3294f4dhashes
- Git OID
293f807fc3036da017f2fb25c6459de0364cc492- LFS SHA256
58c9c3294f4d1ece5b7e9cf32af335413509ab2a87223ef310732a4cc9b17db7- Xet hash
197fbec28613bb77e949e69bffb200fd5718636f72f34d09efc461803cee88c2- Pointer size
- 135 B
-
starcoder2-3b-instruct.Q3_K_M.gguf LFS 1.5 GiB
64bf38f3f305hashes
- Git OID
f954be671e65131587c82e9780347928277da5e8- LFS SHA256
64bf38f3f3057e3ee98403cd028aadb8e0a15b1d397daf8cd17a551792f11a73- Xet hash
f4c9f707027a122030f26564a7e6d2d0f219b08c67e71ed5818d35d637aa5b3f- Pointer size
- 135 B
-
starcoder2-3b-instruct.Q3_K_S.gguf LFS 1.3 GiB
c8dd91a80509hashes
- Git OID
fa6d2a3a85be5f60b8402d85a9176127aacd8874- LFS SHA256
c8dd91a80509be8b2b2e67fffadb74781050fa1a1d0134c53781ef2f26313252- Xet hash
2f3c346e8ba4b2f89d360ebd5e12ce3a754c548b9607c0a45402b30a3b2722d4- Pointer size
- 135 B
-
starcoder2-3b-instruct.Q4_0.gguf LFS 1.6 GiB
4127075781dehashes
- Git OID
911ed5d3600891413b6ff23ac138a41b1492fb6e- LFS SHA256
4127075781de9cfe64ec4ca223379ae38c2b273e19a94a79594ab15c8db47f31- Xet hash
080de7534dc924fe34b149fa0ce4fcfa3b528700d116aabebd5e9a27e912a970- Pointer size
- 135 B
-
starcoder2-3b-instruct.Q4_1.gguf LFS 1.8 GiB
d486207f7624hashes
- Git OID
d56ba28d2ad443f9e0de100e1926d4535382e3f5- LFS SHA256
d486207f7624145be93ae226863497fb022ae65a428d3604340af3efa37c7f3a- Xet hash
eb8dd8d3559c619851150446f6e0e82aecba76c03a132fa3ee323094df4e5175- Pointer size
- 135 B
-
starcoder2-3b-instruct.Q4_K_M.gguf LFS 1.8 GiB
47e5b46ab855hashes
- Git OID
a392928553afeb8be465bae29fd57ae9a945339e- LFS SHA256
47e5b46ab855c441e30f93446a0854c433a8761483026cefd3516297a7a04061- Xet hash
cfabfaa55ca301ef150f506a966148d721d323d55b921e3d68a9fa2a9048943b- Pointer size
- 135 B
-
starcoder2-3b-instruct.Q4_K_S.gguf LFS 1.6 GiB
ef2bd06eb026hashes
- Git OID
e4dd4495296fcd65467e8004e6fd9b21a05421ff- LFS SHA256
ef2bd06eb0261993de7a245dfdc430a54634262a2a2b7f7a4b10719f1f05746c- Xet hash
99ad79e1007274ee36db0fecd8e1331965d2dfa934a2baef637e72e53c9748c8- Pointer size
- 135 B
-
starcoder2-3b-instruct.Q5_0.gguf LFS 2 GiB
e04b48e00132hashes
- Git OID
f3d174f4b23b69f4e1d67a201d37051ffe58243e- LFS SHA256
e04b48e00132d0c2fba3e84b2be156b05870592e609b7f25be243cfcd5b7853d- Xet hash
e8862a47eeef10d8e48a81ec531694aa91800866a091bbd1645844bc2a9d5214- Pointer size
- 135 B
-
starcoder2-3b-instruct.Q5_1.gguf LFS 2.1 GiB
fcea6013adachashes
- Git OID
1a4e681900fd41ffcec111599d46f55bdae55361- LFS SHA256
fcea6013adacd22bd5765fe2d7e0bc75e75dca55b7fd44b7ba706949d1c4a9c1- Xet hash
3852e9e43d63bdff83b604780b673f3167e6c63fe21f073db8feea59b26c21f0- Pointer size
- 135 B
-
starcoder2-3b-instruct.Q5_K_M.gguf LFS 2 GiB
e55b84bd61cahashes
- Git OID
22fdc71eb65d05d63742b74969da0b0284b1f0d2- LFS SHA256
e55b84bd61ca4cb6652e9bc62a2fb932e83b00cc2193381b5af42d9593b04a87- Xet hash
24ea02daeb4c72cbbaefb2d9b5ca5c81f3958f677b4f388012be61f5c7221eed- Pointer size
- 135 B
-
starcoder2-3b-instruct.Q5_K_S.gguf LFS 2 GiB
9cf7561b47e5hashes
- Git OID
4b5534a9864c83f25fa5e89f976b651bbbc8440b- LFS SHA256
9cf7561b47e5fd1bd0dd40d6f8a79fefeba92a79d9c6152389b1be90cef5af88- Xet hash
16f3c975c87857d1ca987fb81c08a23e615ed3154b2e72c954aeb80e3c264411- Pointer size
- 135 B
-
starcoder2-3b-instruct.Q6_K.gguf LFS 2.3 GiB
ae7cf6051a2bhashes
- Git OID
6bc4ac7fcf051ba4f3e97cf5d4b3643fc5d1b01f- LFS SHA256
ae7cf6051a2bd6fe51b7e033754565e8cd8b72399d1e53f47b3ebeebfc48e9a3- Xet hash
d9e85bb97ad921b9f80a2fc5d2b03612574c9560127f5f55e5b7e78b269dad48- Pointer size
- 135 B
-
starcoder2-3b-instruct.Q8_0.gguf LFS 3 GiB
f06a1f40f58ehashes
- Git OID
3907e000673e8b8b194949d8d4e7b1706e26bb4a- LFS SHA256
f06a1f40f58ead30a96bd00dcecb3360c7586feb360d838258c3e0f5359453ea- Xet hash
e0749abde5abab7360d00d65338589278fe682dc00258848f09893773611d2f3- Pointer size
- 135 B