Hugging Peers

DeepSeek-V2-Lite-Chat-imatrix-GGUF

☆ Save
by duyntnet text-generation transformers other
1.7K downloads 0 likes on Hugging Face updated

Hugging Face

duyntnet/DeepSeek-V2-Lite-Chat-imatrix-GGUF · model repository official

Open upstream ↗
Revision
56be24d45b27
Files
29
Downloaded from this source
1.7K

Provider-specific. This path, revision and file list belong to Hugging Face alone. A different source for the same model may publish different files, or the same names with different contents — which is why nothing here is merged across providers.

Tensor information · gguf

Parameters
15.7B
Architecture
deepseek2

Parameter counts and precision come from the provider's gguf metadata. Per-tensor shapes live in the file header and are not part of our index.

Files 29 · revision 56be24d45b27

Hashes: Git OID identifies the file in the repository; LFS SHA256 is the fingerprint of a large file's contents; Xet is the provider's own content fingerprint. Expand “hashes” on any row for the full values.

  • .gitattributes 3.3 KiB
    hashes
    Git OID
    33b8233cda60bf6108f5fddfe87cb9d09982bb95
  • DeepSeek-V2-Lite-Chat-IQ1_M.gguf LFS 4.9 GiB ddc303a2047f
    hashes
    Git OID
    52870a9f6f5fedad05a4ade1dc475060b3589e52
    LFS SHA256
    ddc303a2047fdd1c5678d5fe1c50bebfce57c1892432fde353a08f5b6250c78a
    Xet hash
    a602f5d50a4a88d9471f6ed534dace635786f09c403c079408ccc102bec1e86c
    Pointer size
    135 B
  • DeepSeek-V2-Lite-Chat-IQ1_S.gguf LFS 4.7 GiB 21585f00fe3a
    hashes
    Git OID
    836b12a7a8eceb7384f42b07df7a01b1a8530270
    LFS SHA256
    21585f00fe3a6e13d87e2df7fb0b5b5bbfe08a43321cd1f0095631e49b3f7f8b
    Xet hash
    3c3977c4d75be4faee1469914e4fe7fe6c2dbbc977f69f5c0d51d0e5e9d8c826
    Pointer size
    135 B
  • DeepSeek-V2-Lite-Chat-IQ2_M.gguf LFS 5.9 GiB d2d152a0fa01
    hashes
    Git OID
    4e5aaaa2e3486de4ed8ca3828118f2d79ac1f500
    LFS SHA256
    d2d152a0fa0172c3f134f606f9da5f07dd32d397275763fbf1f971bae0978580
    Xet hash
    2ef63d3ac07e3e73c74e425efab7964117f557d3d83574cdd6deea6ae1d0e10f
    Pointer size
    135 B
  • DeepSeek-V2-Lite-Chat-IQ2_S.gguf LFS 5.6 GiB e33ffcb82976
    hashes
    Git OID
    4e84767208a06e616a728b93977869eb7f3308a4
    LFS SHA256
    e33ffcb829763ae5a5f5f292292e912e364928e83892ba6cb9ed8cef5f196598
    Xet hash
    0d5006f37005dcb75f5aec0cf2dda07ac83b51391ecfcb9bacf07a06270498b8
    Pointer size
    135 B
  • DeepSeek-V2-Lite-Chat-IQ2_XS.gguf LFS 5.6 GiB 6bd906e781db
    hashes
    Git OID
    6f8f100fd6424dafa237eb51b483d9c396877a4b
    LFS SHA256
    6bd906e781dba2ae976f5c17ccf2b728a9b06384229fddb7b4135c1d5df85a9c
    Xet hash
    4fabca9a3cc21ca4d8c64f625fffab44bd761edf1f74c03560002b0af68a4091
    Pointer size
    135 B
  • DeepSeek-V2-Lite-Chat-IQ2_XXS.gguf LFS 5.3 GiB c0c7a9889efe
    hashes
    Git OID
    37c2243da1b5f553091aef6ccedfe9cc257ec1da
    LFS SHA256
    c0c7a9889efe2bc86c0db9ddd2b916564355d6936513dab3a0f314fe4d21f5d8
    Xet hash
    f1dc4bb422377ecbac952c693ce2d071fa17b33b38dc0cb7357d9a67cd9ad459
    Pointer size
    135 B
  • DeepSeek-V2-Lite-Chat-IQ3_M.gguf LFS 7 GiB b2533218b8fb
    hashes
    Git OID
    6f0fe71bcbe684227e3a3adce07a6de174536d29
    LFS SHA256
    b2533218b8fbfb7f3f1016ae47382c2e958b7cc48a4f24d59b43848a61d154c3
    Xet hash
    6816b346734e3935cfc3ba351bb8a0e69deab9f534cfd7b6b0dbfd07dd39d9a6
    Pointer size
    135 B
  • DeepSeek-V2-Lite-Chat-IQ3_S.gguf LFS 7 GiB 9f96ad869f8b
    hashes
    Git OID
    28ff9c7f4ff90fe29d898079f878f0fc8bd9d998
    LFS SHA256
    9f96ad869f8b340286e72d6f762d8637a832df5742ddb174725197fa25bebe53
    Xet hash
    0be6fc777987314b8c8ba4808f0f815ad60626dad235a02f4262be746c232586
    Pointer size
    135 B
  • DeepSeek-V2-Lite-Chat-IQ3_XS.gguf LFS 6.6 GiB 6c49d1e663fc
    hashes
    Git OID
    8b4fe6898dd321fbf445f3322d54dc651b21bab2
    LFS SHA256
    6c49d1e663fc43432206474c7d74acda54c23ec95e694f038561f36e92d604a2
    Xet hash
    2a29d55861d6b74f99d5b97297985d2a5c231d5faf14264a086cdccce8e42b65
    Pointer size
    135 B
  • DeepSeek-V2-Lite-Chat-IQ3_XXS.gguf LFS 6.5 GiB 49ac706fe902
    hashes
    Git OID
    37c2070771946b58d3aa035fa0bc955cac989e73
    LFS SHA256
    49ac706fe902b45f47b0335f266bb0df57b97b355d3253056496a9059ce1aec4
    Xet hash
    7f899aa93958b26edf985cc9fd26baef8a0be117d494c9b886616a58e9c0614d
    Pointer size
    135 B
  • DeepSeek-V2-Lite-Chat-IQ4_NL.gguf LFS 8.3 GiB 42eae68459e3
    hashes
    Git OID
    88bce40b741d6e543463ad1ed124d2c1d6849bc4
    LFS SHA256
    42eae68459e3bc1145a272c01add7bf3bab8ef435a8fcdd117524d7625e8128e
    Xet hash
    e3fc6f94b23a3d582b615e74031da09a0411a71babb9dc9c5672bff044375b44
    Pointer size
    135 B
  • DeepSeek-V2-Lite-Chat-IQ4_XS.gguf LFS 8 GiB ea0c072f2436
    hashes
    Git OID
    c29ce58e9a29c80ced2b4df5e3ba33cb59c95199
    LFS SHA256
    ea0c072f243694e9a1ea20795960e9832fb7b4a39ccbd2ece84958c754f6f1fd
    Xet hash
    4ce6cd0c0725e1bea7c12c7c993f5f404454527b60b8ec97639ab20974e1ecfb
    Pointer size
    135 B
  • DeepSeek-V2-Lite-Chat-Q2_K.gguf LFS 6 GiB c917476face8
    hashes
    Git OID
    ed46dea822629a75303d5d17957c81649a151b0e
    LFS SHA256
    c917476face82aafe6b72e17396a7d25d66c02c5460a1ef05ba4ce44de56d446
    Xet hash
    131760cc012833fcd50162af0d9f65aec659460b993f57cc86254e8d3641756e
    Pointer size
    135 B
  • DeepSeek-V2-Lite-Chat-Q2_K_S.gguf LFS 6 GiB ec03b18437f7
    hashes
    Git OID
    7f3e456a729509542a1cc5b8074177044b8975f2
    LFS SHA256
    ec03b18437f7c6ef6599a024640555aa242e1c3a8aea4d1a09b4db7512e0155d
    Xet hash
    17a2b7465d0a6e80ea1290dac4b1152be1d34545251ef78dd21d7caf9fc18b09
    Pointer size
    135 B
  • DeepSeek-V2-Lite-Chat-Q3_K_L.gguf LFS 7.9 GiB 9a609de1b120
    hashes
    Git OID
    2225171e5550d0251d05585692195d25933460e1
    LFS SHA256
    9a609de1b1209c9a4399b2c434743cac2130fa39b13aef216229c12080d8b287
    Xet hash
    d0622818b1adfc994c2ac665cbdcdab06cb7679ea13b1715a9159ea11ca5fc20
    Pointer size
    135 B
  • DeepSeek-V2-Lite-Chat-Q3_K_M.gguf LFS 7.6 GiB f642f454f33d
    hashes
    Git OID
    cf13e5aed8482335b942818614e7dbfde9a949d4
    LFS SHA256
    f642f454f33d8616f4bbae2d7f634f52dfedb11b5e2570d3f27a2f8f346ef7c2
    Xet hash
    8a43d032c975c251de04e834d6a6d04e9ed44e882b2df99a849bb6d48b3454c6
    Pointer size
    135 B
  • DeepSeek-V2-Lite-Chat-Q3_K_S.gguf LFS 7 GiB d94fb7ee9a72
    hashes
    Git OID
    c87c46b1fb8bdcc8697b677378dcec72fafc114e
    LFS SHA256
    d94fb7ee9a72b40da024a57879f6169578d928655e92385b7f7ac746fbcbc3a9
    Xet hash
    66e2a30c6073f752475faffedb4a2b46c168faca75bb285188d335749d3e087e
    Pointer size
    135 B
  • DeepSeek-V2-Lite-Chat-Q4_0.gguf LFS 8.3 GiB 9297f39f3fa6
    hashes
    Git OID
    12d52fd67229da9d686ea0ce725e1f8f90aa919e
    LFS SHA256
    9297f39f3fa6b1b8a10ff6e6147929b1a6c061c935f6f783cfdd5b6ed7ddd915
    Xet hash
    bad48aa4ec49d90c42c7e830d591d416eb84916ab70f847c70445eda5118a37a
    Pointer size
    135 B
  • DeepSeek-V2-Lite-Chat-Q4_1.gguf LFS 9.2 GiB 344d50ad7965
    hashes
    Git OID
    13b721ffca8765b0056a850d0a77e817a67262ea
    LFS SHA256
    344d50ad7965ff939da9ef8741596c0fd3867226b03f57734c87cf4755c69939
    Xet hash
    080c215a8124b07e2a9e78fab79022f00b8e1a13eda45b8bcb4adabba4e1fa14
    Pointer size
    135 B
  • DeepSeek-V2-Lite-Chat-Q4_K_M.gguf LFS 9.7 GiB 8a1312f6199b
    hashes
    Git OID
    78d1f794787e9683a5b38b22daa7aefc3b2e8f86
    LFS SHA256
    8a1312f6199b9856e7abd34e382e75fc7a30b3a6aa327b1c4e4e597726dc4e6e
    Xet hash
    0b94f8dfb60c86b5f678e13aa33b32dad9f7a9ad1aa7942a131f2780ea123729
    Pointer size
    136 B
  • DeepSeek-V2-Lite-Chat-Q4_K_S.gguf LFS 8.9 GiB 16299c04ca32
    hashes
    Git OID
    d86ab6d4622021aca85d328b1a94fa654a215223
    LFS SHA256
    16299c04ca325f0ea747809a91bac9684bb8115cfb5d0e93f7442daf42a9eb6b
    Xet hash
    ec39cf7de85d117917db2d7af9afb2515dc9a5d29ba4e4688db698e551847550
    Pointer size
    135 B
  • DeepSeek-V2-Lite-Chat-Q5_0.gguf LFS 10.1 GiB b4627ecd42c6
    hashes
    Git OID
    7ba8c38d1fd6190ba1abf7f75b101e73f0d67a19
    LFS SHA256
    b4627ecd42c673dc40a8e7e669afa451bfeda7dd91c244bf79b70b67b3466de7
    Xet hash
    92da1eebf869d655cc1dc1b09cf0c240388f11f9c44446c6ff63c45658da93b0
    Pointer size
    136 B
  • DeepSeek-V2-Lite-Chat-Q5_1.gguf LFS 11 GiB f614c2bb0576
    hashes
    Git OID
    aba55580785828b9c93aa8c8a94c6fad4571ccd0
    LFS SHA256
    f614c2bb05769a42cb7283c536e31709a55a1c3ca3f2353dc35905d5c1a6a9e8
    Xet hash
    c25663cf21b988ea26e940142153c401b8e57e0102a3b3d20650072af72b41d6
    Pointer size
    136 B
  • DeepSeek-V2-Lite-Chat-Q5_K_M.gguf LFS 11 GiB 699babb2430d
    hashes
    Git OID
    c274909f7bf96c8244fbd6ee141257dd857525ac
    LFS SHA256
    699babb2430d12ebfd5b90687cc20b26efbbcb6f5bb4c6d9cf4077169fda75af
    Xet hash
    132c2f5296ea15f7c671eeeea505b5b90eeac9364269d271e266c2724b9126e0
    Pointer size
    136 B
  • DeepSeek-V2-Lite-Chat-Q5_K_S.gguf LFS 10.4 GiB ee6038ae10a4
    hashes
    Git OID
    9312b4a004551aa408cfc213b701672eff1425a3
    LFS SHA256
    ee6038ae10a40b58913531dac99f8205430db9e27aa9a35c932715d9f0275a79
    Xet hash
    8c461efd039ed0d13b43a91dc76df615660bed888f5416a856f22f1738adea55
    Pointer size
    136 B
  • DeepSeek-V2-Lite-Chat-Q6_K.gguf LFS 13.1 GiB 2e733ae498c9
    hashes
    Git OID
    96b3cc588e38ceea872c68d1225010383e3040c2
    LFS SHA256
    2e733ae498c9a8185980c8eb70b2c7545697263c3f2938405616e34830761881
    Xet hash
    62fcca843b5e96ce5639b26816fe093c6309e5317cf24f2e072bb7e82bd3ff29
    Pointer size
    136 B
  • DeepSeek-V2-Lite-Chat-Q8_0.gguf LFS 15.6 GiB 5eba154dd66b
    hashes
    Git OID
    900bad0810d8215dec8ab10f9a34d1aa48b41bc8
    LFS SHA256
    5eba154dd66b275207d3cb4ed232faef41a0905df45a973ae65e1850cf605f95
    Xet hash
    3dae33df9d108e2493c3795a3d20a1c4d42c396c2142606ff1508400e761e3c9
    Pointer size
    136 B
  • README.md 5.6 KiB
    hashes
    Git OID
    d4b8eb368ce3039ac7b13a15d740fe4fdd52d764