Hugging Peers

Nous-Hermes-Llama2-13b-imatrix-GGUF

☆ Save
by duyntnet text-generation transformers other
1.8K downloads 1 likes on Hugging Face updated

Hugging Face

duyntnet/Nous-Hermes-Llama2-13b-imatrix-GGUF · model repository official

Open upstream ↗
Revision
145cbc993cc0
Files
29
Downloaded from this source
1.8K

Provider-specific. This path, revision and file list belong to Hugging Face alone. A different source for the same model may publish different files, or the same names with different contents — which is why nothing here is merged across providers.

Tensor information · gguf

Parameters
13B
Architecture
llama

Parameter counts and precision come from the provider's gguf metadata. Per-tensor shapes live in the file header and are not part of our index.

Files 29 · revision 145cbc993cc0

Hashes: Git OID identifies the file in the repository; LFS SHA256 is the fingerprint of a large file's contents; Xet is the provider's own content fingerprint. Expand “hashes” on any row for the full values.

  • .gitattributes 3.3 KiB
    hashes
    Git OID
    7a709755b3c7e090c8d7981406b938daba604d9e
  • Nous-Hermes-Llama2-13b-IQ1_M.gguf LFS 2.9 GiB 983b0de59165
    hashes
    Git OID
    541b0c7a4dec77859f8e1d7968fb328855ee34b3
    LFS SHA256
    983b0de59165dda7809a9f8e2b6801116801b78b3b073ae15cfe4dcba967241f
    Xet hash
    10366a9568444e06d0ddbbc344ed825509c04d9c68f28be4faa7deb4cd3caaec
    Pointer size
    135 B
  • Nous-Hermes-Llama2-13b-IQ1_S.gguf LFS 2.7 GiB 7469e1b90b27
    hashes
    Git OID
    e2f06d27b9fd9a78493d06ad2d3e75540153567f
    LFS SHA256
    7469e1b90b270a0123a05ad7dae3b2e85428457cc2da64f5f4715711cf0c4f54
    Xet hash
    82416c69f8e50a5461e60d854f354d3f01c0530f84dd2a7857a1cc9374141cb4
    Pointer size
    135 B
  • Nous-Hermes-Llama2-13b-IQ2_M.gguf LFS 4.2 GiB f9ddf8739541
    hashes
    Git OID
    d1d3c9257661ec23a3cc8a44616094902f46c84b
    LFS SHA256
    f9ddf87395416879e858e18bed085f2f066bd51f5039500d45a06f1950e02afb
    Xet hash
    1cc44468905c24426b19a8a8a95b3d1e030d91b22d114f798a8e34393bfa6ceb
    Pointer size
    135 B
  • Nous-Hermes-Llama2-13b-IQ2_S.gguf LFS 3.9 GiB b0e857cde1d0
    hashes
    Git OID
    7b5f5379cbe45315973bbfda50ffe4253d35ba21
    LFS SHA256
    b0e857cde1d0d6776d8925f7272c31227f93a27fc8b6b55bf8f40d5a4e2dc935
    Xet hash
    6398973cd855ad8fd559290ade2f303f8801134b3376b9fc73ad9ee48aa6e77e
    Pointer size
    135 B
  • Nous-Hermes-Llama2-13b-IQ2_XS.gguf LFS 3.6 GiB 2fd5fa2d55c4
    hashes
    Git OID
    04d7ad21222a482c414e9d17c265f082f6d1fd49
    LFS SHA256
    2fd5fa2d55c4213f40b2d48a07f43d70ee0e4928ea1b0bed9bbccdf4bb968002
    Xet hash
    c2aee462591998398d201fb13801a25e2949991c840f47806d769e8c78148f1e
    Pointer size
    135 B
  • Nous-Hermes-Llama2-13b-IQ2_XXS.gguf LFS 3.3 GiB e7632c2bc949
    hashes
    Git OID
    6dde57528856be06a3c3cc7bdfab941cf978e179
    LFS SHA256
    e7632c2bc949c7ebef14f0618318f33f2ad6a7248a2763668765f10824f57bc6
    Xet hash
    ba1fbb08bcd5b3868c1fd077dba0b3374700982eb40e7913b8bd1b5b2765f9be
    Pointer size
    135 B
  • Nous-Hermes-Llama2-13b-IQ3_M.gguf LFS 5.6 GiB 2f1fca25cd5e
    hashes
    Git OID
    31b45efb4b012bd560aad2c4ecae2e53f6644b6b
    LFS SHA256
    2f1fca25cd5e4203566d53ea15e59a3d44a0acef0ffc17242e7f9d06e15d2073
    Xet hash
    743585e653da608da2ec7bd0b2790907747b7b651fd621432cae86378f05163d
    Pointer size
    135 B
  • Nous-Hermes-Llama2-13b-IQ3_S.gguf LFS 5.3 GiB 3e4d1e10167b
    hashes
    Git OID
    3ed456582d94b353c47992d726fc1c5657131880
    LFS SHA256
    3e4d1e10167babbec2358780f98629326dcb5f735332576a738b6057f0dac404
    Xet hash
    8141ad5d040937906ac0b54b3c3342086ba11a98b2081077bfa1a6e0ecd8f999
    Pointer size
    135 B
  • Nous-Hermes-Llama2-13b-IQ3_XS.gguf LFS 5 GiB 6a1b5ca811ef
    hashes
    Git OID
    c369996a43cf57b98b9b225bbe614d80bf2c9b89
    LFS SHA256
    6a1b5ca811efbd145139653b26adfa03625a8d79c5caaf14702705eb34aa9a25
    Xet hash
    fff5f2c979faa91b8d468b7d751793266e536dd1b5b076503cedfee8a0c3c687
    Pointer size
    135 B
  • Nous-Hermes-Llama2-13b-IQ3_XXS.gguf LFS 4.6 GiB 93b71eb06709
    hashes
    Git OID
    c59fab5a7a1fbf1229bf6c8b2045e9c90b3d35ef
    LFS SHA256
    93b71eb067093b5dd4b52997244f20e7eb84e30c849981df54bcfdcc4f0dcbd5
    Xet hash
    c96e07edc2d1214b57a9078d3e44a2814e33666f519f3cf1d04c39290bb7ea7b
    Pointer size
    135 B
  • Nous-Hermes-Llama2-13b-IQ4_NL.gguf LFS 6.9 GiB ede9df8f1baa
    hashes
    Git OID
    9d5cffbd6da1e999e23727a2ff441d1c8585a499
    LFS SHA256
    ede9df8f1baa6a0c2beb073c958be2b94030343c12549809a82493cc1e695ca7
    Xet hash
    75226cf76051bff5836a444a28a1d14edf2fd9f551510fa013691a064c4f0794
    Pointer size
    135 B
  • Nous-Hermes-Llama2-13b-IQ4_XS.gguf LFS 6.5 GiB b1dbe23081b5
    hashes
    Git OID
    e8c02ae858a2d5ae9f2f161e75687d4594bef6e6
    LFS SHA256
    b1dbe23081b56a7e56a018c7e1ebea8eb961a227774638801060ca2b6a971713
    Xet hash
    411a23932002af062d5fe3ad270b25b763c6c014e63317006b02f39facf15da2
    Pointer size
    135 B
  • Nous-Hermes-Llama2-13b-Q2_K.gguf LFS 4.5 GiB 69009d5d44ad
    hashes
    Git OID
    69b4c9c2b7cad31301cefedc283e584821527791
    LFS SHA256
    69009d5d44adc4abe4ec8dfbcdf764e3f77f0db63b41ff40eadd307360353c5f
    Xet hash
    18f43b9b61de49c51c8c99ec9deb9f0703a0277d06c241f1cd98fb9a0d0b73b8
    Pointer size
    135 B
  • Nous-Hermes-Llama2-13b-Q2_K_S.gguf LFS 4.1 GiB 736636f218be
    hashes
    Git OID
    7c833d50bbf925e4e92356dca90878ea4434d82d
    LFS SHA256
    736636f218be9d7597d7d3050f773608ead62310ae6f508c27a7cd3884ce6766
    Xet hash
    2fb4e6ef34ad3ee9462db65392d30ec178540cea8af5b69702b19b287289e7ea
    Pointer size
    135 B
  • Nous-Hermes-Llama2-13b-Q3_K_L.gguf LFS 6.5 GiB 2f7e4f9b7894
    hashes
    Git OID
    44c89f0a9e8573ef5ef5f58d612293d16a734d85
    LFS SHA256
    2f7e4f9b7894e1f200d1e97dfc88199bcdc18cd32b253f7d0f94208caaa7f616
    Xet hash
    22e6b6b4b65d2cabbb9fac8d49bf0674830793de47a63b6f9d658f02d9a8224c
    Pointer size
    135 B
  • Nous-Hermes-Llama2-13b-Q3_K_M.gguf LFS 5.9 GiB 647e6511c0a3
    hashes
    Git OID
    70106f4ee6f4ae041b9b2c4663bbbff7b3e5a3fb
    LFS SHA256
    647e6511c0a31db50a75898fcf98c4dcbeaf86cf89b5160a634a647e6358151a
    Xet hash
    727e5e99935a961d9aa5bb56941d69e6a337068a95eecb718003c6974a8b3bf0
    Pointer size
    135 B
  • Nous-Hermes-Llama2-13b-Q3_K_S.gguf LFS 5.3 GiB 08489ac15b02
    hashes
    Git OID
    8afbc3fee97feb80b80b5e1adb0f5a7b88ecf13a
    LFS SHA256
    08489ac15b02f95e82a33bcbbf5a45b1f4d60bfd40f702f223f255ff55e56e5d
    Xet hash
    bd0e758470bc29b9955f1a6f35a37452cc6fdfaac84a08fb9b502ac919aa17e3
    Pointer size
    135 B
  • Nous-Hermes-Llama2-13b-Q4_0.gguf LFS 6.9 GiB 3f1bdeba61fd
    hashes
    Git OID
    1e2e472633e304fb9c0cbc1f3c0a1743cf0d8c0f
    LFS SHA256
    3f1bdeba61fd380003f72c338777750d2f724225cdef9b55a02dfb8d537dcba5
    Xet hash
    6f4b1de0d13fb78ef8f28f5066127918a96dec308ad9ce7bfb860b6cc9a9068e
    Pointer size
    135 B
  • Nous-Hermes-Llama2-13b-Q4_1.gguf LFS 7.6 GiB 1d0b82cfade2
    hashes
    Git OID
    edbd8e279d3127131663712704b857b7ece760ab
    LFS SHA256
    1d0b82cfade273ceaa81b798df160284bd3e1ca7894ace249538e32da18683d7
    Xet hash
    6bd8c1107c6e6a8c4934beb2875deffb0da9330b10d41ca3d646f91e4b279480
    Pointer size
    135 B
  • Nous-Hermes-Llama2-13b-Q4_K_M.gguf LFS 7.3 GiB ce3080560bae
    hashes
    Git OID
    b6d28e57fd12d95a50f1d0ae417b1ef027a9d331
    LFS SHA256
    ce3080560bae2a723f5c3e2d5e4717258c7d7f283cc568f3e63585f5ebf57baf
    Xet hash
    df0928f7c29c84fd4c8b89cb93312388f26e665cddb722c00270bce0eb2f0f42
    Pointer size
    135 B
  • Nous-Hermes-Llama2-13b-Q4_K_S.gguf LFS 6.9 GiB 4080cc9ad840
    hashes
    Git OID
    5e80f91414a1fafce42dc3cba9661e92c8ac3c82
    LFS SHA256
    4080cc9ad840a7c2c02c8ad0809447e7bfca14586637dfb77208b524692f409a
    Xet hash
    c3a263944050aed4a74f8248d3a48afce02d1a48dccf788f4c7f9c090e292e32
    Pointer size
    135 B
  • Nous-Hermes-Llama2-13b-Q5_0.gguf LFS 8.4 GiB 57886b25ef37
    hashes
    Git OID
    c34cbff994f33f4e6dc1113d71528b2f4a2a202a
    LFS SHA256
    57886b25ef379a27736a9c8d6fb18fbbbde9f0e72d8e70c7ed9200c9f05c4f52
    Xet hash
    1df806f4985207018050a3902b074bf59d87e52483efbcaa04f0551338fb039f
    Pointer size
    135 B
  • Nous-Hermes-Llama2-13b-Q5_1.gguf LFS 9.1 GiB 7ee4385b2e57
    hashes
    Git OID
    5a5d286369a7157191edb8176d6703402992e5dc
    LFS SHA256
    7ee4385b2e57f3bc5ceb95c79b315909de923cc0c29141819333c85e13dd9b95
    Xet hash
    ff36cd505903e015c744899c21c4453766ee16614ce66c528f51cf767cf1dec5
    Pointer size
    135 B
  • Nous-Hermes-Llama2-13b-Q5_K_M.gguf LFS 8.6 GiB 825f498dc20e
    hashes
    Git OID
    e252e852beb9e3c16a69c82dd2365a9eb3734d53
    LFS SHA256
    825f498dc20e82f200827007d38a7ac6f96254d65e268442129965a2ea197790
    Xet hash
    3610919a98fc09f43983b4dd3a8484978560bf7cf7c6614d58389c1690e9f1ba
    Pointer size
    135 B
  • Nous-Hermes-Llama2-13b-Q5_K_S.gguf LFS 8.4 GiB 3360d71b54a6
    hashes
    Git OID
    7b7384607c64defe44b610e1cabda2e659d8a68b
    LFS SHA256
    3360d71b54a61074efb6e6f00a5200d2ac4a00b746dea5622ffb2cbf8fbe7767
    Xet hash
    9746bc5bc819f1c33a0ba8e50f66cc2a00c4ddd0abedfb2956eceb28c6631bd3
    Pointer size
    135 B
  • Nous-Hermes-Llama2-13b-Q6_K.gguf LFS 9.9 GiB ac5e9cfce07e
    hashes
    Git OID
    f2c1751cc0e1243db5a48006dbbc9d8e20dbc909
    LFS SHA256
    ac5e9cfce07e090b7251f774fd16de2c3677bfa4a43d0fa90f6418f497f946e8
    Xet hash
    c02ed9f0a8cd4d06808d09c81a1cfdb853730c0bca01c7b429eb20cf0680db33
    Pointer size
    136 B
  • Nous-Hermes-Llama2-13b-Q8_0.gguf LFS 12.9 GiB e34ef97cb710
    hashes
    Git OID
    bfca471d10685aab7a08c5ace7edabc07f509054
    LFS SHA256
    e34ef97cb710ff871a042a0d6f2cee58d1b6dbc3bb7ed4a894b652b045d6bb6b
    Xet hash
    736aca40cec94efe890381f266ca4775893c9627513f5fd8f511048f199c5993
    Pointer size
    136 B
  • README.md 894 B
    hashes
    Git OID
    b280bfc3ebcdecb9425877d4f5dfe1e6b1d423af