Solutus-3x7B-AWQ

☆ Save

by solidrust text-generation transformers apache-2.0

23 downloads 1 likes on Hugging Face updated 2024-09-03

Model card

ConvexAI/Solutus-3x7B AWQ

Model creator: ConvexAI
Original model: Solutus-3x7B

image/png

Model Summary

A model to test how MoE will route without square expansion.

The config looks like this...(detailed version is in the files and versions):

cognitivecomputations/WestLake-7B-v2-laser - base
mlabonne/Daredevil-7B - expert #1
cognitivecomputations/WestLake-7B-v2-laser - expert #2
mlabonne/Daredevil-7B - expert #3

Get this model

hp get solidrust/Solutus-3x7B-AWQ

The huggingpeers CLI is not released yet. Once it ships, the command above will download the model. Until then, download the weights from Hugging Face.

Details

HuggingPeers ID: ID hpm-JiNol2fX5XW
Provider: Hugging Face
Revision: 9ab07c6a2289
Organization: solidrust
Pipeline: text-generation
Library: transformers
License: apache-2.0
Parameters: 18.5B
Published: 2024-04-18

Files 13

Total size: 9.3 GiB
LFS files: 4
Parameters: 18.5B
Revision: 9ab07c6a2289

Browse files & hashes →

Sources

Hugging Face · solidrust/Solutus-3x7B-AWQ (this) · checked recently

View on Hugging Face ↗