ReluLLaMA-7B

☆ Save

by SparseLLM text-generation transformers llama2

110 downloads 12 likes on Hugging Face updated 2024-12-19

ReluLLaMA-7B Community Forum

0 open discussions

+ Create Post

Start a discussion or share an external link about ReluLLaMA-7B...

🔗 Link

Nothing posted here yet. Start the first one!

Get this model

hp get SparseLLM/ReluLLaMA-7B

The huggingpeers CLI is not released yet. Once it ships, the command above will download the model. Until then, download the weights from Hugging Face.

Details

HuggingPeers ID: ID hpm-a3a9Bg9xwqq
Provider: Hugging Face
Revision: 3bb3afef6510
Organization: SparseLLM
Pipeline: text-generation
Library: transformers
License: llama2
Parameters: 6.7B
Published: 2023-11-28

Files 14

Total size: 50.2 GiB
LFS files: 7
Parameters: 6.7B
Revision: 3bb3afef6510

Browse files & hashes →

Papers 2

MoEfication: Transformer Feed-forward Layers are Mixtures of Experts 215 citations · 2021
ReLU Strikes Back: Exploiting Activation Sparsity in Large Language Models 138 citations · 2023

Open the papers tab →

Code

GitHub · SJTU-IPADS/PowerInfer ↗

Linked from the model card — we do not mirror source repositories.

Sources

Hugging Face · SparseLLM/ReluLLaMA-7B (this) · checked recently

View on Hugging Face ↗