ReluLLaMA-7B

☆ Save

by SparseLLM text-generation transformers llama2

110 downloads 12 likes on Hugging Face updated 2024-12-19

Related models 4

mradermacher ReluLLaMA-7B-GGUF

transformers llama2

256 downloads 0 likes

Tiiny ReluLLaMA-7B-PowerInfer-GGUF

transformers llama2

306 downloads 15 likes

PowerInfer ReluLLaMA-7B-PowerInfer-GGUF

pytorch llama2

1.2K downloads 1 likes

PowerInfer ReluLLaMA-7B-Predictor

pytorch mit

1.1K downloads 1 likes

Get this model

hp get SparseLLM/ReluLLaMA-7B

The huggingpeers CLI is not released yet. Once it ships, the command above will download the model. Until then, download the weights from Hugging Face.

Details

HuggingPeers ID: ID hpm-a3a9Bg9xwqq
Provider: Hugging Face
Revision: 3bb3afef6510
Organization: SparseLLM
Pipeline: text-generation
Library: transformers
License: llama2
Parameters: 6.7B
Published: 2023-11-28

Files 14

Total size: 50.2 GiB
LFS files: 7
Parameters: 6.7B
Revision: 3bb3afef6510

Browse files & hashes →

Papers 2

MoEfication: Transformer Feed-forward Layers are Mixtures of Experts 215 citations · 2021
ReLU Strikes Back: Exploiting Activation Sparsity in Large Language Models 138 citations · 2023

Open the papers tab →

Code

GitHub · SJTU-IPADS/PowerInfer ↗

Linked from the model card — we do not mirror source repositories.

Sources

Hugging Face · SparseLLM/ReluLLaMA-7B (this) · checked recently

View on Hugging Face ↗