ReluLLaMA-13B

☆ Save

by SparseLLM text-generation transformers llama2

26 downloads 4 likes on Hugging Face updated 2023-12-15

ReluLLaMA-13B Community Forum

0 open discussions

+ Create Post

Start a discussion or share an external link about ReluLLaMA-13B...

🔗 Link

Nothing posted here yet. Start the first one!

Get this model

hp get SparseLLM/ReluLLaMA-13B

The huggingpeers CLI is not released yet. Once it ships, the command above will download the model. Until then, download the weights from Hugging Face.

Details

HuggingPeers ID: ID hpm-nT64x0A8RtQ
Provider: Hugging Face
Revision: 3c0eebba3ee1
Organization: SparseLLM
Pipeline: text-generation
Library: transformers
License: llama2
Parameters: 13B
Published: 2023-12-01

Files 15

Total size: 24.2 GiB
LFS files: 7
Parameters: 13B
Revision: 3c0eebba3ee1

Browse files & hashes →

Papers 2

MoEfication: Transformer Feed-forward Layers are Mixtures of Experts 215 citations · 2021
ReLU Strikes Back: Exploiting Activation Sparsity in Large Language Models 138 citations · 2023

Open the papers tab →

Code

GitHub · SJTU-IPADS/PowerInfer ↗

Linked from the model card — we do not mirror source repositories.

Sources

Hugging Face · SparseLLM/ReluLLaMA-13B (this) · checked recently

View on Hugging Face ↗