ReluLLaMA-7B-Predictor

☆ Save

by PowerInfer pytorch mit

1.1K downloads 1 likes on ModelScope updated 2024-12-31

Model card

ReluLLaMA-7B-Predictor

Model creator: PowerInfer

This repository provides a group of sparsity predictors serving for SparseLLM/ReluLLaMA-7B.

Get this model

hp get PowerInfer/ReluLLaMA-7B-Predictor

The huggingpeers CLI is not released yet. Once it ships, the command above will download the model. Until then, download the weights from ModelScope.

Details

HuggingPeers ID: ID hpm-z6VswQa1q8v
Provider: ModelScope
Revision: master
Organization: PowerInfer
Library: pytorch
License: mit
Published: 2024-12-31

Files 35

Total size: 3.1 GiB
LFS files: 32
Revision: master

Browse files & hashes →

Sources

ModelScope · PowerInfer/ReluLLaMA-7B-Predictor (this) · checked recently

View on ModelScope ↗