lora-tests

904 downloads 0 likes on ModelScope updated

Model card

Models with reduced matrix size and overfitted for testing

Base models and adapters for LLMs to be used to test converting to gguf and testing inference.

These LLMs are in safetensors format with their architecture unchanged but for the size of their tensors.

Folders structure:

<model architecture>/hidden_size=<reduced size>/<base|lora>

where:

These models are generated with the repo reduce-llms-for-testing. Please open an issue/PR there if you want to add more models.