This is a Ties merge between the following models:
-
https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct
-
https://huggingface.co/Replete-AI/Llama3-8B-Instruct-Replete-Adapted
The Coding, and Overall performance of this models seems to be better than both base models used in the merge. Benchmarks are coming in the future.
Open LLM Leaderboard Evaluation Results
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 16.32 |
| IFEval (0-Shot) | 53.88 |
| BBH (3-Shot) | 21.94 |
| MATH Lvl 5 (4-Shot) | 7.10 |
| GPQA (0-shot) | 2.57 |
| MuSR (0-shot) | 3.45 |
| MMLU-PRO (5-shot) | 8.98 |