Merged Model Arxiv:2406.07188 Autotrain compatible Base model:mistralai/mixtral-8... Base model:prometheus-eval/pro... Conversational Endpoints compatible Instruct Mistralai/mixtral-8x7b-instruc... Mixtral Model-index Moe Prometheus-eval/prometheus-8x7... Region:us Safetensors Sharded Tensorflow
Model Card on HF 🤗: https://huggingface.co/vicgalle/Merge-Mixtral-Prometheus-8x7B
Merge Mixtral Prometheus 8x7B Benchmarks
MMLU Pro: 29.82
GPQA: 7.83
MUSR: 9.59
BBH: 34.65
IFEval: 57.44 vs 88 (so35)-34.7%
MATH Lvl 5: 9.44
LLME Score: 0.26491
nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
What is the LLM Explorer Rank (Score)
Merge Mixtral Prometheus 8x7B Parameters and Internals
| Model Type |
| |
| Additional Notes |
|
Best Alternatives to Merge Mixtral Prometheus 8x7B
Best Alternatives |
Context / RAM |
Downloads |
Likes |
|---|---|---|---|
| Mixtral 8x7B Instruct V0.1 | 32K / 93.6 GB | 3161658 | 4237 |
| Dolphin 2.5 Mixtral 8x7b | 32K / 93.6 GB | 19440 | 1221 |
| Notux 8x7b V1 | 32K / 93.6 GB | 41 | 165 |
| ...rkrautLM Mixtral 8x7B Instruct | 32K / 93.6 GB | 967 | 22 |
| BagelMIsteryTour V2 8x7B | 32K / 93.5 GB | 84 | 16 |
| Karakuri Lm 8x7b Instruct V0.1 | 32K / 93.6 GB | 465 | 19 |
| XLAM V0.1 R | 32K / 93.6 GB | 758 | 52 |
| Mixtral 8x7B Instruct V0.1 FP8 | 32K / 47.1 GB | 1128 | 3 |
| Autotrain Xva0j Mixtral8x7b | 32K / 93.6 GB | 81 | 0 |
| TeTO MS 8x7b | 32K / 93.7 GB | 14 | 4 |
Note: green Score (e.g. "73.2") means that the model is better than vicgalle/Merge-Mixtral-Prometheus-8x7B .
Rank the Merge Mixtral Prometheus 8x7B Capabilities
🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟
What open-source LLMs or SLMs are you in search of? 40248 in total.
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241217