Autotrain compatible Base model:epistemeai/fireball... Base model:finetune:epistemeai... Dataset:candenizkocak/code-alp... Dataset:yahma/alpaca-cleaned En Endpoints compatible Mistral Region:us Safetensors Sharded Tensorflow Trl Unsloth
Fireball Mistral Nemo Base 2407 Sft V2.1 Benchmarks
MMLU Pro: 26.04
GPQA: 1.57
MUSR: 12.52
BBH: 30.67
IFEval: 18.34 vs 88 (so35)-79.2%
MATH Lvl 5: 3.55
LLME Score: 0.30346
nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
What is the LLM Explorer Rank (Score)
Fireball Mistral Nemo Base 2407 Sft V2.1 Parameters and Internals
| LLM Name | Fireball Mistral Nemo Base 2407 Sft V2.1 |
| Repository 🤗 | https://huggingface.co/EpistemeAI/Fireball-Mistral-Nemo-Base-2407-sft-v2.1 |
| Base Model(s) | |
| Model Size | 12.2b |
| Required VRAM | 24.5 GB |
| Updated | 2024-08-31 |
| Maintainer | EpistemeAI |
| Model Type | mistral |
| Model Files | |
| Supported Languages | en |
| Model Architecture | MistralForCausalLM |
| License | apache-2.0 |
| Context Length | 1024000 |
| Model Max Length | 1024000 |
| Transformers Version | 4.44.0 |
| Tokenizer Class | PreTrainedTokenizerFast |
| Padding Token | <pad> |
| Vocabulary Size | 131072 |
| Torch Data Type | bfloat16 |
Best Alternatives to Fireball Mistral Nemo Base 2407 Sft V2.1
Best Alternatives |
Context / RAM |
Downloads |
Likes |
|---|---|---|---|
| Azure Dusk V0.2 | 1000K / 24.5 GB | 86 | 6 |
| Crimson Dawn V0.2 | 1000K / 24.5 GB | 128 | 7 |
| Mistral Nemo Instruct 2407 | 1000K / 24.5 GB | 5015 | 5 |
| ...Mistral Nemo Base 2407 V1 DPO2 | 1000K / 24.5 GB | 24 | 0 |
| ChatWaifu V1.3.1 | 1000K / 24.5 GB | 335 | 4 |
| Crimson Dawn V0.1 | 1000K / 24.5 GB | 163 | 12 |
| Mistral Nemo Base 2407 | 1000K / 24.5 GB | 720 | 5 |
| Violet Twilight V0.1 | 1000K / 24.5 GB | 59 | 5 |
| Azure Dusk V0.1 | 1000K / 24.5 GB | 70 | 5 |
| ...stral Nemo Base 2407 Sft V2.2a | 1000K / 24.5 GB | 51 | 1 |
Note: green Score (e.g. "73.2") means that the model is better than EpistemeAI/Fireball-Mistral-Nemo-Base-2407-sft-v2.1 .
Rank the Fireball Mistral Nemo Base 2407 Sft V2.1 Capabilities
🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟
What open-source LLMs or SLMs are you in search of? 36026 in total.
Original data from HuggingFace, OpenCompass and various public git repos.
Release v2024072803