LLM EXPLORER
 LLM Explorer: A Curated Large Language Model Directory and Analytics
Dark Theme
  LLM  List    LLM Hosting    LLM Leaderboards    Blog    Newsfeed    Advertise

Mistral Nemo Instruct 2407 by mistralai

 »  All LLMs  »  mistralai  »  Mistral Nemo Instruct 2407   URL Share it on

  2799053   
  Autotrain compatible Base model:finetune:mistralai/... Base model:mistralai/mistral-n...   Conversational   De   En   Endpoints compatible   Es   Fr   Instruct   It   Ja   Mistral   Pt   Region:us   Ru   Safetensors   Sharded   Tensorflow   Zh
Model Card on HF 🤗: https://huggingface.co/mistralai/Mistral-Nemo-Instruct-2407 

Mistral Nemo Instruct 2407 Benchmarks

MMLU Pro: 27.97
GPQA: 5.37
MUSR: 8.48
BBH: 29.68
IFEval: 63.8 vs 88 (so35)-27.5%
MATH Lvl 5: 6.5
LLME Score: 0.55988
nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Mistral Nemo Instruct 2407 (mistralai/Mistral-Nemo-Instruct-2407)

Mistral Nemo Instruct 2407 Parameters and Internals

Model Type 
instruct fine-tuned
Use Cases 
Areas:
research, multilingual tasks, code tasks
Limitations:
No moderation mechanisms
Considerations:
Model should finely respect guardrails for environments requiring moderated outputs.
Additional Notes 
Trained jointly by Mistral AI and NVIDIA. Drop-in replacement of Mistral 7B.
Supported Languages 
en (English), fr (French), de (German), es (Spanish), it (Italian), pt (Portuguese), ru (Russian), zh (Chinese), ja (Japanese)
Training Details 
Methodology:
Trained on a large proportion of multilingual and code data
Context Length:
128000
Model Architecture:
Transformer model with 40 layers, Dim: 5,120, Head dim: 128, Hidden dim: 14,336, Activation Function: SwiGLU, Number of heads: 32, Number of kv-heads: 8 (GQA), Vocabulary size: 128k (2^17), Rotary embeddings (theta = 1M)
LLM NameMistral Nemo Instruct 2407
Repository 🤗https://huggingface.co/mistralai/Mistral-Nemo-Instruct-2407 
Base Model(s)  Mistral Nemo Base 2407   mistralai/Mistral-Nemo-Base-2407
Model Size12.2b
Required VRAM24.5 GB
Updated2024-12-21
Maintainermistralai
Instruction-BasedYes
Model Files  24.5 GB   4.9 GB: 1-of-5   4.9 GB: 2-of-5   4.9 GB: 3-of-5   4.9 GB: 4-of-5   4.9 GB: 5-of-5
Supported Languagesen fr de es it pt ru zh ja
Gated ModelYes
Model ArchitectureAutoModelForCausalLM
Licenseproprietary
Tokenizer ClassPreTrainedTokenizerFast
Vocabulary Size131072

Quantized Models of the Mistral Nemo Instruct 2407

Model
Likes
Downloads
VRAM
Ava 1.0 12B46024 GB
...istral Nemo Instruct 2407 GGUF6346524 GB
...orean Mistral Nemo Sft DPO 12B5406224 GB
...Horizon AI Korean Advanced 12B09124 GB

Best Alternatives to Mistral Nemo Instruct 2407

Best Alternatives
Context / RAM
Downloads
Likes
...lai Mistral Nemo Instruct 24070K / 24.5 GB481

Rank the Mistral Nemo Instruct 2407 Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 40013 in total.

Email us: info@extractum.io. Our Privacy Policy  | Terms and Conditions  | Suggest an improvement.
Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241217
  Support LLM Explorer