Mistralai Mistral Nemo Base 2407 by SillyTilly

 ยป  All LLMs  ยป  SillyTilly  ยป  Mistralai Mistral Nemo Base 2407   URL Share it on

  Autotrain compatible   De   En   Endpoints compatible   Es   Fr   It   Ja   Mistral   Pt   Region:us   Ru   Safetensors   Sharded   Tensorflow   Zh

Mistralai Mistral Nemo Base 2407 Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Mistralai Mistral Nemo Base 2407 (SillyTilly/mistralai_Mistral-Nemo-Base-2407)

Mistralai Mistral Nemo Base 2407 Parameters and Internals

Model Type 
generative, transformer
Additional Notes 
Mistral-Nemo-Base-2407 is a pretrained base model without moderation mechanisms.
Supported Languages 
en (Proficient), fr (Proficient), de (Proficient), es (Proficient), it (Proficient), pt (Proficient), ru (Proficient), zh (Proficient), ja (Proficient)
Training Details 
Methodology:
Pre-trained generative text model using a 128k context window and trained on a large proportion of multilingual and code data.
Context Length:
128000
Model Architecture:
Transformer model with 40 layers, dimension 5,120, head dimension 128, hidden dimension 14,436, SwiGLU activation function, 32 heads, 8 kv-heads, vocabulary size 128k with rotary embeddings (theta = 1M).
LLM NameMistralai Mistral Nemo Base 2407
Repository ๐Ÿค—https://huggingface.co/SillyTilly/mistralai_Mistral-Nemo-Base-2407 
Model Size12.2b
Required VRAM24.5 GB
Updated2024-12-22
MaintainerSillyTilly
Model Files  24.5 GB   4.9 GB: 1-of-5   4.9 GB: 2-of-5   4.9 GB: 3-of-5   4.9 GB: 4-of-5   4.9 GB: 5-of-5
Supported Languagesen fr de es it pt ru zh ja
Model ArchitectureAutoModelForCausalLM
Licenseapache-2.0
Tokenizer ClassGPT2Tokenizer
Vocabulary Size131072

Best Alternatives to Mistralai Mistral Nemo Base 2407

Best Alternatives
Context / RAM
Downloads
Likes
Mistral Nemo Instruct 24070K / 24.5 GB29016831314
Mistral Nemo Base 24070K / 24.5 GB2750851265
Mistral Nemo Base 2407 Chatml0K / 24.5 GB3312
Mistral Nemo Base 2407 Chatml0K / 24.5 GB1631
...stralai Mistral Nemo Base 24070K / 24.5 GB520
Nemo Sunfall V0.6.10K / 24.5 GB305
...lai Mistral Nemo Instruct 24070K / 24.5 GB481
Note: green Score (e.g. "73.2") means that the model is better than SillyTilly/mistralai_Mistral-Nemo-Base-2407.

Rank the Mistralai Mistral Nemo Base 2407 Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 40066 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241217