LLM EXPLORER
 LLM Explorer: A Curated Large Language Model Directory and Analytics
Dark Theme
  LLM  List    LLM Hosting    LLM Leaderboards    Blog    Newsfeed    Advertise

Mistral 14B Merge Base by Vezora

 »  All LLMs  »  Vezora  »  Mistral 14B Merge Base   URL Share it on

  204   
  Merged Model   Autotrain compatible   Endpoints compatible   Mistral   Region:us   Safetensors   Sharded   Tensorflow
Model Card on HF 🤗: https://huggingface.co/Vezora/Mistral-14b-Merge-Base 

Mistral 14B Merge Base Benchmarks

LLME Score: 0.13728
nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Mistral 14B Merge Base (Vezora/Mistral-14b-Merge-Base)

Mistral 14B Merge Base Parameters and Internals

Additional Notes 
Model tends to over-respond with unasked questions when processing more than 512 tokens. Full fine-tuning can potentially enhance performance.
Training Details 
Data Sources:
airoboros-m-7b-3.1.2
Methodology:
SFT
Context Length:
512
Model Architecture:
Merged from Dolphin2.1-mistral-7b, Zephyr-7b-beta, MetaMath-Mistral-7B, Speechless-code-mistral-7b-v1.0 with LoRa adapter
LLM NameMistral 14B Merge Base
Repository 🤗https://huggingface.co/Vezora/Mistral-14b-Merge-Base 
Merged ModelYes
Model Size14b
Required VRAM28.4 GB
Updated2025-04-28
MaintainerVezora
Model Typemistral
Model Files  9.0 GB: 1-of-4   8.9 GB: 2-of-4   9.0 GB: 3-of-4   1.5 GB: 4-of-4
Model ArchitectureMistralForCausalLM
Licenseapache-2.0
Context Length32768
Model Max Length32768
Transformers Version4.34.1
Tokenizer ClassLlamaTokenizer
Vocabulary Size32000
Torch Data Typebfloat16

Best Alternatives to Mistral 14B Merge Base

Best Alternatives
Context / RAM
Downloads
Likes
...ral Nemo Instruct 14B Merge V11000K / 24.6 GB190
K2S3 14B V0.232K / 28.7 GB80
Wendigo 14B Alpha432K / 28.4 GB12880
Qwen1.5 14B Chat Mistral32K / 28.6 GB193
Synthetic Minstrel 14B32K / 27.6 GB63
Wandering Minstrel 14B32K / 27.6 GB53
Barcenas 14B Phi 3 Medium ORPO4K / 28 GB19135
SauerkrautLM Phi 3 Medium4K / 28 GB19099
...2.9.2 Phi 3 Medium Abliterated4K / 28 GB179218
MistralPhi3 11B4K / 23 GB50
Note: green Score (e.g. "73.2") means that the model is better than Vezora/Mistral-14b-Merge-Base.

Rank the Mistral 14B Merge Base Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 46763 in total.

Email us: info@extractum.io. Our Privacy Policy  | Terms and Conditions  | Suggest an improvement.
Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227
  Support LLM Explorer