UltraMerge 7B by mlabonne

 ยป  All LLMs  ยป  mlabonne  ยป  UltraMerge 7B   URL Share it on

  Merged Model   Autotrain compatible   Endpoints compatible   License:cc-by-nc-4.0   Mistral   Moe   Region:us   Safetensors   Sharded   Tensorflow

UltraMerge 7B Benchmarks

Rank the UltraMerge 7B Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  
UltraMerge 7B (mlabonne/UltraMerge-7B)

Best Alternatives to UltraMerge 7B

Best Alternatives
HF Rank
...nated Proof 7b V1.0 Safetensor81.144K / 14.4 GB142811
Contaminated Proof 7b V1.081.144K / 14.4 GB13735
YamshadowExperiment28 7B76.8632K / 14.4 GB313620
MultiverseEx26 7B Slerp76.832K / 14.4 GB13741
NeuralSynthesis 7B V0.176.832K / 14.5 GB22563
Percival 01 7B Slerp76.7932K / 14.4 GB14423
J4RVIZ V6.076.7832K / 14.4 GB13180
Jason1903 SLERP76.7732K / 14.4 GB4631
...periment27Multi Verse Model 7B76.7732K / 14.4 GB13730
B3E3 SLM 7B V3.076.7632K / 14.4 GB13210
Note: green Score (e.g. "73.2") means that the model is better than mlabonne/UltraMerge-7B.

UltraMerge 7B Parameters and Internals

LLM NameUltraMerge 7B
RepositoryOpen on ๐Ÿค— 
Merged ModelYes
Model Size7.2b
Required VRAM14.4 GB
Model Typemistral
Model Files  4.9 GB: 1-of-3   5.0 GB: 2-of-3   4.5 GB: 3-of-3
Model ArchitectureMistralForCausalLM
Context Length32768
Model Max Length32768
Transformers Version4.39.0.dev0
Tokenizer ClassLlamaTokenizer
Padding Token<unk>
Vocabulary Size32000
Initializer Range0.02
Torch Data Typefloat16

What open-source LLMs or SLMs are you in search of? 34902 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v2024042801