MermaidMixtral 2x7b by TroyDoesAI

 ยป  All LLMs  ยป  TroyDoesAI  ยป  MermaidMixtral 2x7b   URL Share it on

  Autotrain compatible   Endpoints compatible   License:cc-by-4.0   Mixtral   Moe   Region:us   Safetensors   Sharded   Tensorflow

Rank the MermaidMixtral 2x7b Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  
MermaidMixtral 2x7b (TroyDoesAI/MermaidMixtral-2x7b)

Best Alternatives to MermaidMixtral 2x7b

Best Alternatives
HF Rank
MixTAO 7Bx2 MoE V8.177.532K / 25.8 GB301738
... TomGrc FusionNet 7Bx2 MoE 13B77.4432K / 25.8 GB369050
LogoS 7Bx2 MoE 13B V0.277.1432K / 25.9 GB44518
DARE TIES 13B77.132K / 25.7 GB250110
13B MATH DPO77.0832K / 25.8 GB23950
MoE 13B DPO77.0532K / 25.8 GB23875
Megatron 2.1 MoE 2x7B76.6432K / 25.8 GB25901
MixtureofMerges MoE 2x7b V676.6332K / 25.8 GB24381
HeroBophades 2x7B76.5632K / 25.8 GB8110
MixTAO 7Bx2 MoE Instruct V7.076.5532K / 25.7 GB316919
Note: green Score (e.g. "73.2") means that the model is better than TroyDoesAI/MermaidMixtral-2x7b.

MermaidMixtral 2x7b Parameters and Internals

LLM NameMermaidMixtral 2x7b
RepositoryOpen on ๐Ÿค— 
Model Size12.9b
Required VRAM25.8 GB
Model Typemixtral
Model Files  5.0 GB: 1-of-6   4.9 GB: 2-of-6   5.0 GB: 3-of-6   5.0 GB: 4-of-6   4.9 GB: 5-of-6   1.0 GB: 6-of-6
Model ArchitectureMixtralForCausalLM
Context Length32768
Model Max Length32768
Transformers Version4.37.2
Tokenizer ClassLlamaTokenizer
Padding Token<s>
Vocabulary Size32000
Initializer Range0.02
Torch Data Typefloat16

What open-source LLMs or SLMs are you in search of? 35526 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20240042001