StarlingMaid 2x7B Base by dawn17

 ยป  All LLMs  ยป  dawn17  ยป  StarlingMaid 2x7B Base   URL Share it on

  Autotrain compatible   Conversational   Endpoints compatible   License:apache-2.0   Mixtral   Moe   Region:us   Safetensors   Sharded   Tensorflow

StarlingMaid 2x7B Base Benchmarks

Rank the StarlingMaid 2x7B Base Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  
StarlingMaid 2x7B Base (dawn17/StarlingMaid-2x7B-base)

Best Alternatives to StarlingMaid 2x7B Base

Best Alternatives
HF Rank
MixTAO 7Bx2 MoE V8.177.532K / 25.8 GB301738
... TomGrc FusionNet 7Bx2 MoE 13B77.4432K / 25.8 GB369050
LogoS 7Bx2 MoE 13B V0.277.1432K / 25.9 GB44518
DARE TIES 13B77.132K / 25.7 GB250110
13B MATH DPO77.0832K / 25.8 GB23950
MoE 13B DPO77.0532K / 25.8 GB23875
Megatron 2.1 MoE 2x7B76.6432K / 25.8 GB25901
MixtureofMerges MoE 2x7b V676.6332K / 25.8 GB24381
HeroBophades 2x7B76.5632K / 25.8 GB8110
MixTAO 7Bx2 MoE Instruct V7.076.5532K / 25.7 GB316919
Note: green Score (e.g. "73.2") means that the model is better than dawn17/StarlingMaid-2x7B-base.

StarlingMaid 2x7B Base Parameters and Internals

LLM NameStarlingMaid 2x7B Base
RepositoryOpen on ๐Ÿค— 
Model Size12.9b
Required VRAM25.8 GB
Model Typemixtral
Model Files  9.9 GB: 1-of-3   10.0 GB: 2-of-3   5.9 GB: 3-of-3
Model ArchitectureMixtralForCausalLM
Context Length8192
Model Max Length8192
Transformers Version4.39.3
Tokenizer ClassLlamaTokenizer
Padding Token<s>
Vocabulary Size32002
Initializer Range0.02
Torch Data Typebfloat16

What open-source LLMs or SLMs are you in search of? 35526 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20240042001