SOLAR Math 2x10.7B V0.2 by macadeliccc

 ยป  All LLMs  ยป  macadeliccc  ยป  SOLAR Math 2x10.7B V0.2   URL Share it on

  Arxiv:2312.15166   Autotrain compatible   Conversational   Endpoints compatible   Instruct   Mixtral   Model-index   Moe   Region:us   Safetensors   Sharded   Tensorflow

SOLAR Math 2x10.7B V0.2 Benchmarks

SOLAR Math 2x10.7B V0.2 (macadeliccc/SOLAR-math-2x10.7b-v0.2)

SOLAR Math 2x10.7B V0.2 Parameters and Internals

Model Type 
text-generation
Additional Notes 
This model is a merge of two SOLAR-10.7B instruct finetunes.
LLM NameSOLAR Math 2x10.7B V0.2
Repository ๐Ÿค—https://huggingface.co/macadeliccc/SOLAR-math-2x10.7b-v0.2 
Model Size19.2b
Required VRAM38.4 GB
Updated2024-12-14
Maintainermacadeliccc
Model Typemixtral
Instruction-BasedYes
Model Files  9.9 GB: 1-of-4   10.0 GB: 2-of-4   10.0 GB: 3-of-4   8.5 GB: 4-of-4
Model ArchitectureMixtralForCausalLM
Licensecc-by-nc-4.0
Context Length4096
Model Max Length4096
Transformers Version4.37.0.dev0
Tokenizer ClassLlamaTokenizer
Padding Token<s>
Vocabulary Size32000
Torch Data Typefloat32

Best Alternatives to SOLAR Math 2x10.7B V0.2

Best Alternatives
Context / RAM
Downloads
Likes
Raccoon Small32K / 38.4 GB861
...oundary Solar Chat 2x10.7B MoE4K / 38 GB1231
...ixtral 8x22B Instruct V0.1 AWQ64K / 73.7 GB13610
... 8x22B Instruct V0.1 GPTQ 4bit64K / 74.1 GB1771
Note: green Score (e.g. "73.2") means that the model is better than macadeliccc/SOLAR-math-2x10.7b-v0.2.

Rank the SOLAR Math 2x10.7B V0.2 Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 39237 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241124