LLM EXPLORER
 LLM Explorer: A Curated Large Language Model Directory and Analytics
Dark Theme
  LLM  List    LLM Hosting    LLM Leaderboards    Blog    Newsfeed    Advertise

Solar Pro Preview Instruct by upstage

 »  All LLMs  »  upstage  »  Solar Pro Preview Instruct   URL Share it on

  2600   
  Autotrain compatible   Conversational   Custom code   En   Instruct   Region:us   Safetensors   Sharded   Solar   Tensorflow

Solar Pro Preview Instruct Benchmarks

MMLU Pro: 47.48
GPQA: 16.11
MUSR: 15.01
BBH: 54.82
IFEval: 84.16 vs 88 (so35)-4.4%
MATH Lvl 5: 21.83
LLME Score: 0.52355
nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").

Solar Pro Preview Instruct Parameters and Internals

Model Type 
text-generation, instruction-following
Use Cases 
Areas:
research, commercial applications
Applications:
conversational tasks, instruction-following tasks
Primary Use Cases:
instruction-tuned tasks, chat interactions
Limitations:
Limited language coverage (English), maximum context length of 4K
Additional Notes 
Solar Pro Preview is a pre-release with an official version expected in November 2024, featuring expanded language support and longer context windows.
Supported Languages 
en (high)
Training Details 
Methodology:
Enhanced depth up-scaling method, training strategy on MMLU-Pro and IFEval benchmarks
Context Length:
4000
Hardware Used:
GPU with 80GB of VRAM
Input Output 
Accepted Modalities:
text
Output Format:
text
Performance Tips:
Use the ChatML template for optimal performance in conversational and instruction-following tasks.
LLM NameSolar Pro Preview Instruct
Repository 🤗https://huggingface.co/upstage/solar-pro-preview-instruct 
Model Size22.1b
Required VRAM44.5 GB
Updated2024-11-23
Maintainerupstage
Model Typesolar
Instruction-BasedYes
Model Files  4.9 GB: 1-of-9   5.0 GB: 2-of-9   4.9 GB: 3-of-9   5.0 GB: 4-of-9   5.0 GB: 5-of-9   5.0 GB: 6-of-9   4.9 GB: 7-of-9   5.0 GB: 8-of-9   4.8 GB: 9-of-9
Supported Languagesen
Model ArchitectureSolarForCausalLM
Licensemit
Context Length4096
Model Max Length4096
Transformers Version4.44.2
Tokenizer ClassLlamaTokenizer
Padding Token<|im_end|>
Vocabulary Size32128
Torch Data Typebfloat16
Solar Pro Preview Instruct (upstage/solar-pro-preview-instruct)

Quantized Models of the Solar Pro Preview Instruct

Model
Likes
Downloads
VRAM
...olar Pro Preview Instruct GGUF1818667424 GB

Rank the Solar Pro Preview Instruct Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 38255 in total.

Email us: info@extractum.io. Our Privacy Policy  | Terms and Conditions  | Suggest an improvement.
Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241110
  Support LLM Explorer