SOLAR 10.7B Instruct V1.0 Pruned50 Quant Ds by neuralmagic

 ยป  All LLMs  ยป  neuralmagic  ยป  SOLAR 10.7B Instruct V1.0 Pruned50 Quant Ds   URL Share it on

  Arxiv:2301.00774   Autotrain compatible Base model:upstage/solar-10.7b...   Conversational   Deepsparse   Instruct   Llama   Onnx   Region:us

Rank the SOLAR 10.7B Instruct V1.0 Pruned50 Quant Ds Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  
SOLAR 10.7B Instruct V1.0 Pruned50 Quant Ds (neuralmagic/SOLAR-10.7B-Instruct-v1.0-pruned50-quant-ds)

Best Alternatives to SOLAR 10.7B Instruct V1.0 Pruned50 Quant Ds

Best Alternatives
HF Rank
Context/RAM
Downloads
Likes
SOLAR 10.7B Instruct V1.0 128K128K / 21.4 GB7264
SOLAR 10.7B V1.0 Instruct 16K16K / 21.4 GB572
SauerkrautLM SOLAR Instruct8K / 21.4 GB133144
Kazemi 1.2 Solar8K / 21.4 GB11
MetaModelv28K / 21.4 GB12810
Mj Solar 10.7B V1.04K / 6.4 GB170
Solar Ko Common Slerp4K / 21 GB4160
SOLAR 10.7B Instruct V1.04K / 21.4 GB57653594
Sakura SOLAR Instruct4K / 21.4 GB350928
KULLM34K / 21.4 GB330926

SOLAR 10.7B Instruct V1.0 Pruned50 Quant Ds Parameters and Internals

LLM NameSOLAR 10.7B Instruct V1.0 Pruned50 Quant Ds
RepositoryOpen on ๐Ÿค— 
Base Model(s)  SOLAR 10.7B Instruct V1.0   upstage/SOLAR-10.7B-Instruct-v1.0
Model Size10.7b
Updated2024-07-07
Maintainerneuralmagic
Model Typellama
Instruction-BasedYes
Model ArchitectureLlamaForCausalLM
Context Length4096
Model Max Length4096
Transformers Version1.7.0.20231218
Tokenizer ClassLlamaTokenizer
Padding Token</s>
Vocabulary Size32000
Initializer Range0.02
Torch Data Typefloat16

What open-source LLMs or SLMs are you in search of? 34531 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v2024042801