SauerkrautLM SOLAR Instruct GPTQ by TheBloke

 ยป  All LLMs  ยป  TheBloke  ยป  SauerkrautLM SOLAR Instruct GPTQ   URL Share it on

  4-bit   Augmentation   Autotrain compatible Base model:vagosolutions/sauer...   Conversational Dataset:argilla/distilabel-mat...   De   Dpo   En   Finetuned   German   Gptq   Instruct   License:cc-by-nc-4.0   Llama   Quantized   Region:us   Safetensors

Rank the SauerkrautLM SOLAR Instruct GPTQ Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  
SauerkrautLM SOLAR Instruct GPTQ (TheBloke/SauerkrautLM-SOLAR-Instruct-GPTQ)

Best Alternatives to SauerkrautLM SOLAR Instruct GPTQ

Best Alternatives
HF Rank
Context/RAM
Downloads
Likes
...rautLM UNA SOLAR Instruct GPTQ4K / 6 GB73
Sakura SOLAR Instruct GPTQ4K / 6 GB73
...UNA SOLARkrautLM Instruct GPTQ4K / 6 GB22
...auerkrautLM SOLAR Instruct AWQ8K / 6 GB12
...auerkrautLM SOLAR Instruct AWQ8K / 6 GB130
...krautLM UNA SOLAR Instruct AWQ4K / 6 GB291
Sakura SOLAR Instruct AWQ4K / 6 GB71
LUNA SOLARkrautLM Instruct AWQ4K / 6 GB60

SauerkrautLM SOLAR Instruct GPTQ Parameters and Internals

LLM NameSauerkrautLM SOLAR Instruct GPTQ
RepositoryOpen on ๐Ÿค— 
Model NameSauerkrautLM SOLAR Instruct
Model CreatorVAGO solutions
Base Model(s)  SauerkrautLM SOLAR Instruct   VAGOsolutions/SauerkrautLM-SOLAR-Instruct
Model Size1.7b
Required VRAM6 GB
Updated2024-07-07
MaintainerTheBloke
Model Typesolar
Instruction-BasedYes
Model Files  6 GB
Supported Languagesen de
GPTQ QuantizationYes
Quantization Typegptq
Model ArchitectureLlamaForCausalLM
Licensecc-by-nc-4.0
Context Length8192
Model Max Length8192
Transformers Version4.35.2
Tokenizer ClassLlamaTokenizer
Padding Token</s>
Vocabulary Size32000
Initializer Range0.02
Torch Data Typebfloat16

What open-source LLMs or SLMs are you in search of? 34531 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v2024042801