LLM Explorer: A Curated Large Language Model Directory and Analytics  // 

Stablelm Base Alpha 3B 4bit GPTQ by DaertML

What open-source LLMs or SLMs are you in search of? 18732 in total.

 ยป  All LLMs  ยป  DaertML  ยป  Stablelm Base Alpha 3B 4bit GPTQ   URL Share it on

  4-bit   4bit   Autotrain compatible   Endpoints compatible   Gpt neox   Gptq   Pytorch   Quantized   Region:us   Safetensors

Rank the Stablelm Base Alpha 3B 4bit GPTQ Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  
Stablelm Base Alpha 3B 4bit GPTQ (DaertML/stablelm-base-alpha-3b-4bit-GPTQ)

Best Alternatives to Stablelm Base Alpha 3B 4bit GPTQ

Best Alternatives
HF Rank
...blecode Instruct Alpha 3B GPTQ4K / 1.8 GB25916
...de Completion Alpha 3B 4K GPTQ4K / 1.8 GB959
...blecode Instruct Alpha 3B GPTQ4K / 1.8 GB31
...CITE Chat 3B V1 GPTQ 4bit 128g2K / 2 GB24
Stablelm Tuned Alpha 3B 8bit4K / 4.3 GB23
Stablelm Tuned Alpha 3B 16bit4K / 7.5 GB26
Guanaco 3B Uncensored V2 GPTQ2K / 1.8 GB170214
Dolly V2 3B 8bit2K / 3.2 GB60
Bling Red Pajamas 3B 0.12K / 5.5 GB484
RedPajama INCITE Chat 3B V12K / 5.7 GB5896131

Stablelm Base Alpha 3B 4bit GPTQ Parameters and Internals

LLM NameStablelm Base Alpha 3B 4bit GPTQ
RepositoryOpen on ๐Ÿค— 
Model Size3b
Required VRAM2.5 GB
Model Typegpt_neox
Model Files  2.5 GB   2.5 GB
GPTQ QuantizationYes
Quantization Typegptq|4bit
Model ArchitectureGPTNeoXForCausalLM
Context Length4096
Model Max Length4096
Transformers Version4.33.1
Tokenizer ClassGPTNeoXTokenizer
Vocabulary Size50688
Initializer Range0.02
Torch Data Typefloat16
Original data from HuggingFace, OpenCompass and various public git repos.
Release v2024022003