LLM Explorer: A Curated Large Language Model Directory and Analytics  // 

Starcoder GPTQ by TheBloke

What open-source LLMs or SLMs are you in search of? 18857 in total.

 ยป  All LLMs  ยป  TheBloke  ยป  Starcoder GPTQ   URL Share it on

  Arxiv:1911.02150   Arxiv:2205.14135   Arxiv:2207.14255   Arxiv:2305.06161   4-bit   Autotrain compatible   Code   Codegen Dataset:bigcode/the-stack-dedu...   Gpt bigcode   Gptq   License:bigcode-openrail-m   Model-index   Quantized   Region:us   Safetensors

Rank the Starcoder GPTQ Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  
Starcoder GPTQ (TheBloke/starcoder-GPTQ)

Best Alternatives to Starcoder GPTQ

Best Alternatives
HF Rank
Starchat Beta GPTQ0K / 8.9 GB36427
Starcoderplus GPTQ0K / 8.9 GB11225

Starcoder GPTQ Parameters and Internals

LLM NameStarcoder GPTQ
RepositoryOpen on ๐Ÿค— 
Model Size2.6b
Required VRAM8.9 GB
Model Typegpt_bigcode
Model Files  8.9 GB
GPTQ QuantizationYes
Quantization Typegptq
Generates CodeYes
Model ArchitectureGPTBigCodeForCausalLM
Transformers Version4.28.1
Tokenizer ClassGPT2Tokenizer
Vocabulary Size49152
Initializer Range0.02
Torch Data Typefloat32
Activation Functiongelu
Attention Dropout0.1
Embedding Dropout0.1
Layer Norm Epsilon1.0E-5
Summary First Dropout0.1
Summary Typecls_index
Original data from HuggingFace, OpenCompass and various public git repos.
Release v2024022003