LLM Explorer: A Curated Large Language Model Directory and Analytics  // 

Starcoder GPTQ by TheBloke

What open-source LLMs or SLMs are you in search of? 18857 in total.

 ยป  All LLMs  ยป  TheBloke  ยป  Starcoder GPTQ   URL Share it on

  Arxiv:1911.02150   Arxiv:2205.14135   Arxiv:2207.14255   Arxiv:2305.06161   4-bit   Autotrain compatible   Code   Codegen Dataset:bigcode/the-stack-dedu...   Gpt bigcode   Gptq   License:bigcode-openrail-m   Model-index   Quantized   Region:us   Safetensors

Rank the Starcoder GPTQ Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  
Starcoder GPTQ (TheBloke/starcoder-GPTQ)

Best Alternatives to Starcoder GPTQ

Best Alternatives
HF Rank
Context/RAM
Downloads
Likes
Starchat Beta GPTQ0K / 8.9 GB36427
Starcoderplus GPTQ0K / 8.9 GB11225

Starcoder GPTQ Parameters and Internals

LLM NameStarcoder GPTQ
RepositoryOpen on ๐Ÿค— 
Model Size2.6b
Required VRAM8.9 GB
Updated2024-02-28
MaintainerTheBloke
Model Typegpt_bigcode
Model Files  8.9 GB
GPTQ QuantizationYes
Quantization Typegptq
Generates CodeYes
Model ArchitectureGPTBigCodeForCausalLM
Licensebigcode-openrail-m
Transformers Version4.28.1
Tokenizer ClassGPT2Tokenizer
Vocabulary Size49152
Initializer Range0.02
Torch Data Typefloat32
Activation Functiongelu
Attention Dropout0.1
Embedding Dropout0.1
Layer Norm Epsilon1.0E-5
Summary First Dropout0.1
Summary Typecls_index
Original data from HuggingFace, OpenCompass and various public git repos.
Release v2024022003