Starcoder2 7B by bigcode

 ยป  All LLMs  ยป  bigcode  ยป  Starcoder2 7B   URL Share it on

  Arxiv:2004.05150   Arxiv:2205.14135   Arxiv:2207.14255   Arxiv:2305.13245   Arxiv:2402.19173   Autotrain compatible   Code Dataset:bigcode/the-stack-v2-t...   Endpoints compatible   License:bigcode-openrail-m   Model-index   Region:us   Safetensors   Sharded   Starcoder2   Tensorflow

Starcoder2 7B Benchmarks

Rank the Starcoder2 7B Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  
Starcoder2 7B (bigcode/starcoder2-7b)

Quantized Models of the Starcoder2 7B

StarCoder2 7B GGUF915092 GB
Starcoder2 7B AWQ1334 GB

Best Alternatives to Starcoder2 7B

Best Alternatives
HF Rank
Starcoder2 7B Int4 Ov16K / 3.8 GB110
Speechless Starcoder2 7B16K / 14.4 GB95
Starcoder2 7B Instruct16K / 14.4 GB32
Jmg Starcoder2 7B 100K16K / 14.4 GB60
OpenCodeInterpreter SC2 7B16K / 14.9 GB914
Dolphincoder Starcoder2 7B16K / 14.9 GB172910
Starcoder2 Chat16K / 28.8 GB22
Starcoder2 7B 4bit16K / 4.4 GB201
StarCoder2 7B GGUF16K / 2.7 GB15099
Starcoder2 7B GPTQ16K / 4.5 GB32

Starcoder2 7B Parameters and Internals

LLM NameStarcoder2 7B
RepositoryOpen on ๐Ÿค— 
Model Size7b
Required VRAM14.4 GB
Model Typestarcoder2
Model Files  4.9 GB: 1-of-3   5.0 GB: 2-of-3   4.5 GB: 3-of-3
Model ArchitectureStarcoder2ForCausalLM
Context Length16384
Model Max Length16384
Transformers Version4.37.0.dev0
Tokenizer ClassGPT2Tokenizer
Vocabulary Size49152
Initializer Range0.018042
Torch Data Typebfloat16
Activation Functiongelu
Layer Norm Epsilon1.0E-5

What open-source LLMs or SLMs are you in search of? 34902 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v2024042801