LLM EXPLORER
 LLM Explorer: A Curated Large Language Model Directory and Analytics
Dark Theme
  LLM  List    LLM Hosting    LLM Leaderboards    Blog    Newsfeed    Advertise

Starcoder2 7B by bigcode

 »  All LLMs  »  bigcode  »  Starcoder2 7B   URL Share it on

  13425   
  Arxiv:2004.05150   Arxiv:2205.14135   Arxiv:2207.14255   Arxiv:2305.13245   Arxiv:2402.19173   Autotrain compatible   Code Dataset:bigcode/the-stack-v2-t...   Endpoints compatible   Model-index   Region:us   Safetensors   Sharded   Starcoder2   Tensorflow

Starcoder2 7B Benchmarks

ARC: 38.31-60.2%
HellaSwag: 51.91-45.5%
MMLU: 41.21-52.4%
TruthfulQA: 41.99-28.8%
WinoGrande: 59.19-32.4%
GSM8K: 25.09-72.7%
HumanEval AVG: 26.10%
Python Eval: 34.09-49.1%
Java Eval: 29.420%
Javascript Eval: 35.350%
CPP Eval: 33.630%
PHP Eval: 30.580%
Julia Eval: 20.420%
D Eval: 15.120%
Lua Eval: 30.670%
R Eval: 16.720%
Racket Eval: 11.580%
Rust Eval: 29.620%
Swift Eval: 26.060%
nn.n% — How the model compares to the GPT-4.

Starcoder2 7B Parameters and Internals

LLM NameStarcoder2 7B
RepositoryOpen on 🤗 
Model Size7b
Required VRAM14.4 GB
Updated2024-07-27
Maintainerbigcode
Model Typestarcoder2
Model Files  4.9 GB: 1-of-3   5.0 GB: 2-of-3   4.5 GB: 3-of-3
Model ArchitectureStarcoder2ForCausalLM
Licensebigcode-openrail-m
Context Length16384
Model Max Length16384
Transformers Version4.37.0.dev0
Tokenizer ClassGPT2Tokenizer
Vocabulary Size49152
Torch Data Typebfloat16
Activation Functiongelu
Starcoder2 7B (bigcode/starcoder2-7b)

Quantized Models of the Starcoder2 7B

Model
Likes
Downloads
VRAM
Starcoder2 7B AWQ1614 GB
StarCoder2 7B GGUF99642 GB

Best Alternatives to Starcoder2 7B

Best Alternatives
HF Rank
Context/RAM
Downloads
Likes
Dolphincoder Starcoder2 7B0.316K / 14.9 GB26511
Starcoder2 7B Int4 Ov0.216K / 3.8 GB260
Jmg Starcoder2 7B 100K0.216K / 14.4 GB70
Speechless Starcoder2 7B0.216K / 14.4 GB125
OpenCodeInterpreter SC2 7B0.216K / 14.9 GB714
Starcoder2 7B Instruct0.216K / 14.4 GB262
Starcoder2 Chat0.216K / 28.8 GB102
...Starcoder2 7B Bnb 4bit Smashed0.216K / 4.4 GB250
Starcoder2 7B 4bit0.216K / 4.4 GB361
Starcoder2 7B AWQ0.316K / 4.5 GB611

Rank the Starcoder2 7B Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 34447 in total.

Email us: info@extractum.io. Our Privacy Policy  | Terms and Conditions  | Suggest an improvement.
Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v2024072501
  Support LLM Explorer