Starcoder2 15B Instruct V0.1 by bigcode

 ยป  All LLMs  ยป  bigcode  ยป  Starcoder2 15B Instruct V0.1   URL Share it on

  Arxiv:2410.24198   Autotrain compatible Base model:bigcode/starcoder2-... Base model:finetune:bigcode/st...   Code   Conversational Dataset:bigcode/self-oss-instr...   Endpoints compatible   Instruct   Model-index   Region:us   Safetensors   Sharded   Starcoder2   Tensorflow

Starcoder2 15B Instruct V0.1 Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Starcoder2 15B Instruct V0.1 (bigcode/starcoder2-15b-instruct-v0.1)

Starcoder2 15B Instruct V0.1 Parameters and Internals

Model Type 
text generation
Use Cases 
Primary Use Cases:
coding-related instructions
Limitations:
The model might not adhere strictly to instructions that dictate the output format, Limitations with other programming languages and out-of-domain coding tasks
Considerations:
Providing a response prefix or a one-shot example can steer the model.
Training Details 
Data Sources:
bigcode/self-oss-instruct-sc2-exec-filter-50k
Methodology:
Self-aligned instruction fine-tuning without human annotations or distilled data.
Context Length:
1280
Hardware Used:
1 x NVIDIA A100 80GB
LLM NameStarcoder2 15B Instruct V0.1
Repository ๐Ÿค—https://huggingface.co/bigcode/starcoder2-15b-instruct-v0.1 
Base Model(s)  Starcoder2 15B   bigcode/starcoder2-15b
Model Size15b
Required VRAM31.9 GB
Updated2025-02-22
Maintainerbigcode
Model Typestarcoder2
Instruction-BasedYes
Model Files  4.9 GB: 1-of-7   5.0 GB: 2-of-7   5.0 GB: 3-of-7   5.0 GB: 4-of-7   5.0 GB: 5-of-7   5.0 GB: 6-of-7   2.0 GB: 7-of-7
Model ArchitectureStarcoder2ForCausalLM
Licensebigcode-openrail-m
Context Length16384
Model Max Length16384
Transformers Version4.39.0.dev0
Tokenizer ClassGPT2Tokenizer
Vocabulary Size49152
Torch Data Typebfloat16

Quantized Models of the Starcoder2 15B Instruct V0.1

Model
Likes
Downloads
VRAM
...rCoder2 15B Instruct V0.1 GGUF01096 GB
...rCoder2 15B Instruct V0.1 GGUF0716 GB

Best Alternatives to Starcoder2 15B Instruct V0.1

Best Alternatives
Context / RAM
Downloads
Likes
Starcoder2 15B Instruct V0.116K / 53.4 GB110
Dolphincoder Starcoder2 15B16K / 31.9 GB14869
Starcoder2 15B Instruct16K / 31.9 GB227
...rCoder2 15B Instruct V0.1 GGUF16K / 6.2 GB1090
...rCoder2 15B Instruct V0.1 GGUF16K / 6.2 GB710
Starcoder2 15B Instruct GPTQ16K / 9.2 GB62

Rank the Starcoder2 15B Instruct V0.1 Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 43470 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227