Speechless Starcoder2 15B by uukuguy

 ยป  All LLMs  ยป  uukuguy  ยป  Speechless Starcoder2 15B   URL Share it on

  Arxiv:2004.05150   Arxiv:2205.14135   Arxiv:2207.14255   Arxiv:2305.13245   Arxiv:2402.19173   Autotrain compatible   Code Dataset:bigcode/the-stack-v2-t...   Endpoints compatible   Fp16   Model-index   Quantized   Region:us   Safetensors   Sharded   Starcoder2   Tensorflow

Speechless Starcoder2 15B Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Speechless Starcoder2 15B (uukuguy/speechless-starcoder2-15b)

Speechless Starcoder2 15B Parameters and Internals

Model Type 
text-generation
Use Cases 
Areas:
research, programming assistance
Applications:
code generation, programming help
Limitations:
may generate inefficient, buggy, or exploitable code
Additional Notes 
Not an instruction model; Contains code from permissive license only.
Training Details 
Data Sources:
The Stack v2, GitHub, Arxiv, Wikipedia
Data Volume:
4+ trillion tokens
Methodology:
Fill-in-the-Middle objective
Context Length:
16384
Hardware Used:
NVIDIA Eos Supercomputer, 1024 x H100 GPUs
Model Architecture:
Transformer decoder with grouped-query and sliding window attention
Input Output 
Input Format:
Alpaca instruction format
Accepted Modalities:
text
Output Format:
text
Performance Tips:
Ensure proper context is provided; model not suited for instruction following
LLM NameSpeechless Starcoder2 15B
Repository ๐Ÿค—https://huggingface.co/uukuguy/speechless-starcoder2-15b 
Model Size15b
Required VRAM31.9 GB
Updated2025-02-22
Maintaineruukuguy
Model Typestarcoder2
Model Files  4.9 GB: 1-of-7   5.0 GB: 2-of-7   5.0 GB: 3-of-7   5.0 GB: 4-of-7   5.0 GB: 5-of-7   5.0 GB: 6-of-7   2.0 GB: 7-of-7
Quantization Typefp16
Model ArchitectureStarcoder2ForCausalLM
Licensebigcode-openrail-m
Context Length16384
Model Max Length16384
Transformers Version4.39.0.dev0
Tokenizer ClassGPT2Tokenizer
Vocabulary Size49152
Torch Data Typefloat16

Best Alternatives to Speechless Starcoder2 15B

Best Alternatives
Context / RAM
Downloads
Likes
Starcoder2 15B16K / 63.8 GB25873587
Starchat2 15B V0.116K / 31.9 GB15029112
Starcoder2 15B Instruct V0.116K / 31.9 GB1273101
Starcoder2 15B AWQ16K / 9.2 GB411
CodeFuse StarCoder2 15B16K / 31.9 GB112
...rCoder2 15B Instruct V0.1 GGUF16K / 6.2 GB1090
Starcoder2 15B Finetuned Drake16K / 63.8 GB50
StarCoder2 15B GGUF16K / 6.2 GB95524
...rCoder2 15B Instruct V0.1 GGUF16K / 6.2 GB710
...aceH4 Starchat2 15B V0.1 4bits16K / 9.9 GB70
Note: green Score (e.g. "73.2") means that the model is better than uukuguy/speechless-starcoder2-15b.

Rank the Speechless Starcoder2 15B Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 43508 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227