LLM EXPLORER
 LLM Explorer: A Curated Large Language Model Directory and Analytics
Dark Theme
  LLM  List    LLM Hosting    LLM Leaderboards    Blog    Newsfeed    Advertise

Starcoder Gpteacher Code Instruct by GeorgiaTechResearchInstitute

 »  All LLMs  »  GeorgiaTechResearchInstitute  »  Starcoder Gpteacher Code Instruct   URL Share it on

  1866   
  Arxiv:1911.02150   Arxiv:2205.14135   Arxiv:2207.14255   Arxiv:2305.06161   Autotrain compatible   Code-gen   Codegen Dataset:bigcode/the-stack-dedu... Dataset:teknium1/gpteacher-cod...   Endpoints compatible   Gpt bigcode   Instruct   Pytorch   Region:us   Sharded
Model Card on HF 🤗: https://huggingface.co/GeorgiaTechResearchInstitute/starcoder-gpteacher-code-instruct 

Starcoder Gpteacher Code Instruct Benchmarks

ARC: 32.68 vs 96.7 (so35)-66.2%
HellaSwag: 47.6 vs 95.3 (gpt4)-50.1%
MMLU: 28.63 vs 88.3 (so35)-67.6%
TruthfulQA: 40.41 vs 59 (gpt4)-31.5%
WinoGrande: 55.56 vs 87.5 (gpt4)-36.5%
LLME Score: 0.16559
nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Starcoder Gpteacher Code Instruct (GeorgiaTechResearchInstitute/starcoder-gpteacher-code-instruct)

Starcoder Gpteacher Code Instruct Parameters and Internals

Model Type 
text-generation
Use Cases 
Primary Use Cases:
Code generation
Limitations:
The generated code might be inefficient, contain bugs or exploits. Current fine-tuning results may not represent the model's full potential.
Supported Languages 
languages (80+ Programming languages), proficiency ()
Training Details 
Data Sources:
bigcode/the-stack-dedup, teknium1/GPTeacher-codegen
Data Volume:
1 trillion tokens
Methodology:
Multi Query Attention, Fill-in-the-Middle objective
Context Length:
8192
Model Architecture:
GPT-2 model with multi-query attention and Fill-in-the-Middle objective
LLM NameStarcoder Gpteacher Code Instruct
Repository 🤗https://huggingface.co/GeorgiaTechResearchInstitute/starcoder-gpteacher-code-instruct 
Required VRAM63.3 GB
Updated2025-02-22
MaintainerGeorgiaTechResearchInstitute
Model Typegpt_bigcode
Instruction-BasedYes
Model Files  9.9 GB: 1-of-7   9.9 GB: 2-of-7   9.8 GB: 3-of-7   9.9 GB: 4-of-7   9.8 GB: 5-of-7   9.9 GB: 6-of-7   4.1 GB: 7-of-7   0.0 GB
Generates CodeYes
Model ArchitectureGPTBigCodeForCausalLM
Licensebigcode-openrail-m
Model Max Length1024
Transformers Version4.28.1
Tokenizer ClassGPT2Tokenizer
Beginning of Sentence Token<|endoftext|>
End of Sentence Token<|endoftext|>
Unk Token<|endoftext|>
Vocabulary Size49153
Torch Data Typefloat32
Activation Functiongelu
Errorsreplace

Best Alternatives to Starcoder Gpteacher Code Instruct

Best Alternatives
Context / RAM
Downloads
Likes
...der Skeleton Wizard Coder 8bit0K / 15.9 GB71

Rank the Starcoder Gpteacher Code Instruct Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 43470 in total.

Email us: info@extractum.io. Our Privacy Policy  | Terms and Conditions  | Suggest an improvement.
Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227
  Support LLM Explorer