CodeFuse 13B by codefuse-ai

 ยป  All LLMs  ยป  codefuse-ai  ยป  CodeFuse 13B   URL Share it on

  Autotrain compatible   Endpoints compatible   Gpt neox   Pytorch   Region:us   Sharded

CodeFuse 13B Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
CodeFuse 13B (codefuse-ai/CodeFuse-13B)

CodeFuse 13B Parameters and Internals

Model Type 
code-generation
Use Cases 
Areas:
code generation
Applications:
code generation for over 40 programming languages
Additional Notes 
Model may have corrupted files during transfer, MD5 value checks are recommended.
Supported Languages 
Chinese (high), English (high)
Training Details 
Data Sources:
1000B token code, Chinese, English
Data Volume:
1000B tokens
Methodology:
fine-tuned on CodeFuse-Evol-instruction-66k dataset
Context Length:
4096
Model Architecture:
GPT-NeoX
LLM NameCodeFuse 13B
Repository ๐Ÿค—https://huggingface.co/codefuse-ai/CodeFuse-13B 
Model Size13b
Required VRAM54.6 GB
Updated2025-02-22
Maintainercodefuse-ai
Model Typegpt_neox
Model Files  9.9 GB: 1-of-6   9.8 GB: 2-of-6   9.7 GB: 3-of-6   9.7 GB: 4-of-6   10.0 GB: 5-of-6   5.5 GB: 6-of-6
Model ArchitectureGPTNeoXForCausalLM
Licenseother
Context Length4096
Model Max Length4096
Transformers Version4.31.0
Tokenizer ClassPreTrainedTokenizerFast
Vocabulary Size100831
Torch Data Typefloat16

Quantized Models of the CodeFuse 13B

Model
Likes
Downloads
VRAM
CodeFuse 13B GPTQ4378 GB

Best Alternatives to CodeFuse 13B

Best Alternatives
Context / RAM
Downloads
Likes
Sarashina1 13B2K / 26.3 GB2800
Polyglot Ko Kullm V2 Fix2K / 51.7 GB20100
Pythia 13B Deduped Green Devil2K / 23.9 GB218110
KORani V1 13B2K / 51.8 GB357
CodeFuse 13B GPTQ4K / 8.6 GB374
Note: green Score (e.g. "73.2") means that the model is better than codefuse-ai/CodeFuse-13B.

Rank the CodeFuse 13B Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 43508 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227