Codegen2 16B P by Salesforce

 ยป  All LLMs  ยป  Salesforce  ยป  Codegen2 16B P   URL Share it on

  Arxiv:2305.02309   Autotrain compatible   Codegen   Custom code   Endpoints compatible   Pytorch   Region:us   Sharded

Codegen2 16B P Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Codegen2 16B P (Salesforce/codegen2-16B_P)

Codegen2 16B P Parameters and Internals

Model Type 
autoregressive, language model, program synthesis
Use Cases 
Areas:
program synthesis
Applications:
generating executable code
Primary Use Cases:
Generating executables from English prompts, Completing partially-generated code
Supported Languages 
c (supported), c++ (supported), c-sharp (supported), dart (supported), go (supported), java (supported), javascript (supported), kotlin (supported), lua (supported), php (supported), python (supported), ruby (supported), rust (supported), scala (supported), shell (supported), sql (supported), swift (supported), typescript (supported), vue (supported)
Training Details 
Data Sources:
the deduplicated version of the Stack dataset (v1.1)
Methodology:
cross-entropy loss to maximize the likelihood of sequential inputs
Input Output 
Accepted Modalities:
text
LLM NameCodegen2 16B P
Repository ๐Ÿค—https://huggingface.co/Salesforce/codegen2-16B_P 
Model Size16b
Required VRAM64.3 GB
Updated2025-02-09
MaintainerSalesforce
Model Typecodegen
Model Files  9.7 GB: 1-of-7   9.7 GB: 2-of-7   9.7 GB: 3-of-7   9.7 GB: 4-of-7   9.7 GB: 5-of-7   9.7 GB: 6-of-7   6.1 GB: 7-of-7
Generates CodeYes
Model ArchitectureCodeGenForCausalLM
Licenseapache-2.0
Model Max Length1024
Transformers Version4.25.1
Tokenizer ClassGPT2Tokenizer
Vocabulary Size51200
Torch Data Typefloat32
Activation Functiongelu_new

Best Alternatives to Codegen2 16B P

Best Alternatives
Context / RAM
Downloads
Likes
Instruct Codegen 16B0K / 32.2 GB1821
Codegen 16B Mono Toolbench0K / 128.4 GB165
Codegen 16B Multi 6 Parts0K / 32.2 GB60
Codegen 16B Nl Sharded0K / 32.1 GB77
Fine Tuned Codegen 16B Verilog0K / 32.2 GB11412
Codegen 16B Nl0K / 32.2 GB165118
Codegen 16B Mono0K / 32.2 GB1020125
Codegen 16B Multi0K / 32.2 GB462120
Note: green Score (e.g. "73.2") means that the model is better than Salesforce/codegen2-16B_P.

Rank the Codegen2 16B P Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 42848 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227