CodeLlama 34B Instruct Hf by codellama

 ยป  All LLMs  ยป  codellama  ยป  CodeLlama 34B Instruct Hf   URL Share it on

  Arxiv:2308.12950   Autotrain compatible   Code   Codegen   Conversational   Endpoints compatible   Instruct   Llama   Llama2   Pytorch   Region:us   Safetensors   Sharded   Tensorflow

CodeLlama 34B Instruct Hf Benchmarks

CodeLlama 34B Instruct Hf (codellama/CodeLlama-34b-Instruct-hf)

CodeLlama 34B Instruct Hf Parameters and Internals

Model Type 
text generation, code synthesis, instruction following
Use Cases 
Areas:
Commercial use, Research
Applications:
Code synthesis, Understanding tasks
Primary Use Cases:
Code assistant, Code generation
Limitations:
Use only in English, Potential production of inaccurate or objectionable responses
Supported Languages 
Programming Languages (Python), Human Languages (English)
Training Details 
Methodology:
Uses an optimized transformer architecture. Trained on similar data as Llama 2.
Training Time:
January 2023 - July 2023
Hardware Used:
A100-80GB GPUs
Model Architecture:
Auto-regressive language model
Safety Evaluation 
Methodologies:
Safety evaluations include tests in English.
Ethical Considerations:
Use in languages other than English may produce unpredictable results.
Responsible Ai Considerations 
Accountability:
Developers should perform safety testing tailored to specific applications.
Mitigation Strategies:
Detailed in Responsible Use Guide.
Input Output 
Input Format:
Text input only
Accepted Modalities:
text
Output Format:
Generates text only
Performance Tips:
Ensure proper safety testing and tuning before deploying applications.
LLM NameCodeLlama 34B Instruct Hf
Repository ๐Ÿค—https://huggingface.co/codellama/CodeLlama-34b-Instruct-hf 
Model Size34b
Required VRAM67.5 GB
Updated2025-03-12
Maintainercodellama
Model Typellama
Instruction-BasedYes
Model Files  9.8 GB: 1-of-7   9.7 GB: 2-of-7   9.7 GB: 3-of-7   9.7 GB: 4-of-7   9.7 GB: 5-of-7   9.7 GB: 6-of-7   9.2 GB: 7-of-7   9.8 GB: 1-of-7   9.7 GB: 2-of-7   9.7 GB: 3-of-7   9.7 GB: 4-of-7   9.7 GB: 5-of-7   9.7 GB: 6-of-7   9.4 GB: 7-of-7
Supported Languagescode
Generates CodeYes
Model ArchitectureLlamaForCausalLM
Licensellama2
Context Length16384
Model Max Length16384
Transformers Version4.32.0.dev0
Tokenizer ClassCodeLlamaTokenizer
Beginning of Sentence Token<s>
End of Sentence Token</s>
Unk Token<unk>
Vocabulary Size32000
Torch Data Typebfloat16

Quantized Models of the CodeLlama 34B Instruct Hf

Model
Likes
Downloads
VRAM
CodeLlama 34B Instruct Hf GGUF116212 GB

Best Alternatives to CodeLlama 34B Instruct Hf

Best Alternatives
Context / RAM
Downloads
Likes
...gpt 32K Codellama 34B Instruct32K / 67.5 GB1542
Speechless Codellama 34B V2.016K / 67.5 GB184017
CodeLlama 34B Instruct Hf16K / 67.5 GB77116
Speechless Codellama 34B V1.916K / 67.5 GB18470
XAgentLLaMa 34B Preview16K / 157.3 GB173
MathCoder CL 34B16K / 67.5 GB302
CodeLlama 34B Instruct Hf16K / 1.4 GB163
...gpt 16K Codellama 34B Instruct16K / 67.5 GB324
CodeLlama 34B Instruct Fp1616K / 67.5 GB34747
CodeLlama 34B Instruct Hf 4bit16K / 19.4 GB192

Rank the CodeLlama 34B Instruct Hf Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 44887 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227