Openbuddy Coder 34B V11 Bf16 AWQ by TheBloke

 ยป  All LLMs  ยป  TheBloke  ยป  Openbuddy Coder 34B V11 Bf16 AWQ   URL Share it on

  4-bit   Autotrain compatible   Awq Base model:openbuddy/openbuddy... Base model:quantized:openbuddy...   Codegen   De   En   Fr   It   Ja   Ko   Llama   Quantized   Region:us   Ru   Safetensors   Sharded   Tensorflow   Zh

Openbuddy Coder 34B V11 Bf16 AWQ Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").

Openbuddy Coder 34B V11 Bf16 AWQ Parameters and Internals

LLM NameOpenbuddy Coder 34B V11 Bf16 AWQ
Repository ๐Ÿค—https://huggingface.co/TheBloke/openbuddy-coder-34b-v11-bf16-AWQ 
Model NameOpenBuddy Coder 34B V11
Model CreatorOpenBuddy
Base Model(s)  Openbuddy Coder 34B V11 Bf16   OpenBuddy/openbuddy-coder-34b-v11-bf16
Model Size34b
Required VRAM18.5 GB
Updated2024-09-27
MaintainerTheBloke
Model Typellama
Model Files  10.0 GB: 1-of-2   8.5 GB: 2-of-2
Supported Languageszh en fr de ja ko it ru
AWQ QuantizationYes
Quantization Typeawq
Generates CodeYes
Model ArchitectureLlamaForCausalLM
Licensellama2
Context Length16384
Model Max Length16384
Transformers Version4.33.0.dev0
Tokenizer ClassLlamaTokenizer
Beginning of Sentence Token<s>
End of Sentence Token</s>
Unk Token<unk>
Vocabulary Size37632
Torch Data Typebfloat16
Openbuddy Coder 34B V11 Bf16 AWQ (TheBloke/openbuddy-coder-34b-v11-bf16-AWQ)

Best Alternatives to Openbuddy Coder 34B V11 Bf16 AWQ

Best Alternatives
Context / RAM
Downloads
Likes
Phind CodeLlama 34B V2 AWQ16K / 18.3 GB49631
...echless Codellama 34B V2.0 AWQ16K / 18.3 GB116
CodeLlama 34B Instruct AWQ16K / 18.3 GB332
...izardCoder Python 34B V1.0 AWQ16K / 18.3 GB166
CodeLlama 34B AWQ16K / 18.3 GB232
CodeLlama 34B Python AWQ16K / 18.3 GB202
MAmmoTH Coder 34B AWQ16K / 18.3 GB111
...nd CodeLlama 34B Python V1 AWQ16K / 18.3 GB132
Phind CodeLlama 34B V1 AWQ16K / 18.3 GB131
CodeFuse CodeLlama 34B AWQ16K / 18.3 GB82
Note: green Score (e.g. "73.2") means that the model is better than TheBloke/openbuddy-coder-34b-v11-bf16-AWQ.

Rank the Openbuddy Coder 34B V11 Bf16 AWQ Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 36339 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v2024072803