LLM Name | Codellama 34B Bnb 4bit |
Repository ๐ค | https://huggingface.co/unsloth/codellama-34b-bnb-4bit |
Model Size | 34b |
Required VRAM | 18.2 GB |
Updated | 2024-09-07 |
Maintainer | unsloth |
Model Type | llama |
Model Files | |
Supported Languages | en |
Quantization Type | 4bit |
Generates Code | Yes |
Model Architecture | LlamaForCausalLM |
License | apache-2.0 |
Context Length | 16384 |
Model Max Length | 16384 |
Transformers Version | 4.37.0.dev0 |
Tokenizer Class | CodeLlamaTokenizer |
Beginning of Sentence Token | <s> |
End of Sentence Token | </s> |
Padding Token | <unk> |
Unk Token | <unk> |
Vocabulary Size | 32000 |
Torch Data Type | bfloat16 |
Model |
Likes |
Downloads |
VRAM |
---|---|---|---|
Codellama Extraction | 0 | 6 | 67 GB |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
---|---|---|---|
Codellama Extraction | 16K / 67.6 GB | 6 | 0 |
CodeLlama 34B Python Fp16 | 16K / 67.5 GB | 1432 | 12 |
CodeLlama 34B Instruct Fp16 | 16K / 67.5 GB | 1429 | 7 |
Phind Codellama 34B V2 EXL2 | 16K / GB | 8 | 16 |
CodeLlama 34B Fp16 | 16K / 67.5 GB | 22 | 4 |
XwinCoder 34B 4.0bpw H6 EXL2 | 16K / 17.4 GB | 7 | 1 |
...Codellama 34B V2 Megacode EXL2 | 16K / GB | 11 | 10 |
...gpt 32K Codellama 34B Instruct | 32K / 67.5 GB | 2836 | 2 |
CodeLlama 34B Instruct Hf | 16K / 67.5 GB | 15791 | 272 |
Phind CodeLlama 34B V2 | 16K / 67.5 GB | 34755 | 817 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐