Model |
Likes |
Downloads |
VRAM |
---|---|---|---|
CodeLlama 70B Instruct GGUF | 52 | 3244 | 25 GB |
CodeLlama 70B Instruct Hf GGUF | 2 | 280 | 25 GB |
CodeLlama 70B Instruct AWQ | 11 | 168 | 36 GB |
CodeLlama 70B Instruct GPTQ | 11 | 38 | 35 GB |
Best Alternatives |
HF Rank |
Context/RAM |
Downloads |
Likes |
---|---|---|---|---|
Code Llama 70B Python Instruct | 0.3 | 4K / 138.1 GB | 310 | 1 |
CodeLlama 70B Instruct Hf | 0.2 | 4K / 72.3 GB | 447 | 7 |
CodeLlama 70B Instruct Neuron | 0.2 | 4K / GB | 6 | 1 |
BigCodeLlama 92B | 0.2 | 2K / 184 GB | 302 | 0 |
...70B Instruct Nf4 Fp16 Upscaled | 0.2 | 4K / 138.7 GB | 234 | 2 |
...Llama 70B Instruct Hf 4bit MLX | 0.2 | 4K / 39.1 GB | 10 | 25 |
...70B Instruct Hf 5.0bpw H6 EXL2 | 0.2 | 2K / 43.6 GB | 11 | 5 |
...0B Instruct Hf 2.65bpw H6 EXL2 | 0.2 | 2K / 23.4 GB | 6 | 3 |
...70B Instruct Hf 2.4bpw H6 EXL2 | 0.2 | 2K / 21.3 GB | 10 | 1 |
...70B Instruct Hf 4.0bpw H6 EXL2 | 0.2 | 2K / 35.1 GB | 12 | 1 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐