LLM Name | Llama 2 70B Guanaco QLoRA GGUF |
Repository ๐ค | https://huggingface.co/nitsuai/llama-2-70b-Guanaco-QLoRA-GGUF |
Model Name | Llama2 70B Guanaco QLoRA |
Model Creator | Mikael110 |
Base Model(s) | |
Model Size | 70b |
Required VRAM | 29.3 GB |
Updated | 2024-09-07 |
Maintainer | nitsuai |
Model Type | llama |
Model Files | |
Supported Languages | en |
GGUF Quantization | Yes |
Quantization Type | gguf |
Model Architecture | AutoModel |
License | other |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
---|---|---|---|
...gekit Passthrough Yqhuxcv GGUF | 0K / 16.9 GB | 97 | 0 |
CodeLlama 70B Instruct GGUF | 0K / 25.5 GB | 2627 | 56 |
CodeLlama 70B Hf GGUF | 0K / 25.5 GB | 2554 | 43 |
CodeLlama 70B Python GGUF | 0K / 25.5 GB | 1808 | 34 |
Meta Llama 3 70B Instruct GGUF | 0K / 26.4 GB | 267 | 3 |
KafkaLM 70B German V0.1 GGUF | 0K / 25.5 GB | 1082 | 15 |
DAD Model V2 70B Q4 | 0K / 42.5 GB | 11 | 0 |
Llama 2 70B Chat GGUF | 0K / 29.3 GB | 8593 | 120 |
Meditron 70B GGUF | 0K / 29.3 GB | 733 | 19 |
Aurora Nights 70B V1.0 GGUF | 0K / 29.3 GB | 167 | 8 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐