Model |
Likes |
Downloads |
VRAM |
---|---|---|---|
Qwen2 72B Instruct GPTQ Int4 | 31 | 7598 | 41 GB |
Qwen2 72B Instruct AWQ | 37 | 5591 | 41 GB |
Qwen2 72B Instruct GPTQ Int8 | 14 | 403 | 77 GB |
Qwen2 72B Instruct GGUF | 0 | 180 | 13 GB |
Qwen2 72B Instruct GGUF | 0 | 171 | 13 GB |
Qwen2 72B Instruct 4bit | 2 | 17 | 40 GB |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
---|---|---|---|
Qwen2.5 72B Instruct | 32K / 145.5 GB | 193302 | 329 |
RYS XLarge | 32K / 156.3 GB | 2410 | 69 |
Dracarys 72B Instruct | 32K / 146 GB | 3689 | 17 |
Calme 2.1 Qwen2 72B | 32K / 146 GB | 4355 | 27 |
Calme 2.2 Qwen2 72B | 32K / 146 GB | 2331 | 5 |
MG FinalMix 72B | 32K / 146.1 GB | 2501 | 3 |
Smaug Qwen2 72B Instruct | 32K / 146 GB | 2575 | 8 |
Qwen2 72B Instruct V0.1 | 32K / 146 GB | 83 | 8 |
Dracarys2 72B Instruct | 32K / 146 GB | 841 | 41 |
Magnum V1 72B | 32K / 146 GB | 5292 | 160 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐