Model |
Likes |
Downloads |
VRAM |
---|---|---|---|
Qwen2.5 72B Instruct AWQ | 22 | 12577 | 41 GB |
Qwen2.5 72B Instruct GPTQ Int4 | 15 | 6737 | 41 GB |
Qwen2.5 72B Instruct GPTQ Int8 | 4 | 5009 | 77 GB |
Qwen2.5 72B Instruct 4bit | 3 | 105 | 40 GB |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
---|---|---|---|
Qwen2 72B Instruct | 32K / 145.5 GB | 84414 | 663 |
RYS XLarge | 32K / 156.3 GB | 2510 | 69 |
Dracarys 72B Instruct | 32K / 146 GB | 707 | 17 |
Calme 2.1 Qwen2 72B | 32K / 146 GB | 4329 | 27 |
Calme 2.2 Qwen2 72B | 32K / 146 GB | 2338 | 5 |
MG FinalMix 72B | 32K / 146.1 GB | 2429 | 3 |
Smaug Qwen2 72B Instruct | 32K / 146 GB | 2448 | 8 |
Qwen2 72B Instruct V0.1 | 32K / 146 GB | 83 | 8 |
Dracarys2 72B Instruct | 32K / 146 GB | 547 | 36 |
Replete LLM V2.5 Qwen 72B | 32K / 146.1 GB | 383 | 10 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐