LLM Name | DeepSeek R1 GGUF |
Repository ๐ค | https://huggingface.co/unsloth/DeepSeek-R1-GGUF |
Base Model(s) | |
Updated | 2025-03-13 |
Maintainer | unsloth |
Model Type | deepseek_v3 |
Supported Languages | en |
GGUF Quantization | Yes |
Quantization Type | gguf |
Model Architecture | DeepseekV3ForCausalLM |
License | mit |
Context Length | 163840 |
Model Max Length | 163840 |
Transformers Version | 4.48.1 |
Vocabulary Size | 129280 |
Torch Data Type | bfloat16 |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
---|---|---|---|
R1 1776 GGUF | 160K / GB | 35997 | 94 |
DeepSeek V3 AWQ | 160K / 351.9 GB | 7357 | 30 |
DeepSeek R1 FP4 | 160K / 226.6 GB | 8046 | 208 |
DeepSeek R1 AWQ | 160K / 225 GB | 44326 | 70 |
R1 1776 | 160K / 243.4 GB | 3918 | 5 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐