🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟
Best Alternatives |
HF Rank |
Context/RAM |
Downloads |
Likes |
---|---|---|---|---|
...pseek Coder 1.3B Instruct GPTQ | — | 16K / 0.9 GB | 97 | 6 |
...seek Coder 1.3B Instruct 4bits | — | 16K / 0.9 GB | 9 | 0 |
... 1.3B Instruct Trt Int4 G64 Hf | — | 16K / 0.9 GB | 5 | 0 |
Deepseek Coder 1.3B Instruct | — | 16K / 2.7 GB | 16352 | 86 |
Datascience Coder 1.3B | — | 16K / 2.7 GB | 1 | 1 |
Speechless Coder Ds 1.3B | — | 16K / 2.7 GB | 1264 | 0 |
...t Structured Output Peft Merge | — | 16K / 2.7 GB | 6 | 0 |
...Coder 1.3B Function Calling V1 | — | 16K / 2.7 GB | 136 | 1 |
LLM Name | Deepseek Coder 1.3B Instruct AWQ |
Repository | Open on 🤗 |
Model Name | Deepseek Coder 1.3B Instruct |
Model Creator | DeepSeek |
Base Model(s) | |
Model Size | 1.3b |
Required VRAM | 0.9 GB |
Updated | 2024-07-05 |
Maintainer | TheBloke |
Model Type | deepseek |
Instruction-Based | Yes |
Model Files | |
AWQ Quantization | Yes |
Quantization Type | awq |
Generates Code | Yes |
Model Architecture | LlamaForCausalLM |
License | other |
Context Length | 8192 |
Model Max Length | 8192 |
Transformers Version | 4.35.0 |
Tokenizer Class | LlamaTokenizerFast |
Beginning of Sentence Token | <|begin▁of▁sentence|> |
End of Sentence Token | <|EOT|> |
Vocabulary Size | 32256 |
Initializer Range | 0.02 |
Torch Data Type | float16 |