LLM Name | DeepSeek Coder V2 Lite Instruct |
Repository 🤗 | https://huggingface.co/deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct |
Model Size | 15.7b |
Required VRAM | 31.4 GB |
Updated | 2024-09-08 |
Maintainer | deepseek-ai |
Model Type | deepseek_v2 |
Instruction-Based | Yes |
Model Files | |
Generates Code | Yes |
Model Architecture | DeepseekV2ForCausalLM |
License | other |
Context Length | 163840 |
Model Max Length | 163840 |
Transformers Version | 4.39.3 |
Tokenizer Class | LlamaTokenizerFast |
Beginning of Sentence Token | <|begin▁of▁sentence|> |
End of Sentence Token | <|end▁of▁sentence|> |
Vocabulary Size | 102400 |
Torch Data Type | bfloat16 |
Model |
Likes |
Downloads |
VRAM |
---|---|---|---|
...ek Coder V2 Lite Instruct GGUF | 4 | 5499 | 6 GB |
...ek Coder V2 Lite Instruct GGUF | 1 | 250 | 6 GB |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
---|---|---|---|
...2 Lite Instruct FlashAttnPatch | 160K / 31.4 GB | 5 | 0 |
🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟