LLM EXPLORER
 LLM Explorer: A Curated Large Language Model Directory and Analytics
Dark Theme
  LLM  List    LLM Hosting    LLM Leaderboards    Blog    Newsfeed    Advertise

DeepSeek Coder V2 Lite Instruct FlashAttnPatch by BirdL

 »  All LLMs  »  BirdL  »  DeepSeek Coder V2 Lite Instruct FlashAttnPatch   URL Share it on

  12   
  Arxiv:2401.06066   Autotrain compatible   Codegen   Conversational   Custom code   Deepseek v2   Endpoints compatible   Instruct   Region:us   Safetensors   Sharded   Tensorflow

DeepSeek Coder V2 Lite Instruct FlashAttnPatch Benchmarks

LLME Score: 0.21215
nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").

DeepSeek Coder V2 Lite Instruct FlashAttnPatch Parameters and Internals

Model Type 
Mixture-of-Experts, Code Intelligence
Use Cases 
Areas:
Code Intelligence
Primary Use Cases:
Coding and mathematical reasoning tasks
Additional Notes 
DeepSeek-Coder-V2 expedites advancements in code-related tasks and supports a wider range of programming languages.
Supported Languages 
languages_supported (338 programming languages)
Training Details 
Data Volume:
6 trillion tokens
Methodology:
Continued pre-training from an intermediate checkpoint
Context Length:
128000
Model Architecture:
Mixture-of-Experts (MoE)
Input Output 
Accepted Modalities:
Text
Output Format:
Text
LLM NameDeepSeek Coder V2 Lite Instruct FlashAttnPatch
Repository 🤗https://huggingface.co/BirdL/DeepSeek-Coder-V2-Lite-Instruct-FlashAttnPatch 
Model Size15.7b
Required VRAM31.4 GB
Updated2024-11-21
MaintainerBirdL
Model Typedeepseek_v2
Instruction-BasedYes
Model Files  8.6 GB: 1-of-4   8.6 GB: 2-of-4   8.6 GB: 3-of-4   5.6 GB: 4-of-4
Generates CodeYes
Model ArchitectureDeepseekV2ForCausalLM
Licenseother
Context Length163840
Model Max Length163840
Transformers Version4.39.3
Tokenizer ClassLlamaTokenizerFast
Beginning of Sentence Token<｜begin▁of▁sentence｜>
End of Sentence Token<｜end▁of▁sentence｜>
Vocabulary Size102400
Torch Data Typebfloat16
DeepSeek Coder V2 Lite Instruct FlashAttnPatch (BirdL/DeepSeek-Coder-V2-Lite-Instruct-FlashAttnPatch)

Best Alternatives to DeepSeek Coder V2 Lite Instruct FlashAttnPatch

Best Alternatives
Context / RAM
Downloads
Likes
...eepSeek Coder V2 Lite Instruct160K / 31.4 GB96884318
Note: green Score (e.g. "73.2") means that the model is better than BirdL/DeepSeek-Coder-V2-Lite-Instruct-FlashAttnPatch.

Rank the DeepSeek Coder V2 Lite Instruct FlashAttnPatch Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 38149 in total.

Email us: info@extractum.io. Our Privacy Policy  | Terms and Conditions  | Suggest an improvement.
Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241110
  Support LLM Explorer