LLM Name | Rmoe V1 |
Repository ๐ค | https://huggingface.co/ehristoforu/rmoe-v1 |
Model Size | 1.5b |
Required VRAM | 22.1 GB |
Updated | 2025-02-16 |
Maintainer | ehristoforu |
Model Type | qwen2_moe |
Instruction-Based | Yes |
Model Files | |
Model Architecture | Qwen2MoeForCausalLM |
License | mit |
Context Length | 32768 |
Model Max Length | 32768 |
Transformers Version | 4.48.1 |
Tokenizer Class | Qwen2Tokenizer |
Padding Token | <|im_end|> |
Vocabulary Size | 151936 |
Torch Data Type | float16 |
Errors | replace |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐