LLM Name | C4ai Command R Plus 4bit |
Repository ๐ค | https://huggingface.co/mlx-community/c4ai-command-r-plus-4bit |
Model Size | 18.9b |
Required VRAM | 62.8 GB |
Updated | 2024-09-14 |
Maintainer | mlx-community |
Model Type | cohere |
Model Files | |
Supported Languages | en fr de es it pt ja ko zh ar |
Quantization Type | 4bit |
Model Architecture | CohereForCausalLM |
License | cc-by-nc-4.0 |
Context Length | 8192 |
Model Max Length | 8192 |
Transformers Version | 4.39.3 |
Padding Token | <PAD> |
Vocabulary Size | 256000 |
Torch Data Type | float16 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐