LLM Name | C4ai Command R 08 2024 4bit |
Repository ๐ค | https://huggingface.co/mlx-community/c4ai-command-r-08-2024-4bit |
Model Size | 5b |
Required VRAM | 18.1 GB |
Updated | 2025-01-24 |
Maintainer | mlx-community |
Model Type | cohere |
Model Files | |
Supported Languages | en fr de es it pt ja ko zh ar |
Quantization Type | 4bit |
Model Architecture | CohereForCausalLM |
License | cc-by-nc-4.0 |
Context Length | 131072 |
Model Max Length | 131072 |
Transformers Version | 4.44.0 |
Tokenizer Class | CohereTokenizer |
Padding Token | <PAD> |
Vocabulary Size | 256000 |
Torch Data Type | float16 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐