Additional Notes |
| |
Supported Languages |
|
LLM Name | C4ai Command R 08 2024 8bit |
Repository ๐ค | https://huggingface.co/mlx-community/c4ai-command-r-08-2024-8bit |
Model Size | 9.1b |
Required VRAM | 34.2 GB |
Updated | 2025-02-05 |
Maintainer | mlx-community |
Model Type | cohere |
Model Files | |
Supported Languages | en fr de es it pt ja ko zh ar |
Quantization Type | 8bit |
Model Architecture | CohereForCausalLM |
License | cc-by-nc-4.0 |
Context Length | 131072 |
Model Max Length | 131072 |
Transformers Version | 4.44.0 |
Tokenizer Class | CohereTokenizer |
Padding Token | <PAD> |
Vocabulary Size | 256000 |
Torch Data Type | float16 |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
---|---|---|---|
Xerxes Pro | 8K / 18.1 GB | 54 | 0 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐