LLM Name | TinyMistral 248M 8bits |
Repository ๐ค | https://huggingface.co/mlx-community/TinyMistral-248M-8bits |
Model Size | 248m |
Required VRAM | 0.3 GB |
Updated | 2024-09-07 |
Maintainer | mlx-community |
Model Type | mistral |
Model Files | |
Supported Languages | en |
Model Architecture | MistralForCausalLM |
License | apache-2.0 |
Context Length | 32768 |
Model Max Length | 32768 |
Transformers Version | 4.35.0 |
Tokenizer Class | LlamaTokenizer |
Padding Token | [PAD] |
Vocabulary Size | 32005 |
Torch Data Type | float16 |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
---|---|---|---|
TinyMistral 248M V2 | 32K / 1 GB | 1343 | 15 |
TinyMistral 248M V2.5 | 32K / 1 GB | 166 | 25 |
TinyMistral 248M V2.5 Instruct | 32K / 1 GB | 12 | 10 |
...al V2.5 MiniPile Guidelines E1 | 32K / 0.6 GB | 5 | 2 |
TinyMistral V2 Test1 | 32K / 1 GB | 4 | 1 |
Tinymistv1 | 32K / 0.5 GB | 17 | 0 |
TinyMistral 248M Instruct | 32K / 1 GB | 59 | 11 |
TinyMistral Haiku | 32K / 1 GB | 6 | 0 |
TinyMistral 248M | 32K / 1 GB | 6475 | 39 |
...istral 248M V2.5 Instruct Orpo | 32K / 0.5 GB | 5 | 0 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐