LLM Name | Mistral Small 24B Instruct 2501 Unsloth Bnb 4bit |
Repository ๐ค | https://huggingface.co/unsloth/Mistral-Small-24B-Instruct-2501-unsloth-bnb-4bit |
Base Model(s) | |
Model Size | 24b |
Required VRAM | 15 GB |
Updated | 2025-02-09 |
Maintainer | unsloth |
Model Type | mistral |
Instruction-Based | Yes |
Model Files | |
Supported Languages | en |
Quantization Type | 4bit |
Model Architecture | MistralForCausalLM |
License | apache-2.0 |
Context Length | 32768 |
Model Max Length | 32768 |
Transformers Version | 4.48.2 |
Tokenizer Class | LlamaTokenizer |
Padding Token | <pad> |
Vocabulary Size | 131072 |
Torch Data Type | bfloat16 |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
---|---|---|---|
Not So Small Alpaca 24B | 32K / 47.3 GB | 19 | 0 |
...all3 24B InstructContinuedFine | 32K / 47.3 GB | 1008 | 0 |
...ral Nemo Instruct 24B Merge V1 | 1000K / 24.6 GB | 9 | 0 |
...l Small 24B Instruct 2501 Bf16 | 32K / 46.9 GB | 124 | 2 |
...l Small 24B Instruct 2501 GGUF | 32K / 8.9 GB | 11365 | 17 |
SCE 2 24B | 32K / 47.3 GB | 27 | 0 |
SCE 3 24B | 32K / 47.3 GB | 30 | 0 |
MS 24B Instruct Mullein V0 | 32K / 47.3 GB | 548 | 10 |
...istral Small 24B Instruct 2501 | 32K / 47.3 GB | 1894 | 2 |
Mistral Small 24B Base 2501 | 32K / 47.3 GB | 594 | 2 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐