LLM Name | Mistral 7B Instruct V0.2 |
Repository ๐ค | https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2 |
Model Size | 7b |
Required VRAM | 14.4 GB |
Updated | 2024-11-21 |
Maintainer | mistralai |
Model Type | mistral |
Instruction-Based | Yes |
Model Files | |
Gated Model | Yes |
Model Architecture | MistralForCausalLM |
License | proprietary |
Context Length | 32768 |
Model Max Length | 32768 |
Transformers Version | 4.36.0 |
Tokenizer Class | LlamaTokenizer |
Vocabulary Size | 32000 |
Torch Data Type | bfloat16 |
Model |
Likes |
Downloads |
VRAM |
---|---|---|---|
Mistral 7B Instruct V0.2 GGUF | 398 | 138341 | 3 GB |
Mistral 7B Instruct V0.2 GPTQ | 50 | 460322 | 4 GB |
Mistral 7B Instruct V0.2 AWQ | 41 | 91719 | 4 GB |
...ral 7B Instruct V0.2 Llamafile | 26 | 10791 | 14 GB |
...Instruct V0.2 AWQ 4bit Smashed | 1 | 11 | 4 GB |
Mimi Chatbot 0.2 | 0 | 5 | 4 GB |
Mistral 7B Instruct V0.2 GGUF | 0 | 15 | 3 GB |
...Instruct V0.2 Bnb 4bit Smashed | 1 | 37 | 4 GB |
Rubra 11B H 5.0bpw EXL2 | 1 | 10 | 1 GB |
Mistral 7B Instruct V0.2 GGUF | 0 | 205 | 3 GB |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
---|---|---|---|
...Nemo Instruct 2407 Abliterated | 1000K / 24.5 GB | 2514 | 8 |
SpydazWeb AI HumanAI RP | 512K / 14.4 GB | 97 | 1 |
SpydazWeb AI HumanAI 002 | 512K / 14.4 GB | 17 | 1 |
...daz Web AI ChatML 512K Project | 512K / 14.5 GB | 12 | 0 |
... Summarize 64K QLoRANET Merged | 128K / 4.1 GB | 7 | 0 |
...1 Summarize 64K LoRANET Merged | 128K / 14.4 GB | 6 | 0 |
Mistral 7B Instruct V0.1 | 32K / 14.4 GB | 181963 | 1528 |
...ity Instruct 7M Gen Mistral 7B | 32K / 14.4 GB | 4925 | 3 |
...ty Instruct 3M 0625 Mistral 7B | 32K / 14.4 GB | 4856 | 3 |
...ty Instruct 3M 0613 Mistral 7B | 32K / 14.4 GB | 7031 | 11 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐