Model Type |
|
LLM Name | Mistral 7B Instruct V0.2 |
Repository ๐ค | https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2 |
Model Size | 7b |
Required VRAM | 14.4 GB |
Updated | 2024-12-21 |
Maintainer | mistralai |
Model Type | mistral |
Instruction-Based | Yes |
Model Files | |
Gated Model | Yes |
Model Architecture | MistralForCausalLM |
License | proprietary |
Context Length | 32768 |
Model Max Length | 32768 |
Transformers Version | 4.36.0 |
Tokenizer Class | LlamaTokenizer |
Vocabulary Size | 32000 |
Torch Data Type | bfloat16 |
Model |
Likes |
Downloads |
VRAM |
---|---|---|---|
Mistral 7B Instruct V0.2 GGUF | 407 | 131566 | 3 GB |
ShoriRP V0.75d | 32 | 49 | 0 GB |
Mistral 7B Instruct V0.2 GPTQ | 50 | 589654 | 4 GB |
Mistral 7B Instruct V0.2 AWQ | 41 | 99357 | 4 GB |
...ral 7B Instruct V0.2 Llamafile | 26 | 5888 | 14 GB |
...Instruct V0.2 AWQ 4bit Smashed | 1 | 11 | 4 GB |
Mimi Chatbot 0.2 | 0 | 7 | 4 GB |
Mistral 7B Instruct V0.2 GGUF | 0 | 34 | 3 GB |
Rubra 11B H 5.0bpw EXL2 | 1 | 18 | 1 GB |
...Instruct V0.2 Bnb 4bit Smashed | 1 | 24 | 4 GB |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
---|---|---|---|
...Nemo Instruct 2407 Abliterated | 1000K / 24.5 GB | 2699 | 9 |
SpydazWeb AI HumanAI RP | 512K / 14.4 GB | 33 | 1 |
SpydazWeb AI HumanAI 002 | 512K / 14.4 GB | 20 | 1 |
...daz Web AI ChatML 512K Project | 512K / 14.5 GB | 12 | 0 |
... Summarize 64K QLoRANET Merged | 128K / 4.1 GB | 8 | 0 |
...1 Summarize 64K LoRANET Merged | 128K / 14.4 GB | 6 | 0 |
Mistral 7B Instruct V0.1 | 32K / 14.4 GB | 3023756 | 1538 |
...ity Instruct 7M Gen Mistral 7B | 32K / 14.4 GB | 5417 | 4 |
...ty Instruct 3M 0625 Mistral 7B | 32K / 14.4 GB | 5434 | 3 |
...ty Instruct 3M 0613 Mistral 7B | 32K / 14.4 GB | 7821 | 11 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐