LLM Name | AshhLimaRP Mistral 7B |
Repository | Open on ๐ค |
Model Size | 7b |
Required VRAM | 14.4 GB |
Updated | 2024-07-27 |
Maintainer | lemonilia |
Model Files | |
GGUF Quantization | Yes |
Quantization Type | gguf |
Model Architecture | AutoModelForCausalLM |
License | apache-2.0 |
Is Biased | none |
Tokenizer Class | LlamaTokenizer |
PEFT Type | LORA |
LoRA Model | Yes |
PEFT Target Modules | k_proj|gate_proj|v_proj|q_proj|o_proj|up_proj|down_proj |
LoRA Alpha | 16 |
LoRA Dropout | 0 |
R Param | 256 |
Model |
Likes |
Downloads |
VRAM |
---|---|---|---|
AshhLimaRP Mistral 7B GGUF | 2 | 153 | 3 GB |
AshhLimaRP Mistral 7B GPTQ | 3 | 11 | 4 GB |
AshhLimaRP Mistral 7B AWQ | 2 | 7 | 4 GB |
Best Alternatives |
HF Rank |
Context/RAM |
Downloads |
Likes |
---|---|---|---|---|
...rendyol 7B Base V1 MtLoRA Entr | 0.3 | 0K / 14.6 GB | 93 | 0 |
Mistral Llm V4 | 0.2 | 0K / 14.4 GB | 13 | 0 |
Mistral 7B V0.1 Hitl | 0.2 | 0K / 14.4 GB | 10 | 0 |
Gemma 7B English To Hinglish | 0.2 | 0K / 17.1 GB | 72 | 0 |
...rix Philosophy Mistral 7B LoRA | 0.2 | 0K / 14.4 GB | 371 | 2 |
Gumzo Llama 00 | 0.2 | 0K / 0.3 GB | 42 | 0 |
Legal Summarizer | 0.2 | 0K / 14.4 GB | 35 | 0 |
Medilora Mistral 7B | 0.2 | 0K / 14.4 GB | 130 | 4 |
EvolCodeLlama 7B | 0.2 | 0K / 13.5 GB | 10 | 0 |
...B V0.3 Chinese Chat Uncensored | 0.3 | 0K / 14.5 GB | 4782 | 0 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐