LLM Name | LemonadeRP 4.5.3 AWQ |
Repository ๐ค | https://huggingface.co/solidrust/LemonadeRP-4.5.3-AWQ |
Base Model(s) | |
Model Size | 1.2b |
Required VRAM | 4.2 GB |
Updated | 2024-09-20 |
Maintainer | solidrust |
Model Type | mistral |
Model Files | |
Supported Languages | en |
AWQ Quantization | Yes |
Quantization Type | awq |
Model Architecture | MistralForCausalLM |
License | cc-by-4.0 |
Context Length | 32768 |
Model Max Length | 32768 |
Transformers Version | 4.38.2 |
Tokenizer Class | LlamaTokenizer |
Vocabulary Size | 32000 |
Torch Data Type | float16 |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
---|---|---|---|
MistralLite AWQ | 32K / 4.2 GB | 372 | 3 |
Quantized Kheopss AWQ 4bits V1 | 32K / 4.2 GB | 17 | 0 |
Feedback Wizard 4bit AWQ | 32K / 4.2 GB | 5 | 0 |
Ryze AWQ 4bit | 32K / 4.2 GB | 5 | 0 |
...lot Engine Step Json Short AWQ | 32K / 4.2 GB | 6 | 0 |
...V3 Plot Chat Roleplay Chat AWQ | 32K / 4.2 GB | 5 | 0 |
SFR Embedding Mistral AWQ | 32K / 4.2 GB | 6 | 0 |
Dictalm2.0 AWQ | 32K / 4.2 GB | 33 | 0 |
Dictalm2.0 Instruct AWQ | 32K / 4.2 GB | 19 | 0 |
Yugo55A GPT AWQ | 32K / 4.2 GB | 6 | 0 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐