Model Type |
| ||||||
Use Cases |
| ||||||
Additional Notes |
| ||||||
Supported Languages |
| ||||||
Training Details |
|
LLM Name | Dictalm2.0 AWQ |
Repository ๐ค | https://huggingface.co/dicta-il/dictalm2.0-AWQ |
Model Size | 1.2b |
Required VRAM | 4.2 GB |
Updated | 2025-02-14 |
Maintainer | dicta-il |
Model Type | mistral |
Model Files | |
Supported Languages | en he |
AWQ Quantization | Yes |
Quantization Type | awq |
Model Architecture | MistralForCausalLM |
License | apache-2.0 |
Context Length | 32768 |
Model Max Length | 32768 |
Transformers Version | 4.38.2 |
Tokenizer Class | LlamaTokenizer |
Vocabulary Size | 33152 |
Torch Data Type | float16 |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
---|---|---|---|
Ryze AWQ 4bit | 32K / 4.2 GB | 84 | 0 |
Feedback Wizard 4bit AWQ | 32K / 4.2 GB | 31 | 0 |
Quantized Kheopss AWQ 4bits V1 | 32K / 4.2 GB | 17 | 0 |
...lot Engine Step Json Short AWQ | 32K / 4.2 GB | 81 | 0 |
...V3 Plot Chat Roleplay Chat AWQ | 32K / 4.2 GB | 81 | 0 |
MistralLite AWQ | 32K / 4.2 GB | 20 | 3 |
Dictalm2.0 Instruct AWQ | 32K / 4.2 GB | 182 | 0 |
LemonadeRP 4.5.3 AWQ | 32K / 4.2 GB | 82 | 0 |
Functionary Small V2.4 AWQ | 32K / 4.2 GB | 64 | 1 |
SFR Embedding Mistral AWQ | 32K / 4.2 GB | 16 | 0 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐