Dictalm2.0 AWQ by dicta-il

 ยป  All LLMs  ยป  dicta-il  ยป  Dictalm2.0 AWQ   URL Share it on

  Arxiv:2407.07080   4-bit   Autotrain compatible   Awq   En   He   Mistral   Pretrained   Quantized   Region:us   Safetensors
Model Card on HF ๐Ÿค—: https://huggingface.co/dicta-il/dictalm2.0-AWQ 

Dictalm2.0 AWQ Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Dictalm2.0 AWQ (dicta-il/dictalm2.0-AWQ)

Dictalm2.0 AWQ Parameters and Internals

Model Type 
text-generation
Use Cases 
Limitations:
Does not have any moderation mechanisms.
Additional Notes 
DictaLM 2.0 is specialized in Hebrew text processing.
Supported Languages 
en (Yes), he (Yes)
Training Details 
Data Sources:
naturally occurring text
Data Volume:
over 190B tokens
LLM NameDictalm2.0 AWQ
Repository ๐Ÿค—https://huggingface.co/dicta-il/dictalm2.0-AWQ 
Model Size1.2b
Required VRAM4.2 GB
Updated2025-02-14
Maintainerdicta-il
Model Typemistral
Model Files  4.2 GB
Supported Languagesen he
AWQ QuantizationYes
Quantization Typeawq
Model ArchitectureMistralForCausalLM
Licenseapache-2.0
Context Length32768
Model Max Length32768
Transformers Version4.38.2
Tokenizer ClassLlamaTokenizer
Vocabulary Size33152
Torch Data Typefloat16

Best Alternatives to Dictalm2.0 AWQ

Best Alternatives
Context / RAM
Downloads
Likes
Ryze AWQ 4bit32K / 4.2 GB840
Feedback Wizard 4bit AWQ32K / 4.2 GB310
Quantized Kheopss AWQ 4bits V132K / 4.2 GB170
...lot Engine Step Json Short AWQ32K / 4.2 GB810
...V3 Plot Chat Roleplay Chat AWQ32K / 4.2 GB810
MistralLite AWQ32K / 4.2 GB203
Dictalm2.0 Instruct AWQ32K / 4.2 GB1820
LemonadeRP 4.5.3 AWQ32K / 4.2 GB820
Functionary Small V2.4 AWQ32K / 4.2 GB641
SFR Embedding Mistral AWQ32K / 4.2 GB160
Note: green Score (e.g. "73.2") means that the model is better than dicta-il/dictalm2.0-AWQ.

Rank the Dictalm2.0 AWQ Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 43106 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227