LLM Name | Spydaz Web AI ChatQA 002 4 BIT |
Repository ๐ค | https://huggingface.co/LeroyDyer/_Spydaz_Web_AI_ChatQA_002_4_BIT |
Base Model(s) | |
Model Size | 3.9b |
Required VRAM | 4.1 GB |
Updated | 2024-09-29 |
Maintainer | LeroyDyer |
Model Type | mistral |
Instruction-Based | Yes |
Model Files | |
Supported Languages | en sw ig so es ca xh zu ha tw af hi bm su |
Model Architecture | MistralForCausalLM |
Context Length | 524288 |
Model Max Length | 524288 |
Transformers Version | 4.44.2 |
Tokenizer Class | LlamaTokenizer |
Padding Token | <unk> |
Vocabulary Size | 32000 |
Torch Data Type | float16 |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
---|---|---|---|
Spydaz Web AI 02 4 BIT | 32K / 4.1 GB | 28 | 0 |
...pydaz Web AI ChatQA BASE 4 BIT | 32K / 4.1 GB | 18 | 0 |
Mistral MoE Lora | 32K / 4.1 GB | 16 | 1 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐