LLM Name | Spydaz Web AI ChatQA 001 4 BIT |
Repository ๐ค | https://huggingface.co/LeroyDyer/_Spydaz_Web_AI_ChatQA_001_4_BIT |
Base Model(s) | |
Model Size | 3.9b |
Required VRAM | 4.1 GB |
Updated | 2024-08-30 |
Maintainer | LeroyDyer |
Model Type | mistral |
Model Files | |
Supported Languages | en |
Model Architecture | MistralForCausalLM |
License | apache-2.0 |
Context Length | 32768 |
Model Max Length | 32768 |
Transformers Version | 4.44.0 |
Tokenizer Class | LlamaTokenizer |
Padding Token | <unk> |
Vocabulary Size | 32000 |
Torch Data Type | bfloat16 |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
---|---|---|---|
...Spydaz Web AI ChatQA 003 4 BIT | 512K / 4.1 GB | 56 | 0 |
...Spydaz Web AI ChatQA 002 4 BIT | 512K / 4.1 GB | 51 | 0 |
...ydaz Web AI ChatQA 002r1 4 BIT | 512K / 4.1 GB | 47 | 0 |
Spydaz Web AI 02 4 BIT | 32K / 4.1 GB | 28 | 0 |
Spydaz Web AI 06 4 BIT | 32K / 4.1 GB | 10 | 0 |
Spydaz Web AI 03 4 BIT | 32K / 4.1 GB | 12 | 0 |
...pydaz Web AI ChatQA BASE 4 BIT | 32K / 4.1 GB | 18 | 0 |
Spydaz Web AI ChatQA 05 4 BIT | 32K / 4.1 GB | 10 | 0 |
Finchat298 Mistral7B FT 650 | 32K / 4.1 GB | 5 | 0 |
Finchat298 Mistral7B FT3 | 32K / 4.1 GB | 6 | 0 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐