LLM Name | Spydaz Web AI 026 4bit |
Repository ๐ค | https://huggingface.co/LeroyDyer/_Spydaz_Web_AI_026_4bit |
Base Model(s) | |
Model Size | 3.9b |
Required VRAM | 4.2 GB |
Updated | 2024-08-02 |
Maintainer | LeroyDyer |
Model Type | mistral |
Model Files | |
Supported Languages | en |
Quantization Type | 4bit |
Model Architecture | MistralForCausalLM |
License | apache-2.0 |
Context Length | 32768 |
Model Max Length | 32768 |
Transformers Version | 4.43.0.dev0 |
Tokenizer Class | LlamaTokenizer |
Padding Token | <unk> |
Vocabulary Size | 32002 |
Torch Data Type | bfloat16 |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
---|---|---|---|
...cr To Json V1 Bnb 4bit Smashed | 32K / 4.5 GB | 16 | 0 |
Mixtral AI SwahiliTron 4BIT | 32K / 4.1 GB | 5 | 0 |
Mcqa 4bit | 32K / 4.1 GB | 5 | 0 |
Mistral 4bit Bnb | 32K / 4.1 GB | 5 | 0 |
Yugo55 GPT V4 4bit | 32K / 4.1 GB | 424 | 1 |
Rezephyr Merged 4bit | 32K / 4.1 GB | 60 | 0 |
Zephyr DPO 4bit | 32K / 4.1 GB | 62 | 0 |
...Spydaz Web AI ChatQA 002 4 BIT | 512K / 4.1 GB | 50 | 0 |
...ydaz Web AI ChatQA 002r1 4 BIT | 512K / 4.1 GB | 46 | 0 |
Spydaz Web AI 02 4 BIT | 32K / 4.1 GB | 28 | 0 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐