LLM Name | Seraph Openchat 3.5 1210 Slerp GPTQ |
Repository 🤗 | https://huggingface.co/TheBloke/Seraph-openchat-3.5-1210-Slerp-GPTQ |
Model Name | Seraph OpenChat 3.5 1210 SLERP |
Model Creator | Yağız Çalık |
Base Model(s) | |
Model Size | 1.2b |
Required VRAM | 4.2 GB |
Updated | 2024-09-16 |
Maintainer | TheBloke |
Model Type | mistral |
Model Files | |
GPTQ Quantization | Yes |
Quantization Type | gptq |
Model Architecture | MistralForCausalLM |
License | apache-2.0 |
Context Length | 32768 |
Model Max Length | 32768 |
Transformers Version | 4.37.0.dev0 |
Tokenizer Class | LlamaTokenizer |
Vocabulary Size | 32002 |
Torch Data Type | bfloat16 |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
---|---|---|---|
... Finetune 16bit Ver9 Main GPTQ | 32K / 4.2 GB | 5 | 0 |
Dictalm2.0 Instruct GPTQ | 32K / 4.2 GB | 47 | 0 |
Multi Verse Model GPTQ | 32K / 4.2 GB | 60 | 1 |
Dictalm2.0 GPTQ | 32K / 4.2 GB | 38 | 0 |
Turdus GPTQ | 32K / 4.2 GB | 24 | 5 |
Em German Leo Mistral GPTQ | 32K / 4.2 GB | 1818 | 11 |
Garrulus GPTQ | 32K / 4.2 GB | 7 | 3 |
HamSter 0.1 GPTQ | 32K / 4.2 GB | 7 | 2 |
Phoenix GPTQ | 32K / 4.2 GB | 5 | 1 |
Mistral Ft Optimized 1227 GPTQ | 32K / 4.2 GB | 6 | 2 |
🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟