LLM Name | SUS Chat 34B GPTQ |
Repository | Open on ๐ค |
Model Name | SUS Chat 34B |
Model Creator | Southern university of science and technology |
Base Model(s) | |
Model Size | 34b |
Required VRAM | 18.6 GB |
Updated | 2024-07-27 |
Maintainer | TheBloke |
Model Type | llama |
Model Files | |
GPTQ Quantization | Yes |
Quantization Type | gptq |
Model Architecture | LlamaForCausalLM |
License | other |
Context Length | 8192 |
Model Max Length | 8192 |
Transformers Version | 4.35.2 |
Tokenizer Class | LlamaTokenizer |
Padding Token | <unk> |
Vocabulary Size | 64000 |
Torch Data Type | bfloat16 |
Best Alternatives |
HF Rank |
Context/RAM |
Downloads |
Likes |
---|---|---|---|---|
Yi 34B 200K RPMerge GPTQ | 0.2 | 195K / 21.2 GB | 8 | 3 |
Smaug 34B V0.1 GPTQ | 0.2 | 195K / 21.2 GB | 7 | 1 |
Tess 34B V1.5B GPTQ | 0.2 | 195K / 18.6 GB | 13 | 7 |
...4B 200K DARE Megamerge V8 GPTQ | 0.2 | 195K / 18.6 GB | 14 | 3 |
Deepmoney 34B 200K Base GPTQ | 0.2 | 195K / 18.6 GB | 12 | 3 |
...y 34B 200K Chat Evaluator GPTQ | 0.2 | 195K / 18.6 GB | 8 | 3 |
...ous Capybara Limarpv3 34B GPTQ | 0.2 | 195K / 18.6 GB | 10 | 4 |
Bagel DPO 34B V0.2 GPTQ | 0.2 | 195K / 18.6 GB | 24 | 2 |
Bagel 34B V0.2 GPTQ | 0.2 | 195K / 18.6 GB | 11 | 2 |
Nontoxic Bagel 34B V0.2 GPTQ | 0.2 | 195K / 18.6 GB | 7 | 1 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐