Model Type |
| ||||||||||||
Additional Notes |
| ||||||||||||
Training Details |
|
LLM Name | Etheria 55B V0.1 3.5bpw H6 EXL2 |
Repository ๐ค | https://huggingface.co/LoneStriker/Etheria-55b-v0.1-3.5bpw-h6-exl2 |
Merged Model | Yes |
Model Size | 55b |
Required VRAM | 25.3 GB |
Updated | 2025-02-22 |
Maintainer | LoneStriker |
Model Type | llama |
Model Files | |
Quantization Type | exl2 |
Model Architecture | LlamaForCausalLM |
Context Length | 200000 |
Model Max Length | 200000 |
Transformers Version | 4.37.1 |
Tokenizer Class | LlamaTokenizer |
Padding Token | <unk> |
Vocabulary Size | 64002 |
Torch Data Type | bfloat16 |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
---|---|---|---|
...theria 55B V0.1 3.0bpw H6 EXL2 | 195K / 21.9 GB | 4 | 2 |
Etheria 55B V0.1 | 195K / 111.2 GB | 61 | 9 |
Etheria 55B V0.1 | 195K / 111.2 GB | 20 | 10 |
Etheria 55B V0.1 GPTQ | 195K / 29.2 GB | 26 | 4 |
Etheria 55B V0.1 AWQ | 195K / 30.2 GB | 14 | 1 |
SG Raccoon Yi 55B 200K 2.0 | 195K / 111.3 GB | 32 | 6 |
SG Raccoon Yi 55B 200K | 195K / 111.4 GB | 53 | 4 |
SG Raccoon Yi 55B | 4K / 111.2 GB | 56 | 6 |
SG Raccoon Yi 55B GPTQ | 4K / 29.2 GB | 28 | 1 |
SG Raccoon Yi 55B AWQ | 4K / 30.2 GB | 11 | 2 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐