Model Type |
| |
Additional Notes |
| |
Supported Languages |
|
LLM Name | Opt 6.7B GPTQ 4bit G128 |
Repository ๐ค | https://huggingface.co/iproskurina/opt-6.7b-GPTQ-4bit-g128 |
Model Name | opt-6.7b |
Model Creator | |
Base Model(s) | |
Model Size | 6.7b |
Required VRAM | 4.2 GB |
Updated | 2024-12-22 |
Maintainer | iproskurina |
Model Type | opt |
Model Files | |
Supported Languages | en |
GPTQ Quantization | Yes |
Quantization Type | gptq|4bit |
Model Architecture | OPTForCausalLM |
License | other |
Context Length | 2048 |
Model Max Length | 2048 |
Transformers Version | 4.44.2 |
Tokenizer Class | GPT2Tokenizer |
Padding Token | <pad> |
Vocabulary Size | 50272 |
Torch Data Type | float16 |
Activation Function | relu |
Errors | replace |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
---|---|---|---|
Opt 6.7B Gptq 4bit | 2K / 4.2 GB | 90 | 0 |
....7B Qcqa Ub 16 Best For Q Loss | 2K / 27.4 GB | 74 | 0 |
...B Qcqa Ub 16 Best For KV Cache | 2K / 27.4 GB | 75 | 0 |
...7B Gqa Ub 16 Best For KV Cache | 2K / 27.4 GB | 71 | 0 |
Galactica 6.7B ReFT GSM8k | 2K / 13.8 GB | 76 | 0 |
Galactica 6.7B EssayWriter | 2K / 13.4 GB | 1156 | 3 |
Opt Flan Iml 6.7B | 2K / 26.6 GB | 1249 | 1 |
...lactica 6.7B Evol Instruct 70K | 2K / 27.4 GB | 1244 | 19 |
OPT 6.7B Nerybus Mix | 2K / 13.7 GB | 1556 | 20 |
Galactica 6.7B Finetuned | 2K / 27.4 GB | 1223 | 34 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐