LLM Name | OPT 6.7B Nerybus Mix |
Repository ๐ค | https://huggingface.co/KoboldAI/OPT-6.7B-Nerybus-Mix |
Model Size | 6.7b |
Required VRAM | 13.7 GB |
Updated | 2024-09-07 |
Maintainer | KoboldAI |
Model Type | opt |
Model Files | |
Supported Languages | en |
Model Architecture | OPTForCausalLM |
License | other |
Context Length | 2048 |
Model Max Length | 2048 |
Transformers Version | 4.24.0 |
Tokenizer Class | GPT2Tokenizer |
Beginning of Sentence Token | </s> |
End of Sentence Token | </s> |
Unk Token | </s> |
Vocabulary Size | 50265 |
Torch Data Type | float16 |
Activation Function | relu |
Errors | replace |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
---|---|---|---|
....7B Qcqa Ub 16 Best For Q Loss | 2K / 27.4 GB | 58 | 0 |
...B Qcqa Ub 16 Best For KV Cache | 2K / 27.4 GB | 61 | 0 |
...7B Gqa Ub 16 Best For KV Cache | 2K / 27.4 GB | 60 | 0 |
Galactica 6.7B ReFT GSM8k | 2K / 13.8 GB | 61 | 0 |
Galactica 6.7B EssayWriter | 2K / 13.4 GB | 700 | 3 |
Opt Flan Iml 6.7B | 2K / 26.6 GB | 711 | 1 |
...lactica 6.7B Evol Instruct 70K | 2K / 27.4 GB | 673 | 19 |
Galactica 6.7B Finetuned | 2K / 27.4 GB | 684 | 34 |
Opt 6.7B | 2K / 13.4 GB | 106416 | 104 |
OPI Full Galactica 6.7B | 2K / 27.3 GB | 11 | 4 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐