Model Type |
| |||
Additional Notes |
| |||
Input Output |
|
LLM Name | Merlyn Education Safety GPTQ |
Repository ๐ค | https://huggingface.co/TheBloke/merlyn-education-safety-GPTQ |
Model Name | Merlyn Education Safety 12B |
Model Creator | Merlyn Mind |
Base Model(s) | |
Model Size | 12b |
Required VRAM | 6.9 GB |
Updated | 2025-02-22 |
Maintainer | TheBloke |
Model Type | gpt_neox |
Model Files | |
GPTQ Quantization | Yes |
Quantization Type | gptq |
Model Architecture | GPTNeoXForCausalLM |
License | apache-2.0 |
Context Length | 2048 |
Model Max Length | 2048 |
Transformers Version | 4.35.0 |
Tokenizer Class | GPTNeoXTokenizer |
Vocabulary Size | 50688 |
Torch Data Type | float16 |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
---|---|---|---|
... Int3 Step71000 GPTQ Wikitext2 | 2K / 5.5 GB | 76 | 0 |
...Int4 Step107000 GPTQ Wikitext2 | 2K / 6.9 GB | 76 | 0 |
... Int4 Step36000 GPTQ Wikitext2 | 2K / 6.9 GB | 76 | 0 |
Dolly V2 12B Sharded 8bit | 2K / 12.4 GB | 19 | 4 |
...sst Sft 4 Pythia 12B Epoch 3.5 | 2K / 23.8 GB | 426081 | 364 |
Dolly V2 12B | 2K / 23.8 GB | 6765 | 1953 |
Pythia 12B | 2K / 23.8 GB | 14160 | 135 |
Oasst Sft 1 Pythia 12B | 2K / 23.8 GB | 5010 | 278 |
Pythia 12B Deduped | 2K / 23.8 GB | 9925 | 51 |
Pythia 12B Sft V8 7K Steps | 2K / 23.8 GB | 2142 | 21 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐