LLM Name | Vegan Mayo |
Repository ๐ค | https://huggingface.co/nroggendorff/vegan-mayo |
Model Size | 843.5m |
Required VRAM | 0.5 GB |
Updated | 2024-07-24 |
Maintainer | nroggendorff |
Model Type | gpt2 |
Model Files | |
Supported Languages | en |
Model Architecture | GPT2LMHeadModel |
License | mit |
Model Max Length | 1024 |
Transformers Version | 4.39.3 |
Is Biased | none |
Tokenizer Class | GPT2Tokenizer |
Padding Token | <|endoftext|> |
Vocabulary Size | 50257 |
PEFT Type | LORA |
PEFT Target Modules | up_proj|lm_head|v_proj|o_proj|q_proj|k_proj|gate_proj|down_proj |
LoRA Alpha | 64 |
LoRA Dropout | 0.05 |
R Param | 32 |
Torch Data Type | float32 |
Activation Function | gelu_new |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐