LLM Name | Qlora Self Instruct 65B |
Repository ๐ค | https://huggingface.co/timdettmers/qlora-self-instruct-65b |
Model Size | 65b |
Required VRAM | 3.2 GB |
Updated | 2024-09-18 |
Maintainer | timdettmers |
Instruction-Based | Yes |
Model Files | |
Model Architecture | Adapter |
Is Biased | none |
PEFT Type | LORA |
LoRA Model | Yes |
PEFT Target Modules | gate_proj|down_proj|up_proj|q_proj|k_proj|v_proj|o_proj |
LoRA Alpha | 16 |
LoRA Dropout | 0.05 |
R Param | 64 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐