LLM Name | Test Model2 |
Repository ๐ค | https://huggingface.co/lee0901/test_model2 |
Model Size | 3.2b |
Required VRAM | 0.1 GB |
Updated | 2024-09-01 |
Maintainer | lee0901 |
Model Files | |
Model Architecture | AutoModelForCausalLM |
Is Biased | none |
Tokenizer Class | PreTrainedTokenizerFast |
Padding Token | <|endoftext|> |
PEFT Type | LORA |
LoRA Model | Yes |
PEFT Target Modules | query_key_value |
LoRA Alpha | 512 |
LoRA Dropout | 0.1 |
R Param | 64 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐