LLM Name | Trained Quant 4bit |
Repository ๐ค | https://huggingface.co/RyanJT/trained-quant-4bit |
Base Model(s) | |
Model Size | 3b |
Required VRAM | 0 GB |
Updated | 2024-08-15 |
Maintainer | RyanJT |
Instruction-Based | Yes |
Model Files | |
Quantization Type | 4bit |
Model Architecture | Adapter |
Model Max Length | 9223372036854775807 |
Is Biased | none |
Tokenizer Class | GPT2Tokenizer |
Padding Token | <|endoftext|> |
Vocabulary Size | 49152 |
PEFT Type | LORA |
LoRA Model | Yes |
PEFT Target Modules | q_proj|v_proj |
LoRA Alpha | 32 |
LoRA Dropout | 0.1 |
R Param | 8 |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
---|---|---|---|
Xenith 3B | 0K / 7.6 GB | 3 | 2 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐