LLM Name | Q4 Llama 3 |
Repository ๐ค | https://huggingface.co/piyushsalunke/q4-llama-3 |
Model Size | 4.6b |
Required VRAM | 6.1 GB |
Updated | 2024-09-06 |
Maintainer | piyushsalunke |
Model Type | llama |
Model Files | |
Quantization Type | q4 |
Model Architecture | LlamaForCausalLM |
Context Length | 8192 |
Model Max Length | 8192 |
Transformers Version | 4.41.2 |
Tokenizer Class | PreTrainedTokenizerFast |
Vocabulary Size | 128256 |
LoRA Model | Yes |
Torch Data Type | float16 |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
---|---|---|---|
BNB 4Bit Llama3 Finetune | 8K / 6.1 GB | 5 | 0 |
Llama3 Finetune 4bit | 8K / 6.1 GB | 0 | 0 |
SimpleLlamaSentences | 2K / 0 GB | 5 | 0 |
TinyLLama V0 | 2K / 0 GB | 205367 | 25 |
UniversalNER TinyLLama | 2K / 0 GB | 8 | 1 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐