LLM Name | Qwen2 7B Instruct Nf4 |
Repository ๐ค | https://huggingface.co/fubuki9/Qwen2-7B-Instruct-nf4 |
Model Size | 7b |
Required VRAM | 5.9 GB |
Updated | 2024-09-07 |
Maintainer | fubuki9 |
Model Type | qwen2 |
Instruction-Based | Yes |
Model Files | |
Model Architecture | Qwen2ForCausalLM |
Context Length | 32768 |
Model Max Length | 32768 |
Transformers Version | 4.40.1 |
Vocabulary Size | 152064 |
Torch Data Type | float16 |
Model |
Likes |
Downloads |
VRAM |
---|---|---|---|
Qwen2 7B Instruct Bnb 4bit | 4 | 9200 | 5 GB |
Qwen2 7B Instruct 4bit | 3 | 106 | 4 GB |
Qwen2 7B Instruct 4bit | 1 | 20 | 5 GB |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
---|---|---|---|
Gte Qwen2 7B Instruct | 128K / 30.5 GB | 20948 | 158 |
Qwen2 7B Instruct V0.1 | 128K / 15.2 GB | 40968 | 1 |
Qwen2 7B Instruct V0.8 | 128K / 15.2 GB | 40990 | 3 |
Einstein V7 Qwen2 7B | 128K / 15.2 GB | 4289 | 35 |
...nity Instruct 3M 0625 Qwen2 7B | 128K / 15.2 GB | 4519 | 7 |
Samantha Qwen 2 7B | 128K / 15.2 GB | 4227 | 2 |
Qwen2 7B Instruct V0.4 | 128K / 15.2 GB | 41008 | 1 |
Qwen2 7B Instruct V0.5 | 128K / 15.2 GB | 41019 | 1 |
Qwen2 7B Instruct V0.7 | 128K / 15.2 GB | 40972 | 1 |
Qwen2 7B Instruct V0.3 | 128K / 15.2 GB | 40943 | 1 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐