LLM Name | Winagent 8B Instruct Bnb Q4 K M Gguf |
Repository | Open on ๐ค |
Base Model(s) | |
Model Size | 8b |
Required VRAM | 0.6 GB |
Updated | 2024-07-27 |
Maintainer | irfanfadhullah |
Model Type | llama |
Instruction-Based | Yes |
Model Files | |
Supported Languages | en |
GGUF Quantization | Yes |
Quantization Type | gguf|q4|4bit|q4_k |
Model Architecture | AutoModel |
License | apache-2.0 |
Best Alternatives |
HF Rank |
Context/RAM |
Downloads |
Likes |
---|---|---|---|---|
Meta Llama 3 8B Instruct GGUF | 0.4 | 0K / 3.2 GB | 237072 | 29 |
1goavll3 | 0.3 | 0K / 3.2 GB | 14717 | 0 |
...ma 3 8B Instruct 32K V0.1 GGUF | 0.3 | 0K / 2 GB | 17849 | 55 |
Granite 8B Code Instruct GGUF | 0.3 | 0K / 3.1 GB | 25142 | 2 |
Qllamaredq | 0.3 | 0K / 4.9 GB | 6555 | 0 |
2rpsll3 | 0.3 | 0K / 3.2 GB | 6074 | 0 |
Puzzle Tools Llama3 | 0.3 | 0K / 4.9 GB | 3673 | 0 |
Meta Llama 3 8B Instruct GGUF | 0.3 | 0K / 2 GB | 3295 | 75 |
Llama 3 8B Instruct V0.10 GGUF | 0.3 | 0K / 2 GB | 600 | 2 |
...3 8B Instruct Robot Test Model | 0.3 | 0K / 4.9 GB | 195 | 0 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐