LLM Name | NeuralQuant 9B GGUF |
Repository ๐ค | https://huggingface.co/TheBloke/NeuralQuant-9B-GGUF |
Model Name | NeuralQuant 9B |
Model Creator | Maxime Labonne |
Base Model(s) | |
Model Size | 9b |
Required VRAM | 3.8 GB |
Updated | 2024-09-07 |
Maintainer | TheBloke |
Model Type | mistral |
Model Files | |
GGUF Quantization | Yes |
Quantization Type | gguf |
Model Architecture | AutoModel |
License | apache-2.0 |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
---|---|---|---|
Yi 1.5 9B Chat GGUF | 0K / 3.4 GB | 153 | 5 |
...e Dolphin 2.9.1 Yi 1.5 9b GGUF | 0K / 5.3 GB | 34 | 0 |
...n Dolphin 2.9.1 Yi 1.5 9b GGUF | 0K / 5.3 GB | 36 | 0 |
...s Dolphin 2.9.1 Yi 1.5 9b GGUF | 0K / 5.3 GB | 17 | 0 |
Yi 9B GGUF | 0K / 3.4 GB | 307 | 14 |
Yi 9B 200K GGUF | 0K / 3.4 GB | 240 | 5 |
Yi Super 9B GGUF | 0K / 3.4 GB | 184 | 4 |
Yi 9B GGUF | 0K / 3.4 GB | 40 | 2 |
NeuralPipe 9B Merged GGUF | 0K / 3.8 GB | 103 | 2 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐