LLM Name | ComicBot V.2 Gguf |
Repository ๐ค | https://huggingface.co/njwright92/ComicBot_v.2-gguf |
Model Size | 7b |
Required VRAM | 5 GB |
Updated | 2024-09-07 |
Maintainer | njwright92 |
Model Type | mistral |
Model Files | |
Supported Languages | en |
GGUF Quantization | Yes |
Quantization Type | gguf |
Model Architecture | AutoModel |
License | mit |
Context Length | 32768 |
Model Max Length | 32768 |
Transformers Version | 4.37.2 |
Vocabulary Size | 32000 |
Torch Data Type | bfloat16 |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
---|---|---|---|
...ixtral 8x7B Instruct V0.1 GGUF | 0K / 15.6 GB | 61011 | 594 |
Phi 3 Mini 4K Instruct GGUF | 0K / 1.4 GB | 24260 | 15 |
Dolphin 2.5 Mixtral 8x7b GGUF | 0K / 15.6 GB | 18688 | 291 |
GOAT Llama3.1 V0.1 | 0K / 0.2 GB | 88 | 3 |
Mixtral 8x7B V0.1 GGUF | 0K / 15.6 GB | 7595 | 421 |
Dolphin 2.7 Mixtral 8x7b GGUF | 0K / 15.6 GB | 14804 | 129 |
Phi 2 GGUF | 0K / 1.2 GB | 8066 | 190 |
Zephyr Tuning Gguf | 0K / 5.1 GB | 160 | 2 |
Spydaz Web AI | 0K / 4.4 GB | 81 | 3 |
...i 3 Mini 4K Instruct V0.3 GGUF | 0K / 1.4 GB | 227 | 5 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐