Supported Languages |
| |||
Input Output |
|
LLM Name | LLama 3 Mega Dolphin 2.9.1 120b GGUF |
Repository ๐ค | https://huggingface.co/DarqueDante/LLama-3-Mega-Dolphin-2.9.1-120b_GGUF |
Base Model(s) | |
Merged Model | Yes |
Model Size | 70b |
Required VRAM | 18.4 GB |
Updated | 2025-05-16 |
Maintainer | DarqueDante |
Model Type | llama |
Model Files | |
Supported Languages | en |
GGUF Quantization | Yes |
Quantization Type | gguf|q6 |
Model Architecture | LlamaForCausalLM |
Context Length | 8192 |
Model Max Length | 8192 |
Transformers Version | 4.41.0 |
Tokenizer Class | PreTrainedTokenizerFast |
Padding Token | <|end_of_text|> |
Vocabulary Size | 128258 |
Torch Data Type | float16 |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
---|---|---|---|
...Seek R1 Distill Llama 70B GGUF | 128K / 15.9 GB | 10941 | 79 |
Llama 3.3 70B Instruct GGUF | 128K / 15.9 GB | 7289 | 64 |
R1 1776 Distill Llama 70B GGUF | 128K / 26.4 GB | 663 | 18 |
Reflection Llama 3.1 70B Bf16 | 128K / 141.9 GB | 283 | 6 |
Reflection Llama 3.1 70B GGUF | 128K / 26.4 GB | 22 | 6 |
...Horizon AI Korean Advanced 70B | 128K / 141.9 GB | 26 | 0 |
Midnight Miqu 70B V1.0 GGUF | 31K / 29.9 GB | 112 | 4 |
...qu 1 70B 24GB VRAM IQ2 XS SOTA | 31K / 20.3 GB | 8 | 0 |
...ma3 70B Chinese Chat GGUF 4bit | 8K / 40 GB | 185 | 18 |
Llama 3 70B Quantised | 8K / 48.7 GB | 6 | 2 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐