LLM Name | LosslessMegaCoder Llama2 7B Mini |
Repository ๐ค | https://huggingface.co/rombodawg/LosslessMegaCoder-llama2-7b-mini |
Model Size | 7b |
Required VRAM | 13.4 GB |
Updated | 2024-12-26 |
Maintainer | rombodawg |
Model Type | llama |
Model Files | |
Model Architecture | LlamaForCausalLM |
License | llama2 |
Context Length | 4096 |
Model Max Length | 4096 |
Transformers Version | 4.31.0 |
Tokenizer Class | LlamaTokenizer |
Beginning of Sentence Token | <s> |
End of Sentence Token | </s> |
Unk Token | <unk> |
Vocabulary Size | 32007 |
Torch Data Type | bfloat16 |
Model |
Likes |
Downloads |
VRAM |
---|---|---|---|
...sMegaCoder Llama2 7B Mini GGUF | 7 | 174 | 2 GB |
...ssMegaCoder Llama2 7B Mini AWQ | 1 | 24 | 3 GB |
...sMegaCoder Llama2 7B Mini GPTQ | 8 | 22 | 3 GB |
...sMegaCoder Llama2 7B Mini GGML | 4 | 15 | 3 GB |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
---|---|---|---|
...4.95 New Writer 7B NON FICTION | 1024K / 16.1 GB | 65 | 1 |
...ruct Uncensored Abliterated 7B | 128K / 15.4 GB | 2320 | 6 |
Marcoro14 7B Slerp | 8K / 14.5 GB | 15 | 0 |
L2 7B Base WVG Uncensored | 4K / 13.5 GB | 1186 | 0 |
L2 7B Base Guanaco Uncensored | 4K / 13.5 GB | 1146 | 0 |
Guanaco 7B Uncensored | 4K / 13.5 GB | 1153 | 7 |
L2 7B Zar WVG Test | 4K / 13.5 GB | 13 | 1 |
Lunaboros Limarp 7B | 4K / 13.5 GB | 15 | 0 |
Freyja V4.92a 7B ACADEMIC | 2K / 13.5 GB | 9 | 0 |
...lama2 7b Chat Uncensored 8bits | 2K / 7 GB | 15 | 0 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐