LLM Name | LosslessMegaCoder Llama2 13B Mini |
Repository ๐ค | https://huggingface.co/rombodawg/LosslessMegaCoder-llama2-13b-mini |
Model Size | 13b |
Required VRAM | 26.1 GB |
Updated | 2024-09-07 |
Maintainer | rombodawg |
Model Type | llama |
Model Files | |
Model Architecture | LlamaForCausalLM |
License | llama2 |
Context Length | 2048 |
Model Max Length | 2048 |
Transformers Version | 4.31.0 |
Tokenizer Class | LlamaTokenizer |
Beginning of Sentence Token | <s> |
End of Sentence Token | </s> |
Unk Token | <unk> |
Vocabulary Size | 32007 |
Torch Data Type | bfloat16 |
Model |
Likes |
Downloads |
VRAM |
---|---|---|---|
...MegaCoder Llama2 13B Mini GGUF | 2 | 156 | 5 GB |
...sMegaCoder Llama2 13B Mini AWQ | 1 | 11 | 7 GB |
...MegaCoder Llama2 13B Mini GGML | 11 | 2 | 5 GB |
...MegaCoder Llama2 13B Mini GPTQ | 4 | 20 | 7 GB |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
---|---|---|---|
Uncensored Jordan 13B | 4K / 26.1 GB | 692 | 6 |
Orca 2 13B Alpaca Uncensored | 4K / 26 GB | 72 | 2 |
Uncensored Frank 13B | 4K / 26.1 GB | 693 | 7 |
Guanaco 13B Uncensored | 4K / 26 GB | 688 | 12 |
...rdLM 1.0 Uncensored Llama2 13B | 4K / 26.2 GB | 6 | 0 |
...rdLM 1.0 Uncensored Llama2 13B | 4K / 26 GB | 26 | 48 |
13B Ouroboros | 2K / 26 GB | 694 | 9 |
Wizard Vicuna 13B Juniper | 2K / 52.1 GB | 689 | 0 |
...izard Vicuna 13B Uncensored HF | 2K / 26 GB | 884 | 208 |
...M 13B OpenAssistant Uncensored | 2K / 15.9 GB | 674 | 7 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐