LLM Name | LosslessMegaCoder Llama2 13B Mini AWQ |
Repository ๐ค | https://huggingface.co/TheBloke/LosslessMegaCoder-Llama2-13B-Mini-AWQ |
Model Name | LosslessMegaCoder Llama2 13B Mini |
Model Creator | Rombo Dawg |
Base Model(s) | |
Model Size | 13b |
Required VRAM | 7.2 GB |
Updated | 2024-09-16 |
Maintainer | TheBloke |
Model Type | llama |
Model Files | |
AWQ Quantization | Yes |
Quantization Type | awq |
Model Architecture | LlamaForCausalLM |
License | llama2 |
Context Length | 2048 |
Model Max Length | 2048 |
Transformers Version | 4.31.0 |
Tokenizer Class | LlamaTokenizer |
Beginning of Sentence Token | <s> |
End of Sentence Token | </s> |
Unk Token | <unk> |
Vocabulary Size | 32007 |
Torch Data Type | bfloat16 |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
---|---|---|---|
...ed Jordan 13B AWQ 4bit Smashed | 4K / 7.2 GB | 5 | 0 |
Uncensored Jordan 13B AWQ | 4K / 7.2 GB | 7 | 2 |
... 1.0 Uncensored Llama2 13B AWQ | 4K / 7.2 GB | 146 | 7 |
Guanaco 13B Uncensored AWQ | 4K / 7.2 GB | 12 | 3 |
Uncensored Frank 13B AWQ | 4K / 7.2 GB | 6 | 3 |
WizardLM 13B Uncensored AWQ | 2K / 7.2 GB | 1298 | 1 |
...zard Vicuna 13B Uncensored AWQ | 2K / 7.2 GB | 44 | 12 |
Karen TheEditor 13B AWQ | 2K / 7.2 GB | 16 | 1 |
...zardLM 13B V1.0 Uncensored AWQ | 2K / 7.2 GB | 11 | 1 |
13B Ouroboros AWQ | 2K / 7.2 GB | 9 | 1 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐