LLM Name | Open Llama 3b V2 |
Repository ๐ค | https://huggingface.co/openlm-research/open_llama_3b_v2 |
Model Size | 3b |
Required VRAM | 6.8 GB |
Updated | 2024-09-16 |
Maintainer | openlm-research |
Model Type | llama |
Model Files | |
Model Architecture | LlamaForCausalLM |
License | apache-2.0 |
Context Length | 2048 |
Model Max Length | 2048 |
Transformers Version | 4.31.0.dev0 |
Tokenizer Class | LlamaTokenizer |
Beginning of Sentence Token | <s> |
End of Sentence Token | </s> |
Unk Token | <unk> |
Vocabulary Size | 32000 |
Torch Data Type | float16 |
Model |
Likes |
Downloads |
VRAM |
---|---|---|---|
...3b V2 Python Instruct 0.1 4bit | 0 | 5 | 2 GB |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
---|---|---|---|
Llama 3.1 Mini Instruct | 128K / 6.1 GB | 45 | 0 |
Granite 3B Code Instruct 128K | 125K / 7 GB | 553 | 2 |
Granite 3B Code Base 128K | 125K / 7 GB | 489 | 1 |
Openbuddy Zero 3B V21.2 32K | 32K / 9.5 GB | 46 | 2 |
Openbuddy Zen 3B V21.1 32K | 32K / 9.5 GB | 12 | 2 |
Mm4.more.star | 32K / 6 GB | 1 | 1 |
Mm4.ascii.star | 32K / 6 GB | 5 | 0 |
KoreanLM 3B | 20K / 11.4 GB | 1811 | 0 |
Pruned Yi 3B Prerelease Ckpt01 | 16K / 6.5 GB | 83 | 1 |
Buzz 3B Small V0.6.3 | 8K / 8.7 GB | 2 | 1 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐