LLM Name | Smol Llama 220M GQA |
Repository | Open on ๐ค |
Model Size | 220m |
Required VRAM | 0.4 GB |
Updated | 2024-07-26 |
Maintainer | BEE-spoke-data |
Model Type | llama |
Model Files | |
Supported Languages | en |
Model Architecture | LlamaForCausalLM |
License | apache-2.0 |
Context Length | 2048 |
Model Max Length | 2048 |
Transformers Version | 4.37.0.dev0 |
Tokenizer Class | LlamaTokenizer |
Padding Token | </s> |
Vocabulary Size | 32128 |
Torch Data Type | bfloat16 |
Best Alternatives |
HF Rank |
Context/RAM |
Downloads |
Likes |
---|---|---|---|---|
...l Llama 220M GQA 32K Theta Sft | 0.2 | 32K / 0.4 GB | 8 | 2 |
Smol Llama 220M GQA 32K Theta | 0.2 | 32K / 0.4 GB | 7 | 1 |
Saily 220B | 0.2 | 4K / 417 GB | 1891 | 20 |
Smol Llama 220M Openhermes | 0.3 | 2K / 0.4 GB | 1404 | 4 |
...mol Llama 220M GQA Fineweb Edu | 0.3 | 2K / 0.4 GB | 36 | 1 |
Smol Llama 220M Open Instruct | 0.2 | 2K / 0.4 GB | 191 | 1 |
Smol Llama 220M Bees Internal | 0.2 | 2K / 0.4 GB | 10 | 1 |
Beecoder 220M Python | 0.2 | 2K / 0.4 GB | 13 | 2 |
Saily 220B GPTQ | 0.2 | 4K / 105.2 GB | 9 | 1 |
Saily 220B AWQ | 0.2 | 4K / 109.1 GB | 6 | 0 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐