LLM Name | Testing |
Repository ๐ค | https://huggingface.co/Edens-Gate/testing |
Model Size | 4b |
Required VRAM | 9 GB |
Updated | 2024-08-28 |
Maintainer | Edens-Gate |
Model Type | llama |
Model Files | |
Model Architecture | LlamaForCausalLM |
Context Length | 131072 |
Model Max Length | 131072 |
Transformers Version | 4.45.0.dev0 |
Tokenizer Class | PreTrainedTokenizerFast |
Padding Token | <|finetune_right_pad_id|> |
Vocabulary Size | 128256 |
Torch Data Type | bfloat16 |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
---|---|---|---|
SJT 4B | 146K / 7.6 GB | 63 | 0 |
Loxa 4B | 128K / 16 GB | 53 | 0 |
Aura 4B | 128K / 9 GB | 19 | 10 |
...ama 3.1 Minitron 4B Depth Base | 128K / 9.1 GB | 5 | 20 |
....5 MINI 4B SFTxORPO HESSIAN AI | 128K / 7.7 GB | 16 | 0 |
....5 MINI 4B ORPOxSFT HESSIAN AI | 128K / 7.7 GB | 15 | 0 |
....5 MINI 4B ORPOxSFT HESSIAN AI | 128K / 7.7 GB | 15 | 0 |
....5 MINI 4B SFTxORPO HESSIAN AI | 128K / 7.7 GB | 13 | 0 |
...ama 3.1 Minitron 4B Width Base | 128K / 9 GB | 11 | 187 |
... Minitron 4B Width Base Chatml | 128K / 9 GB | 444 | 2 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐