Model Type |
| ||||||
Use Cases |
| ||||||
Additional Notes |
| ||||||
Supported Languages |
| ||||||
Training Details |
|
LLM Name | Maelstrom 4B |
Repository ๐ค | https://huggingface.co/FourOhFour/Maelstrom_4B |
Merged Model | Yes |
Model Size | 4b |
Required VRAM | 9.1 GB |
Updated | 2025-01-17 |
Maintainer | FourOhFour |
Model Type | llama |
Model Files | |
Supported Languages | en |
Model Architecture | LlamaForCausalLM |
License | apache-2.0 |
Context Length | 131072 |
Model Max Length | 131072 |
Transformers Version | 4.44.1 |
Tokenizer Class | PreTrainedTokenizerFast |
Padding Token | <|finetune_right_pad_id|> |
Vocabulary Size | 128256 |
Torch Data Type | bfloat16 |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
---|---|---|---|
SJT 4B | 146K / 7.6 GB | 57 | 0 |
Loxa 4B | 128K / 16 GB | 46 | 0 |
Aura 4B | 128K / 9 GB | 23 | 9 |
...ama 3.1 Minitron 4B Width Base | 128K / 9 GB | 15 | 187 |
...ama 3.1 Minitron 4B Depth Base | 128K / 9.1 GB | 5 | 20 |
....5 MINI 4B SFTxORPO HESSIAN AI | 128K / 7.7 GB | 16 | 0 |
....5 MINI 4B ORPOxSFT HESSIAN AI | 128K / 7.7 GB | 15 | 0 |
....5 MINI 4B ORPOxSFT HESSIAN AI | 128K / 7.7 GB | 15 | 0 |
....5 MINI 4B SFTxORPO HESSIAN AI | 128K / 7.7 GB | 13 | 0 |
MagpieLM 4B Chat V0.1 | 128K / 9 GB | 198 | 18 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐