Model Type |
| ||||||
Additional Notes |
| ||||||
Supported Languages |
| ||||||
Training Details |
|
LLM Name | Theia 21B V1 Pretrained |
Repository ๐ค | https://huggingface.co/athirdpath/Theia-21B-v1_pretrained |
Base Model(s) | |
Model Size | 21b |
Required VRAM | 40.8 GB |
Updated | 2025-01-23 |
Maintainer | athirdpath |
Model Type | mistral |
Model Files | |
Supported Languages | en |
Model Architecture | MistralForCausalLM |
License | apache-2.0 |
Context Length | 1024000 |
Model Max Length | 1024000 |
Transformers Version | 4.44.0 |
Tokenizer Class | PreTrainedTokenizerFast |
Padding Token | <pad> |
Vocabulary Size | 131072 |
Torch Data Type | bfloat16 |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
---|---|---|---|
Moist Theia 21B | 1000K / 40.8 GB | 34 | 1 |
Theia 21B V2 | 1000K / 40.8 GB | 37 | 26 |
Theia 21B V1 | 1000K / 40.8 GB | 13 | 29 |
NeMoist 21B V1a | 1000K / 40.8 GB | 121 | 2 |
Blendy001 | 1000K / 40.8 GB | 6 | 0 |
NeMoria 21B | 1000K / 40.9 GB | 36 | 12 |
NeMoist 21B V0.5 | 1000K / 40.8 GB | 5 | 0 |
Codestral 21B Pruned | 32K / 43.1 GB | 29 | 2 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐