Model Type |
| |||
Use Cases |
| |||
Additional Notes |
| |||
Training Details |
|
LLM Name | Theia 21B V2 |
Repository ๐ค | https://huggingface.co/TheDrummer/Theia-21B-v2 |
Model Size | 21b |
Required VRAM | 40.8 GB |
Updated | 2024-12-21 |
Maintainer | TheDrummer |
Model Type | mistral |
Model Files | |
Model Architecture | MistralForCausalLM |
License | other |
Context Length | 1024000 |
Model Max Length | 1024000 |
Transformers Version | 4.44.0.dev0 |
Tokenizer Class | PreTrainedTokenizerFast |
Padding Token | <pad> |
Vocabulary Size | 131074 |
Torch Data Type | bfloat16 |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
---|---|---|---|
NeMoist 21B V1a | 1000K / 40.8 GB | 349 | 2 |
Moist Theia 21B | 1000K / 40.8 GB | 16 | 1 |
Theia 21B V1 | 1000K / 40.8 GB | 24 | 28 |
Blendy001 | 1000K / 40.8 GB | 14 | 0 |
Theia 21B V1 Pretrained | 1000K / 40.8 GB | 17 | 0 |
NeMoria 21B | 1000K / 40.9 GB | 22 | 12 |
NeMoist 21B V0.5 | 1000K / 40.8 GB | 6 | 0 |
Codestral 21B Pruned | 32K / 43.1 GB | 15 | 2 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐