Theia 21B V2 by TheDrummer

 ยป  All LLMs  ยป  TheDrummer  ยป  Theia 21B V2   URL Share it on

  Mistral   Region:us   Safetensors   Sharded   Tensorflow
Model Card on HF ๐Ÿค—: https://huggingface.co/TheDrummer/Theia-21B-v2 

Theia 21B V2 Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Theia 21B V2 (TheDrummer/Theia-21B-v2)

Theia 21B V2 Parameters and Internals

Model Type 
text generation
Use Cases 
Applications:
RP, Storytelling
Additional Notes 
Finetune of Steelskull's NeMoria 21B model with a focus on creative output. It includes features for text completion and instruct-guided storytelling using various formats such as Alpaca and Mistral.
Training Details 
Methodology:
completion, RP, and instruct training
LLM NameTheia 21B V2
Repository ๐Ÿค—https://huggingface.co/TheDrummer/Theia-21B-v2 
Model Size21b
Required VRAM40.8 GB
Updated2024-12-21
MaintainerTheDrummer
Model Typemistral
Model Files  4.9 GB: 1-of-9   4.9 GB: 2-of-9   4.9 GB: 3-of-9   4.9 GB: 4-of-9   4.9 GB: 5-of-9   4.9 GB: 6-of-9   4.9 GB: 7-of-9   4.9 GB: 8-of-9   1.6 GB: 9-of-9   0.0 GB
Model ArchitectureMistralForCausalLM
Licenseother
Context Length1024000
Model Max Length1024000
Transformers Version4.44.0.dev0
Tokenizer ClassPreTrainedTokenizerFast
Padding Token<pad>
Vocabulary Size131074
Torch Data Typebfloat16

Best Alternatives to Theia 21B V2

Best Alternatives
Context / RAM
Downloads
Likes
NeMoist 21B V1a1000K / 40.8 GB3492
Moist Theia 21B1000K / 40.8 GB161
Theia 21B V11000K / 40.8 GB2428
Blendy0011000K / 40.8 GB140
Theia 21B V1 Pretrained1000K / 40.8 GB170
NeMoria 21B1000K / 40.9 GB2212
NeMoist 21B V0.51000K / 40.8 GB60
Codestral 21B Pruned32K / 43.1 GB152

Rank the Theia 21B V2 Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 40013 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241217