LLM EXPLORER
 LLM Explorer: A Curated Large Language Model Directory and Analytics
Dark Theme
  LLM  List    LLM Hosting    LLM Leaderboards    Blog    Newsfeed    Advertise

StarDust 12B V2 by Luni

 »  All LLMs  »  Luni  »  StarDust 12B V2   URL Share it on

  98   
  Arxiv:2306.01708   Arxiv:2311.03099   Autotrain compatible Base model:finetune:gryphe/pan... Base model:gryphe/pantheon-rp-...   Chat   Conversational   Creative-writing   En   Endpoints compatible   Mistral   Model-index   Region:us   Roleplay   Safetensors   Sharded   Tensorflow
Model Card on HF 🤗: https://huggingface.co/Luni/StarDust-12b-v2 

StarDust 12B V2 Benchmarks

MMLU Pro: 27.1
GPQA: 5.82
MUSR: 14.26
BBH: 34.95
IFEval: 56.29 vs 88 (so35)-36%
MATH Lvl 5: 6.12
LLME Score: 0.31457
nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
StarDust 12B V2 (Luni/StarDust-12b-v2)

StarDust 12B V2 Parameters and Internals

Model Type 
text-generation, roleplay, creative-writing
Use Cases 
Areas:
creative storywriting, role-play
Applications:
creative writing, roleplay scenarios
Primary Use Cases:
creative storywriting, roleplay
Limitations:
not suited for direct conversation, not suited for general purpose text generation
Considerations:
Use ChatML for better performance
Additional Notes 
The model combines various versions to enhance creative output and role-playing ability.
Supported Languages 
en (high)
Training Details 
Methodology:
DARE-TIES merge method
Input Output 
Input Format:
ChatML
Accepted Modalities:
text
Performance Tips:
Use ChatML prompting for optimal performance
LLM NameStarDust 12B V2
Repository 🤗https://huggingface.co/Luni/StarDust-12b-v2 
Base Model(s)  Mistral Nemo Bophades 12B   Magnum V2 12B   MN 12B Lyra V3   Gryphe/Pantheon-RP-1.6-12b-Nemo   nbeerbower/mistral-nemo-bophades-12B   anthracite-org/magnum-v2-12b   Sao10K/MN-12B-Lyra-v3   Gryphe/Pantheon-RP-1.6-12b-Nemo
Model Size12b
Required VRAM24.5 GB
Updated2024-12-22
MaintainerLuni
Model Typemistral
Model Files  4.9 GB: 1-of-5   4.9 GB: 2-of-5   4.9 GB: 3-of-5   4.9 GB: 4-of-5   4.9 GB: 5-of-5
Supported Languagesen
Model ArchitectureMistralForCausalLM
Licenseapache-2.0
Context Length1024000
Model Max Length1024000
Transformers Version4.44.2
Tokenizer ClassPreTrainedTokenizerFast
Padding Token<pad>
Vocabulary Size131072
Torch Data Typebfloat16

Best Alternatives to StarDust 12B V2

Best Alternatives
Context / RAM
Downloads
Likes
...r Nemo 12B Instruct R 21 09 241000K / 24.5 GB2072096
SauerkrautLM Nemo 12B Instruct1000K / 24.5 GB10680822
...s PersonalityEngine V1.1.0 12B1000K / 24.5 GB463
MISCHIEVOUS 12B Mix 0.4v1000K / 24.5 GB1861
Dolphin 2.9.3 Mistral Nemo 12B1000K / 24.5 GB912687
VICIOUS MESH 12B BETA1000K / 24.5 GB251
VICIOUS MESH 12B GAMMA1000K / 24.5 GB241
MISCHIEVOUS 12B1000K / 24.5 GB2272
MISCHIEVOUS 12B Mix III Ex V1000K / 24.5 GB1740
VICIOUS MESH 12B ALPHA1000K / 24.5 GB420
Note: green Score (e.g. "73.2") means that the model is better than Luni/StarDust-12b-v2.

Rank the StarDust 12B V2 Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 40123 in total.

Email us: info@extractum.io. Our Privacy Policy  | Terms and Conditions  | Suggest an improvement.
Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241217
  Support LLM Explorer