Gemma 2 Ataraxy V3i 9B by lemon07r

 ยป  All LLMs  ยป  lemon07r  ยป  Gemma 2 Ataraxy V3i 9B   URL Share it on

  Merged Model   Autotrain compatible Base model:ifable/gemma-2-ifab... Base model:nbeerbower/gemma2-g... Base model:unsloth/gemma-2-9b-... Base model:wzhouad/gemma-2-9b-...   Conversational   Endpoints compatible   Gemma2   Model-index   Region:us   Safetensors   Sharded   Tensorflow

Gemma 2 Ataraxy V3i 9B Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Gemma 2 Ataraxy V3i 9B (lemon07r/Gemma-2-Ataraxy-v3i-9B)

Gemma 2 Ataraxy V3i 9B Parameters and Internals

Additional Notes 
Another experimental model. This one is in the vein of advanced 2.1, but we replace the simpo model used in the original recipe, with a different simpo model, that was more finetuned with writing in mind, ifable. We also use another writing model, which was trained on gutenberg. We use this one at a higher density because SPPO, on paper is the superior training method, to simpo.
Training Details 
Methodology:
Merged using della merge method
Model Architecture:
Merge of pre-trained language models
LLM NameGemma 2 Ataraxy V3i 9B
Repository ๐Ÿค—https://huggingface.co/lemon07r/Gemma-2-Ataraxy-v3i-9B 
Base Model(s)  Gemma2 Gutenberg Doppel 9B   Gemma 2 Ifable 9B   Gemma 2 9B It   Gemma 2 9B It WPO HB   nbeerbower/Gemma2-Gutenberg-Doppel-9B   ifable/gemma-2-Ifable-9B   unsloth/gemma-2-9b-it   wzhouad/gemma-2-9b-it-WPO-HB
Merged ModelYes
Model Size9b
Required VRAM18.6 GB
Updated2025-02-08
Maintainerlemon07r
Model Typegemma2
Model Files  5.0 GB: 1-of-4   5.0 GB: 2-of-4   5.0 GB: 3-of-4   3.6 GB: 4-of-4
Model ArchitectureGemma2ForCausalLM
Context Length8192
Model Max Length8192
Transformers Version4.43.3
Tokenizer ClassGemmaTokenizer
Padding Token<pad>
Vocabulary Size256000
Torch Data Typebfloat16

Best Alternatives to Gemma 2 Ataraxy V3i 9B

Best Alternatives
Context / RAM
Downloads
Likes
G2 GSHT 32K32K / 20.4 GB150
SystemGemma2 9B It32K / 18.6 GB341
Gemma 2 9B It SimPO8K / 18.6 GB29638144
Gemma 2 9B It8K / 18.6 GB396442645
Gemma 2 9B8K / 37.1 GB82802639
...2 9B Cpt Sahabatai V1 Instruct8K / 18.6 GB433934
MT4 Gen5 Gemma 2 9B8K / 20.4 GB1562
SILMA 9B Instruct V1.08K / 18.6 GB1934963
Recoilme Gemma 2 9B V0.38K / 20.4 GB50823
Darkest Muse V18K / 20.4 GB37055
Note: green Score (e.g. "73.2") means that the model is better than lemon07r/Gemma-2-Ataraxy-v3i-9B.

Rank the Gemma 2 Ataraxy V3i 9B Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 42807 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227