Gemma 2 9B It Advanced V2.1 by jsgreenawalt

 ยป  All LLMs  ยป  jsgreenawalt  ยป  Gemma 2 9B It Advanced V2.1   URL Share it on

  Merged Model   Autotrain compatible Base model:princeton-nlp/gemma... Base model:ucla-agi/gemma-2-9b... Base model:wzhouad/gemma-2-9b-...   Conversational   Endpoints compatible   Gemma2   Region:us   Safetensors   Sharded   Tensorflow

Gemma 2 9B It Advanced V2.1 Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Gemma 2 9B It Advanced V2.1 (jsgreenawalt/gemma-2-9B-it-advanced-v2.1)

Gemma 2 9B It Advanced V2.1 Parameters and Internals

Additional Notes 
This is a merge of the 'smartest' advanced fine-tunes available for Gemma-2-9b-it, including WPO, SimPO, and SPPO. The extreme temperature sensitivity from version V1 has been fixed. It has a unique writing style distinct from its parent models and excels in instruction following and situational understanding. The 'Q8_0 quant' is recommended.
Training Details 
Methodology:
della merge method
LLM NameGemma 2 9B It Advanced V2.1
Repository ๐Ÿค—https://huggingface.co/jsgreenawalt/gemma-2-9B-it-advanced-v2.1 
Base Model(s)  Gemma 2 9B It WPO HB   Gemma 2 9B It SPPO Iter3   Gemma 2 9B It SimPO   wzhouad/gemma-2-9b-it-WPO-HB   UCLA-AGI/Gemma-2-9B-It-SPPO-Iter3   princeton-nlp/gemma-2-9b-it-SimPO
Merged ModelYes
Model Size9b
Required VRAM20.4 GB
Updated2025-01-24
Maintainerjsgreenawalt
Model Typegemma2
Model Files  5.0 GB: 1-of-5   5.0 GB: 2-of-5   4.9 GB: 3-of-5   5.0 GB: 4-of-5   0.5 GB: 5-of-5
Model ArchitectureGemma2ForCausalLM
Context Length8192
Model Max Length8192
Transformers Version4.44.0
Tokenizer ClassGemmaTokenizer
Padding Token<pad>
Vocabulary Size256000
Torch Data Typefloat16

Best Alternatives to Gemma 2 9B It Advanced V2.1

Best Alternatives
Context / RAM
Downloads
Likes
G2 GSHT 32K32K / 20.4 GB120
Gemma 2 9B It SimPO8K / 18.6 GB21482142
Gemma 2 9B It8K / 18.6 GB350318629
Gemma 2 9B8K / 37.1 GB84944631
...2 9B Cpt Sahabatai V1 Instruct8K / 18.6 GB271230
MT4 Gen5 Gemma 2 9B8K / 20.4 GB1912
MT Merge5 Gemma 2 9B8K / 20.4 GB962
MT Merge4 Gemma 2 9B8K / 20.4 GB1601
...erge 02012025163610 Gemma 2 9B8K / 20.4 GB661
...erge 02012025163610 Gemma 2 9B8K / 20.4 GB561
Note: green Score (e.g. "73.2") means that the model is better than jsgreenawalt/gemma-2-9B-it-advanced-v2.1.

Rank the Gemma 2 9B It Advanced V2.1 Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 41815 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227