Gemma 2 9B It SimPO by princeton-nlp

 ยป  All LLMs  ยป  princeton-nlp  ยป  Gemma 2 9B It SimPO   URL Share it on

  Arxiv:2310.01377   Arxiv:2405.14734   Arxiv:2406.12845   Alignment-handbook   Autotrain compatible Base model:finetune:google/gem... Base model:google/gemma-2-9b-i...   Conversational Dataset:princeton-nlp/gemma2-u...   Endpoints compatible   Gemma2   Generated from trainer   Region:us   Safetensors   Sharded   Tensorflow

Gemma 2 9B It SimPO Benchmarks

Gemma 2 9B It SimPO (princeton-nlp/gemma-2-9b-it-SimPO)

Gemma 2 9B It SimPO Parameters and Internals

Model Type 
Causal Language Model
Training Details 
Data Sources:
princeton-nlp/gemma2-ultrafeedback-armorm
Methodology:
SimPO training objective
Training Time:
Around 100 mins on 8xH100 GPUs
Hardware Used:
8xH100 GPUs
Model Architecture:
Based on google/gemma-2-9b-it
LLM NameGemma 2 9B It SimPO
Repository ๐Ÿค—https://huggingface.co/princeton-nlp/gemma-2-9b-it-SimPO 
Base Model(s)  Gemma 2 9B It   google/gemma-2-9b-it
Model Size9b
Required VRAM18.6 GB
Updated2025-03-12
Maintainerprinceton-nlp
Model Typegemma2
Model Files  4.9 GB: 1-of-4   5.0 GB: 2-of-4   5.0 GB: 3-of-4   3.7 GB: 4-of-4   0.0 GB
Model ArchitectureGemma2ForCausalLM
Licensemit
Context Length8192
Model Max Length8192
Transformers Version4.42.4
Tokenizer ClassGemmaTokenizer
Padding Token<pad>
Vocabulary Size256000
Torch Data Typebfloat16

Best Alternatives to Gemma 2 9B It SimPO

Best Alternatives
Context / RAM
Downloads
Likes
G2 GSHT 32K32K / 20.4 GB90
SystemGemma2 9B It32K / 18.6 GB1421
Gemma 2 9B It8K / 18.6 GB417785685
Gemma 2 9B8K / 37.1 GB113134653
Darkest Muse V18K / 20.4 GB100865
...2 9B Cpt Sahabatai V1 Instruct8K / 18.6 GB132035
SILMA 9B Instruct V1.08K / 18.6 GB1268669
MT Merge4 Gemma 2 9B8K / 20.4 GB1201
MT3 Gen4 Gemma 2 9B8K / 20.4 GB1164
...erge 02012025163610 Gemma 2 9B8K / 20.4 GB531

Rank the Gemma 2 9B It SimPO Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 44887 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227