Gemma Ei Oc Structured Train by Holmeister

 ยป  All LLMs  ยป  Holmeister  ยป  Gemma Ei Oc Structured Train   URL Share it on

  Adapter Base model:adapter:google/gemm...   Base model:google/gemma-7b   Finetuned   Generated from trainer   Llama-factory   Lora   Peft   Region:us   Safetensors

Gemma Ei Oc Structured Train Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Gemma Ei Oc Structured Train (Holmeister/Gemma_ei_oc_structured_train)

Gemma Ei Oc Structured Train Parameters and Internals

Additional Notes 
Training used hyperparameters including a learning rate of 0.0003, train batch size of 32, and evaluation batch size of 8.
Training Details 
Data Sources:
emollms_ei_oc_structured
Methodology:
Fine-tuning with LoRA
LLM NameGemma Ei Oc Structured Train
Repository ๐Ÿค—https://huggingface.co/Holmeister/Gemma_ei_oc_structured_train 
Base Model(s)  Gemma 7B   google/gemma-7b
Model Size7b
Required VRAM0.1 GB
Updated2024-08-15
MaintainerHolmeister
Model Files  0.1 GB   0.0 GB
Model ArchitectureAdapter
Is Biasednone
Tokenizer ClassGemmaTokenizer
Padding Token<pad>
PEFT TypeLORA
LoRA ModelYes
PEFT Target Moduleso_proj|k_proj|down_proj|q_proj|up_proj|gate_proj|v_proj
LoRA Alpha16
LoRA Dropout0.1
R Param8

Quantized Models of the Gemma Ei Oc Structured Train

Model
Likes
Downloads
VRAM
Gemma 7B31717060317 GB
Gemma 7B01417 GB

Best Alternatives to Gemma Ei Oc Structured Train

Best Alternatives
Context / RAM
Downloads
Likes
Qwen Megumin0K / 0.1 GB81
...s 25 Mistral 7B Irca DPO Pairs0K / 0.1 GB70
Qwen1.5 7B Chat Sa V0.10K / 0 GB50
Zephyr 7B Ipo 0K 15K I10K / 0.7 GB250
Hr Other 7B Lora0K / 0.2 GB300
Deepseek Llm 7B Chat Sa V0.10K / 0 GB50
Deepthink Reasoning Adapter0K / 0.2 GB132
... Days Of Sodom LoRA Mistral 7B0K / 0.2 GB120
...4a1 L512 R16a32 202411160828570K / 0 GB220
...4a1 L512 R16a32 202411160915540K / 0 GB220
Note: green Score (e.g. "73.2") means that the model is better than Holmeister/Gemma_ei_oc_structured_train.

Rank the Gemma Ei Oc Structured Train Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 47770 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227