GrayLine Gemma3 12B by soob3123

 ยป  All LLMs  ยป  soob3123  ยป  GrayLine Gemma3 12B   URL Share it on

  Amoral-ai   Autotrain compatible Base model:finetune:google/gem... Base model:google/gemma-3-12b-...   Conversational   Dataset:soob3123/grayline-qa   Direct-answer   En   Endpoints compatible   Gemma3 text   General-knowledge   Information-retrieval   Q4   Q4 0   Quantized   Region:us   Safetensors   Sharded   Tensorflow   Uncensored   Unfiltered

GrayLine Gemma3 12B Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
GrayLine Gemma3 12B (soob3123/GrayLine-Gemma3-12B)

GrayLine Gemma3 12B Parameters and Internals

LLM NameGrayLine Gemma3 12B
Repository ๐Ÿค—https://huggingface.co/soob3123/GrayLine-Gemma3-12B 
Base Model(s)  google/gemma-3-12b-it-qat-q4_0-unquantized   google/gemma-3-12b-it-qat-q4_0-unquantized
Model Size12b
Required VRAM24.3 GB
Updated2025-05-18
Maintainersoob3123
Model Typegemma3_text
Model Files  5.0 GB: 1-of-5   4.9 GB: 2-of-5   4.9 GB: 3-of-5   4.9 GB: 4-of-5   4.6 GB: 5-of-5
Supported Languagesen
Quantization Typeq4|q4_0
Model ArchitectureGemma3ForCausalLM
Licenseapache-2.0
Context Length131072
Model Max Length131072
Transformers Version4.51.3
Tokenizer ClassGemmaTokenizer
Padding Token<pad>
Vocabulary Size262208
Torch Data Typebfloat16

Best Alternatives to GrayLine Gemma3 12B

Best Alternatives
Context / RAM
Downloads
Likes
...ranscription Fixer Gemma 3 12B128K / 24.3 GB331
Typhoon2.1 Gemma3 12B128K / 23.4 GB2463204
Gemma 3 12B It Abliterated V2128K / 47.2 GB562
Gemma 3 Coldbrew Test1128K / 23.4 GB250
Fallen Gemma3 12B V1128K / 24.3 GB24318
Gemma 3 Glitter 12B128K / 23.4 GB1397
Gemma 3 Starshine 12B Alt128K / 23.4 GB697
Amoral Gemma3 12B V2 Qat128K / 24.3 GB06
Amoral Gemma3 4B V2 Qat128K / 8.6 GB02
Gemma 3 Confetti 12B128K / 23.4 GB232
Note: green Score (e.g. "73.2") means that the model is better than soob3123/GrayLine-Gemma3-12B.

Rank the GrayLine Gemma3 12B Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 47753 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227