Gemma 7B It GGUF by alokabhishek

 ยป  All LLMs  ยป  alokabhishek  ยป  Gemma 7B It GGUF   URL Share it on

  Arxiv:1705.03551   Arxiv:1804.06876   Arxiv:1804.09301   Arxiv:1809.02789   Arxiv:1811.00937   Arxiv:1904.09728   Arxiv:1905.07830   Arxiv:1905.10044   Arxiv:1907.10641   Arxiv:1911.01547   Arxiv:1911.11641   Arxiv:2009.03300   Arxiv:2009.11462   Arxiv:2101.11718   Arxiv:2107.03374   Arxiv:2108.07732   Arxiv:2109.07958   Arxiv:2110.08193   Arxiv:2110.14168   Arxiv:2203.09509   Arxiv:2206.04615   Arxiv:2304.06364   Arxiv:2312.11805   4bit   5bit   Autotrain compatible   Conversational   Endpoints compatible   Gemma   Gemma-7b   Gguf   Google   License:gemma   Q4   Q4 k m   Q5 k m   Quantized   Region:us   Safetensors

Rank the Gemma 7B It GGUF Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  
Gemma 7B It GGUF (alokabhishek/gemma-7b-it-GGUF)

Best Alternatives to Gemma 7B It GGUF

Best Alternatives
HF Rank
SauerkrautLM Gemma 7B67.838K / 17.1 GB286311
Gemma Ko 7B Instruct V0.6267.88K / 17 GB11661
EveryoneLLM 7B Gemma Base66.698K / 17.1 GB22512
Gemma 7B Alpaca Case 0 264.478K / 34 GB16840
Gemma Orchid 7B DPO64.378K / 17.1 GB43875
Gemma 7B Experiment64.298K / 17.1 GB23590
Gemma 7B Ultrachat Sft63.928K / 17.1 GB53132
Firefly Gemma 7B62.938K / 17.1 GB25161
...l Large Language Model 7B V1.062.928K / 17.1 GB18405 7B Open Platypus Commercial62.718K / 17.1 GB18290
Note: green Score (e.g. "73.2") means that the model is better than alokabhishek/gemma-7b-it-GGUF.

Gemma 7B It GGUF Parameters and Internals

LLM NameGemma 7B It GGUF
RepositoryOpen on ๐Ÿค— 
Model Size7b
Required VRAM5.3 GB
Model Typegemma
Model Files  17.1 GB   5.3 GB   6.1 GB
GGUF QuantizationYes
Quantization Typegguf|q4|q4_k|q5_k
Model ArchitectureGemmaForCausalLM
Context Length8192
Model Max Length8192
Transformers Version4.38.0.dev0
Tokenizer ClassGemmaTokenizer
Padding Token<pad>
Vocabulary Size256000
Initializer Range0.02
Torch Data Typebfloat16

What open-source LLMs or SLMs are you in search of? 35526 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20240042001