Gemma 7B It GGUF by alokabhishek

 ยป  All LLMs  ยป  alokabhishek  ยป  Gemma 7B It GGUF   URL Share it on

  Arxiv:1705.03551   Arxiv:1804.06876   Arxiv:1804.09301   Arxiv:1809.02789   Arxiv:1811.00937   Arxiv:1904.09728   Arxiv:1905.07830   Arxiv:1905.10044   Arxiv:1907.10641   Arxiv:1911.01547   Arxiv:1911.11641   Arxiv:2009.03300   Arxiv:2009.11462   Arxiv:2101.11718   Arxiv:2107.03374   Arxiv:2108.07732   Arxiv:2109.07958   Arxiv:2110.08193   Arxiv:2110.14168   Arxiv:2203.09509   Arxiv:2206.04615   Arxiv:2304.06364   Arxiv:2312.11805   4bit   5bit   Autotrain compatible   Conversational   Endpoints compatible   Gemma   Gemma-7b   Gguf   Google   License:gemma   Q4   Q4 k m   Q5 k m   Quantized   Region:us   Safetensors

Rank the Gemma 7B It GGUF Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  
Gemma 7B It GGUF (alokabhishek/gemma-7b-it-GGUF)

Best Alternatives to Gemma 7B It GGUF

Best Alternatives
HF Rank
Context/RAM
Downloads
Likes
SauerkrautLM Gemma 7B67.838K / 17.1 GB286311
Gemma Ko 7B Instruct V0.6267.88K / 17 GB11661
EveryoneLLM 7B Gemma Base66.698K / 17.1 GB22512
Gemma 7B Alpaca Case 0 264.478K / 34 GB16840
Gemma Orchid 7B DPO64.378K / 17.1 GB43875
Gemma 7B Experiment64.298K / 17.1 GB23590
Gemma 7B Ultrachat Sft63.928K / 17.1 GB53132
Firefly Gemma 7B62.938K / 17.1 GB25161
...l Large Language Model 7B V1.062.928K / 17.1 GB18405
...ma 7B Open Platypus Commercial62.718K / 17.1 GB18290
Note: green Score (e.g. "73.2") means that the model is better than alokabhishek/gemma-7b-it-GGUF.

Gemma 7B It GGUF Parameters and Internals

LLM NameGemma 7B It GGUF
RepositoryOpen on ๐Ÿค— 
Model Size7b
Required VRAM5.3 GB
Updated2024-04-20
Maintaineralokabhishek
Model Typegemma
Model Files  17.1 GB   5.3 GB   6.1 GB
GGUF QuantizationYes
Quantization Typegguf|q4|q4_k|q5_k
Model ArchitectureGemmaForCausalLM
Licensegemma
Context Length8192
Model Max Length8192
Transformers Version4.38.0.dev0
Tokenizer ClassGemmaTokenizer
Padding Token<pad>
Vocabulary Size256000
Initializer Range0.02
Torch Data Typebfloat16

What open-source LLMs or SLMs are you in search of? 35526 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20240042001