LLM EXPLORER
 LLM Explorer: A Curated Large Language Model Directory and Analytics
Dark Theme
  LLM  List    LLM Hosting    LLM Leaderboards    Blog    Newsfeed    Advertise

Gemma 7B It GGUF by alokabhishek

 »  All LLMs  »  alokabhishek  »  Gemma 7B It GGUF   URL Share it on

  28   
  Arxiv:1705.03551   Arxiv:1804.06876   Arxiv:1804.09301   Arxiv:1809.02789   Arxiv:1811.00937   Arxiv:1904.09728   Arxiv:1905.07830   Arxiv:1905.10044   Arxiv:1907.10641   Arxiv:1911.01547   Arxiv:1911.11641   Arxiv:2009.03300   Arxiv:2009.11462   Arxiv:2101.11718   Arxiv:2107.03374   Arxiv:2108.07732   Arxiv:2109.07958   Arxiv:2110.08193   Arxiv:2110.14168   Arxiv:2203.09509   Arxiv:2206.04615   Arxiv:2304.06364   Arxiv:2312.11805   4bit   5bit   Autotrain compatible   Conversational   Endpoints compatible   Gemma   Gemma-7b   Gguf   Google   Q4   Q4 k m   Q5 k m   Quantized   Region:us   Safetensors

Gemma 7B It GGUF Parameters and Internals

LLM NameGemma 7B It GGUF
RepositoryOpen on 🤗 
Model Size7b
Required VRAM5.3 GB
Updated2024-07-27
Maintaineralokabhishek
Model Typegemma
Model Files  17.1 GB   5.3 GB   6.1 GB
GGUF QuantizationYes
Quantization Typegguf|q4|q4_k|q5_k
Model ArchitectureGemmaForCausalLM
Licensegemma
Context Length8192
Model Max Length8192
Transformers Version4.38.0.dev0
Tokenizer ClassGemmaTokenizer
Padding Token<pad>
Vocabulary Size256000
Torch Data Typebfloat16
Gemma 7B It GGUF (alokabhishek/gemma-7b-it-GGUF)

Best Alternatives to Gemma 7B It GGUF

Best Alternatives
HF Rank
Context/RAM
Downloads
Likes
Gemma 7B It0.68K / 17.1 GB3879191105
Gemma 7B0.58K / 17.1 GB1163032971
Train060.28K / 9.1 GB240
Gemma 1.1 7B It GGUF0.28K / 5.3 GB511
Llama2 Kazakh 7B GGUF0.28K / 4.1 GB300
Gemma 7B0.28K / 17.1 GB100
Gemma 7B It GGUF0.28K / 3.1 GB54111
Gemma7B Konosuba0.28K / 17.1 GB590
Gemma 7B Translator 0.40.28K / 17.1 GB130
Gemma 7B Translator 0.30.28K / 17.1 GB120
Note: green Score (e.g. "73.2") means that the model is better than alokabhishek/gemma-7b-it-GGUF.

Rank the Gemma 7B It GGUF Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 34447 in total.

Email us: info@extractum.io. Our Privacy Policy  | Terms and Conditions  | Suggest an improvement.
Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v2024072501
  Support LLM Explorer