LLM EXPLORER
 LLM Explorer: A Curated Large Language Model Directory and Analytics
Dark Theme
  LLM  List    LLM Hosting    LLM Leaderboards    Blog    Newsfeed    Advertise

Gemma 7B It 3.0bpw H6 EXL2 by LoneStriker

 »  All LLMs  »  LoneStriker  »  Gemma 7B It 3.0bpw H6 EXL2   URL Share it on

  6   
  Arxiv:1705.03551   Arxiv:1804.06876   Arxiv:1804.09301   Arxiv:1809.02789   Arxiv:1811.00937   Arxiv:1904.09728   Arxiv:1905.07830   Arxiv:1905.10044   Arxiv:1907.10641   Arxiv:1911.01547   Arxiv:1911.11641   Arxiv:2009.03300   Arxiv:2009.11462   Arxiv:2101.11718   Arxiv:2107.03374   Arxiv:2108.07732   Arxiv:2109.07958   Arxiv:2110.08193   Arxiv:2110.14168   Arxiv:2203.09509   Arxiv:2206.04615   Arxiv:2304.06364   Arxiv:2312.11805   Autotrain compatible   Conversational   Endpoints compatible   Exl2   Gemma   License:other   Quantized   Region:us   Safetensors

Rank the Gemma 7B It 3.0bpw H6 EXL2 Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  
Gemma 7B It 3.0bpw H6 EXL2 (LoneStriker/gemma-7b-it-3.0bpw-h6-exl2)

Best Alternatives to Gemma 7B It 3.0bpw H6 EXL2

Best Alternatives
HF Rank
Context/RAM
Downloads
Likes
SeaLLM 7B V2.569.078K / 17.1 GB1613045
SauerkrautLM Gemma 7B67.838K / 17.1 GB487313
Gemma Ko 7B Instruct V0.6267.88K / 17 GB26872
EveryoneLLM 7B Gemma Base66.698K / 17.1 GB10942
Volare64.658K / 17.1 GB21112
Gemma 7B Alpaca Case 0 264.478K / 34 GB8110
Gemma Orchid 7B DPO64.378K / 17.1 GB9106
Gemma 7B Experiment64.298K / 17.1 GB8210
Gemma 7B Ultrachat Sft63.928K / 17.1 GB8262
Gemma 7B63.758K / 17.1 GB1938292965
Note: green Score (e.g. "73.2") means that the model is better than LoneStriker/gemma-7b-it-3.0bpw-h6-exl2.

Gemma 7B It 3.0bpw H6 EXL2 Parameters and Internals

LLM NameGemma 7B It 3.0bpw H6 EXL2
RepositoryOpen on 🤗 
Model Size7b
Required VRAM5.1 GB
Updated2024-07-01
MaintainerLoneStriker
Model Typegemma
Model Files  5.1 GB
Quantization Typeexl2
Model ArchitectureGemmaForCausalLM
Licenseother
Context Length8192
Model Max Length8192
Transformers Version4.38.0.dev0
Tokenizer ClassGemmaTokenizer
Padding Token<pad>
Vocabulary Size256000
Initializer Range0.02
Torch Data Typebfloat16

What open-source LLMs or SLMs are you in search of? 34238 in total.

Email us: info@extractum.io. Our Privacy Policy  | Terms and Conditions  | Suggest an improvement.
Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v2024042801
  Support LLM Explorer