H2ogpt 16K Aquilachat2 34B by h2oai

 ยป  All LLMs  ยป  h2oai  ยป  H2ogpt 16K Aquilachat2 34B   URL Share it on

  Aquila   Autotrain compatible   Custom code   Pytorch   Region:us   Sharded

H2ogpt 16K Aquilachat2 34B Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
H2ogpt 16K Aquilachat2 34B (h2oai/h2ogpt-16k-aquilachat2-34b)

H2ogpt 16K Aquilachat2 34B Parameters and Internals

Model Type 
long-text chat, causal language model
LLM NameH2ogpt 16K Aquilachat2 34B
Repository ๐Ÿค—https://huggingface.co/h2oai/h2ogpt-16k-aquilachat2-34b 
Model Size34b
Required VRAM67.2 GB
Updated2025-02-05
Maintainerh2oai
Model Typeaquila
Model Files  10.0 GB: 1-of-7   9.8 GB: 2-of-7   9.7 GB: 3-of-7   9.7 GB: 4-of-7   9.7 GB: 5-of-7   9.7 GB: 6-of-7   8.6 GB: 7-of-7   0.0 GB
Model ArchitectureAquilaForCausalLM
Context Length4096
Model Max Length4096
Transformers Version4.31.0
Tokenizer ClassGPT2Tokenizer
Vocabulary Size100008
Torch Data Typebfloat16

Best Alternatives to H2ogpt 16K Aquilachat2 34B

Best Alternatives
Context / RAM
Downloads
Likes
AquilaChat2 34B 16K16K / 67.2 GB13625
Aquila2 34B8K / 136.4 GB274417
AquilaChat2 34B4K / 67.2 GB14947
AquilaChat2 34B 16K GPTQ4K / 18.7 GB266
AquilaChat2 34B GPTQ4K / 18.7 GB302
AquilaChat2 34B 16K AWQ4K / 19.3 GB94
AquilaChat2 34B AWQ4K / 19.3 GB81
Note: green Score (e.g. "73.2") means that the model is better than h2oai/h2ogpt-16k-aquilachat2-34b.

Rank the H2ogpt 16K Aquilachat2 34B Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 42565 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227