Hermes 2 Theta Llama 3 8B Ov Int8 by fakezeta

 ยป  All LLMs  ยป  fakezeta  ยป  Hermes 2 Theta Llama 3 8B Ov Int8   URL Share it on

  Autotrain compatible   Axolotl Base model:finetune:nousresear... Base model:nousresearch/hermes...   Chatml   Conversational   Dataset:teknium/openhermes-2.5   Distillation   Dpo   En   Endpoints compatible   Finetuned   Function calling   Gpt4   Instruct   Json mode   Llama   Llama-3   Merges   Openvino   Region:us   Rlhf   Synthetic data

Hermes 2 Theta Llama 3 8B Ov Int8 Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Hermes 2 Theta Llama 3 8B Ov Int8 (fakezeta/Hermes-2-Theta-Llama-3-8B-ov-int8)

Hermes 2 Theta Llama 3 8B Ov Int8 Parameters and Internals

Model Type 
text generation, instruct, finetune, chatml, function calling
Additional Notes 
Designed for structured dialogues and function calling. Prompt format includes system messages for steerability.
Supported Languages 
English (Fully supported)
Training Details 
Data Sources:
teknium/OpenHermes-2.5
Methodology:
RLHF'ed, merged model
Context Length:
8192
Model Architecture:
OVModelForCausalLM
Input Output 
Input Format:
ChatML
Accepted Modalities:
text
LLM NameHermes 2 Theta Llama 3 8B Ov Int8
Repository ๐Ÿค—https://huggingface.co/fakezeta/Hermes-2-Theta-Llama-3-8B-ov-int8 
Base Model(s)  Hermes 2 Pro Llama 3 8B   NousResearch/Hermes-2-Pro-Llama-3-8B
Model Size8b
Required VRAM8 GB
Updated2025-06-01
Maintainerfakezeta
Model Typellama
Model Files  8.0 GB
Supported Languagesen
Model ArchitectureLlamaForCausalLM
Licenseapache-2.0
Context Length8192
Model Max Length8192
Transformers Version4.41.2
Tokenizer ClassPreTrainedTokenizerFast
Padding Token<|end_of_text|>
Vocabulary Size128256

Quantized Models of the Hermes 2 Theta Llama 3 8B Ov Int8

Model
Likes
Downloads
VRAM
Hermes 2 Theta Llama 3 8B GPTQ0165 GB

Best Alternatives to Hermes 2 Theta Llama 3 8B Ov Int8

Best Alternatives
Context / RAM
Downloads
Likes
...otron 8B UltraLong 4M Instruct4192K / 32.1 GB3482107
UltraLong Thinking4192K / 16.1 GB3122
...a 3.1 8B UltraLong 4M Instruct4192K / 32.1 GB17624
...a 3.1 8B UltraLong 2M Instruct2096K / 32.1 GB8759
...otron 8B UltraLong 2M Instruct2096K / 32.1 GB41815
Zero Llama 3.1 8B Beta61048K / 16.1 GB7301
...otron 8B UltraLong 1M Instruct1048K / 32.1 GB179443
...a 3.1 8B UltraLong 1M Instruct1048K / 32.1 GB138729
...xis Bookwriter Llama3.1 8B Sft1048K / 16.1 GB534
...dger Nu Llama 3.1 8B UltraLong1048K / 16.2 GB573
Note: green Score (e.g. "73.2") means that the model is better than fakezeta/Hermes-2-Theta-Llama-3-8B-ov-int8.

Rank the Hermes 2 Theta Llama 3 8B Ov Int8 Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 47770 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227