Hermes 2 Theta Llama 3 8B Ov Int4 by fakezeta

 ยป  All LLMs  ยป  fakezeta  ยป  Hermes 2 Theta Llama 3 8B Ov Int4   URL Share it on

  Autotrain compatible   Axolotl Base model:finetune:nousresear... Base model:nousresearch/hermes...   Chatml   Conversational   Dataset:teknium/openhermes-2.5   Distillation   Dpo   En   Endpoints compatible   Finetuned   Function calling   Gpt4   Instruct   Json mode   Llama   Llama-3   Merges   Openvino   Region:us   Rlhf   Synthetic data

Hermes 2 Theta Llama 3 8B Ov Int4 Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Hermes 2 Theta Llama 3 8B Ov Int4 (fakezeta/Hermes-2-Theta-Llama-3-8B-ov-int4)

Hermes 2 Theta Llama 3 8B Ov Int4 Parameters and Internals

Model Type 
text generation, multimodal, function calling
Use Cases 
Areas:
research, commercial applications
Applications:
training in structured outputs, multimodal dialogues
Primary Use Cases:
chat dialogues, structured function outputs
Limitations:
complex prompts may not provide desired outcomes
Considerations:
Using provided templates and structures helps in achieving optimal function output.
Additional Notes 
Provides tools for JSON mode and Function Calling for structured outputs.
Supported Languages 
en (high)
Training Details 
Data Sources:
teknium/OpenHermes-2.5
Methodology:
RLHF, function calling, JSON mode
Context Length:
8192
Model Architecture:
Transformer-based, Llama-3 structure
Input Output 
Input Format:
Uses ChatML for prompting, ensuring turn and role indications.
Accepted Modalities:
text
Output Format:
JSON, structured output compatible.
Performance Tips:
Use provided templates like ChatML for best results.
Release Notes 
Version:
1.0
Date:
2023-10-16
Notes:
Initial release with enhancements in function calling capabilities.
LLM NameHermes 2 Theta Llama 3 8B Ov Int4
Repository ๐Ÿค—https://huggingface.co/fakezeta/Hermes-2-Theta-Llama-3-8B-ov-int4 
Base Model(s)  Hermes 2 Pro Llama 3 8B   NousResearch/Hermes-2-Pro-Llama-3-8B
Model Size8b
Required VRAM0 GB
Updated2025-02-22
Maintainerfakezeta
Model Typellama
Model Files  0.0 GB   5.3 GB   0.0 GB
Supported Languagesen
Model ArchitectureLlamaForCausalLM
Licenseapache-2.0
Context Length8192
Model Max Length8192
Transformers Version4.41.2
Tokenizer ClassPreTrainedTokenizerFast
Padding Token<|end_of_text|>
Vocabulary Size128256

Best Alternatives to Hermes 2 Theta Llama 3 8B Ov Int4

Best Alternatives
Context / RAM
Downloads
Likes
...a 3 8B Instruct Gradient 1048K1024K / 16.1 GB3927680
MrRoboto ProLong 8B V4i1024K / 16.1 GB661
...o ProLongBASE Pt8 Unaligned 8B1024K / 16.1 GB240
MrRoboto BASE V2 Unholy 8B 64K1024K / 16.1 GB271
Mpasila Viking 8B1024K / 16.1 GB840
Thor V1.4 8B DARK FICTION1024K / 16.1 GB9412
41024K / 16.1 GB3220
Hel V2 8B DARK FICTION1024K / 16.1 GB220
161024K / 16.1 GB1690
...di95 LewdStorytellerMix 8B 64K1024K / 16.1 GB692
Note: green Score (e.g. "73.2") means that the model is better than fakezeta/Hermes-2-Theta-Llama-3-8B-ov-int4.

Rank the Hermes 2 Theta Llama 3 8B Ov Int4 Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 43470 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227