Llama 3 Neural Chat V1 8B by Locutusque

 ยป  All LLMs  ยป  Locutusque  ยป  Llama 3 Neural Chat V1 8B   URL Share it on

  Autotrain compatible Base model:finetune:meta-llama... Base model:meta-llama/meta-lla...   Conversational Dataset:jondurbin/airoboros-3....   Dataset:m-a-p/code-feedback Dataset:maziyarpanahi/wizardlm... Dataset:microsoft/orca-math-wo... Dataset:mlabonne/orpo-dpo-mix-... Dataset:open-orca/slimorca-ded...   Endpoints compatible   Instruct   Llama   Model-index   Region:us   Safetensors   Sharded   Tensorflow

Llama 3 Neural Chat V1 8B Benchmarks

Llama 3 Neural Chat V1 8B (Locutusque/llama-3-neural-chat-v1-8b)

Llama 3 Neural Chat V1 8B Parameters and Internals

Model Type 
Text Generation
Use Cases 
Primary Use Cases:
Conversational AI, Great performance in writing and coding
Training Details 
Data Sources:
mlabonne/orpo-dpo-mix-40k, Open-Orca/SlimOrca-Dedup, jondurbin/airoboros-3.2, microsoft/orca-math-word-problems-200k, m-a-p/Code-Feedback, MaziyarPanahi/WizardLM_evol_instruct_V2_196k
Methodology:
I fine-tuned llama-3 8B on an approach similar to Intel's neural chat language model. I have slightly modified the data sources so it is stronger in coding, math, and writing. I use both SFT and DPO.
LLM NameLlama 3 Neural Chat V1 8B
Repository ๐Ÿค—https://huggingface.co/Locutusque/llama-3-neural-chat-v1-8b 
Base Model(s)  Meta Llama 3 8B   meta-llama/Meta-Llama-3-8B
Model Size8b
Required VRAM16.1 GB
Updated2025-02-05
MaintainerLocutusque
Model Typellama
Instruction-BasedYes
Model Files  2.0 GB: 1-of-9   1.9 GB: 2-of-9   2.0 GB: 3-of-9   1.9 GB: 4-of-9   2.0 GB: 5-of-9   1.9 GB: 6-of-9   2.0 GB: 7-of-9   1.3 GB: 8-of-9   1.1 GB: 9-of-9
Model ArchitectureLlamaForCausalLM
Licenseother
Context Length8192
Model Max Length8192
Transformers Version4.40.0
Tokenizer ClassPreTrainedTokenizerFast
Padding Token<|end_of_text|>
Vocabulary Size128256
Torch Data Typebfloat16

Quantized Models of the Llama 3 Neural Chat V1 8B

Model
Likes
Downloads
VRAM
Llama 3 Neural Chat V1 8B AWQ2765 GB

Best Alternatives to Llama 3 Neural Chat V1 8B

Best Alternatives
Context / RAM
Downloads
Likes
...a 3 8B Instruct Gradient 1048K1024K / 16.1 GB6623678
Mpasila Viking 8B1024K / 16.1 GB590
161024K / 16.1 GB1690
Because Im Bored Nsfw11024K / 16.1 GB661
121024K / 16.1 GB600
MrRoboto ProLong 8B V4b1024K / 16.1 GB1070
MrRoboto ProLong 8B V1a1024K / 16.1 GB1080
MrRoboto ProLong 8B V2a1024K / 16.1 GB1020
MrRoboto ProLong 8B V4c1024K / 16.1 GB870
8B Unaligned BASE V2b1024K / 16.1 GB980
Note: green Score (e.g. "73.2") means that the model is better than Locutusque/llama-3-neural-chat-v1-8b.

Rank the Llama 3 Neural Chat V1 8B Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 42577 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227