Unsloth Llama3 8B Instruct F16 by MStefan

 ยป  All LLMs  ยป  MStefan  ยป  Unsloth Llama3 8B Instruct F16   URL Share it on

  4bit Base model:quantized:unsloth/l... Base model:unsloth/llama-3-8b-...   Conversational   En   Endpoints compatible   Fp16   Gguf   Instruct   Llama   Quantized   Region:us   Unsloth

Unsloth Llama3 8b Instruct F16 Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Unsloth Llama3 8B Instruct F16 (MStefan/unsloth_llama3_8b_instruct_f16)

Unsloth Llama3 8B Instruct F16 Parameters and Internals

Additional Notes 
This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.
LLM NameUnsloth Llama3 8b Instruct F16
Repository ๐Ÿค—https://huggingface.co/MStefan/unsloth_llama3_8b_instruct_f16 
Base Model(s)  Llama 3 8B Instruct Bnb 4bit   unsloth/llama-3-8b-Instruct-bnb-4bit
Model Size8b
Required VRAM16.1 GB
Updated2025-02-22
MaintainerMStefan
Model Typellama
Instruction-BasedYes
Model Files  16.1 GB
Supported Languagesen
GGUF QuantizationYes
Quantization Typefp16|gguf|4bit
Model ArchitectureAutoModel
Licenseapache-2.0

Best Alternatives to Unsloth Llama3 8B Instruct F16

Best Alternatives
Context / RAM
Downloads
Likes
Meta Llama 3 8B Instruct GGUF0K / 2 GB143334585
...ma 3 8B Instruct 32K V0.1 GGUF0K / 2 GB141701656
Llama 3 8B Instruct 64K GGUF0K / 3.2 GB122498413
...B Instruct Bnb 4bit 24 1 100 10K / 16.1 GB800
...leverBoi Llama 3.1 8B Instruct0K / 0.2 GB4171
... Old English Tutorial FineTune0K / 4.9 GB910
Granite 8B Code Instruct GGUF0K / 3.1 GB184876
... 4bit Tiny Thought Model Large0K / 4.9 GB160
Meta Llama 3 8B Instruct GGUF0K / 3.2 GB188032
Llama 3 8B Instruct V0.10 GGUF0K / 2 GB21032
Note: green Score (e.g. "73.2") means that the model is better than MStefan/unsloth_llama3_8b_instruct_f16.

Rank the Unsloth Llama3 8B Instruct F16 Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 43470 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227