Pruned Llama 3 Oasis 6B by GazTrab

 ยป  All LLMs  ยป  GazTrab  ยป  Pruned Llama 3 Oasis 6B   URL Share it on

  Autotrain compatible   Endpoints compatible   Llama   Region:us   Safetensors   Sharded   Tensorflow

Pruned Llama 3 Oasis 6B Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Pruned Llama 3 Oasis 6B (GazTrab/Pruned-Llama-3-Oasis-6B)

Pruned Llama 3 Oasis 6B Parameters and Internals

Model Type 
text generation
Training Details 
Methodology:
Pruning and Orthogonal Activation Steering
Model Architecture:
Meta Llama 3
LLM NamePruned Llama 3 Oasis 6B
Repository ๐Ÿค—https://huggingface.co/GazTrab/Pruned-Llama-3-Oasis-6B 
Model Size6b
Required VRAM13 GB
Updated2024-12-21
MaintainerGazTrab
Model Typellama
Model Files  5.0 GB: 1-of-3   5.0 GB: 2-of-3   3.0 GB: 3-of-3
Model ArchitectureLlamaForCausalLM
Context Length8192
Model Max Length8192
Transformers Version4.41.2
Tokenizer ClassPreTrainedTokenizerFast
Padding Token<|end_of_text|>
Vocabulary Size128256
Torch Data Typefloat16

Best Alternatives to Pruned Llama 3 Oasis 6B

Best Alternatives
Context / RAM
Downloads
Likes
Yi 6B 200K195K / 12.1 GB7232173
Yi 6B 200K AEZAKMI V2195K / 12.1 GB11261
Yi 6B 200K DPO195K / 12.1 GB11900
Wukong Yi 6B 200K195K / 12.1 GB141
Barcenas 6B 200K195K / 12.1 GB11622
Yi 6B 200K Llamafied195K / 12.1 GB2111
Yi 6B 200K Llama195K / 12.1 GB185
Chatglm2 6B Port Llama32K / 12.5 GB134
Miqu 6B Truthy31K / 11.3 GB4821
Llama 3 6B V0.18K / 12.6 GB3812
Note: green Score (e.g. "73.2") means that the model is better than GazTrab/Pruned-Llama-3-Oasis-6B.

Rank the Pruned Llama 3 Oasis 6B Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 40066 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241217