Meta Llama 3 8B Instruct Abliterated V3 by failspy

 ยป  All LLMs  ยป  failspy  ยป  Meta Llama 3 8B Instruct Abliterated V3   URL Share it on

  Autotrain compatible   Conversational   Endpoints compatible   Instruct   Llama   Region:us   Safetensors   Sharded   Tensorflow

Meta Llama 3 8B Instruct Abliterated V3 Benchmarks

Meta Llama 3 8B Instruct Abliterated V3 (failspy/Meta-Llama-3-8B-Instruct-abliterated-v3)

Meta Llama 3 8B Instruct Abliterated V3 Parameters and Internals

Model Type 
text generation
Additional Notes 
The model has undergone orthogonalization to remove refusal behavior without altering other aspects of the original 70B instruct model. Known as "abliteration," this process differentiates it from standard uncensored fine-tunes. Potential quirks due to new methodology are acknowledged.
Training Details 
Methodology:
Orthogonalization (Ablation) of refusal behavior based on a refined methodology.
LLM NameMeta Llama 3 8B Instruct Abliterated V3
Repository ๐Ÿค—https://huggingface.co/failspy/Meta-Llama-3-8B-Instruct-abliterated-v3 
Model Size8b
Required VRAM16.1 GB
Updated2024-12-22
Maintainerfailspy
Model Typellama
Instruction-BasedYes
Model Files  5.0 GB: 1-of-4   5.0 GB: 2-of-4   4.9 GB: 3-of-4   1.2 GB: 4-of-4
Model ArchitectureLlamaForCausalLM
Licensellama3
Context Length8192
Model Max Length8192
Transformers Version4.40.1
Tokenizer ClassPreTrainedTokenizerFast
Vocabulary Size128256
Torch Data Typebfloat16

Quantized Models of the Meta Llama 3 8B Instruct Abliterated V3

Model
Likes
Downloads
VRAM
...truct Abliterated V3 GPTQ 4bit095 GB

Best Alternatives to Meta Llama 3 8B Instruct Abliterated V3

Best Alternatives
Context / RAM
Downloads
Likes
...a 3 8B Instruct Gradient 1048K1024K / 16.1 GB4850678
MrRoboto ProLong 8B V4b1024K / 16.1 GB940
...o ProLongBASE Pt6 Unaligned 8B1024K / 16.1 GB600
MrRoboto ProLong 8B V4c1024K / 16.1 GB790
MrRoboto ProLong 8B V1a1024K / 16.1 GB1070
MrRoboto ProLong 8B V2a1024K / 16.1 GB1010
...o ProLongBASE Pt2 Unaligned 8B1024K / 16.1 GB450
MrRoboto ProLong 8B V2f1024K / 16.1 GB740
MrRoboto ProLong 8B V4f1024K / 16.1 GB450
MrRoboto ProLong 8B V1l1024K / 16.1 GB670
Note: green Score (e.g. "73.2") means that the model is better than failspy/Meta-Llama-3-8B-Instruct-abliterated-v3.

Rank the Meta Llama 3 8B Instruct Abliterated V3 Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 40123 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241217