Llama2 7B Sft Detox by SungJoo

 ยป  All LLMs  ยป  SungJoo  ยป  Llama2 7B Sft Detox   URL Share it on

  Autotrain compatible   Bias   Detoxification   En   Endpoints compatible   Finetuned   Instruction   Llama   Llama2   Region:us   Safetensors   Sharded   Tensorflow   Unbias

Llama2 7B Sft Detox Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Llama2 7B Sft Detox (SungJoo/llama2-7b-sft-detox)

Llama2 7B Sft Detox Parameters and Internals

Model Type 
Auto-regressive language model
Use Cases 
Applications:
chatbots, NLP systems
Primary Use Cases:
Generating less toxic language
Limitations:
May still generate biased or harmful content.
Considerations:
Users should apply this model with caution and review outputs for sensitive applications.
Additional Notes 
The model was fine-tuned using a comprehensive instruction dataset specifically designed for detoxification of LLMs. Objective for detoxification achieved through instruction tuning and Direct Preference Optimization (DPO).
Supported Languages 
English (NLP)
Training Details 
Methodology:
Instruction tuning
Context Length:
512
Hardware Used:
4 A100 80GB GPUs
Model Architecture:
LLaMA-2-7b
LLM NameLlama2 7B Sft Detox
Repository ๐Ÿค—https://huggingface.co/SungJoo/llama2-7b-sft-detox 
Model Size7b
Required VRAM27.1 GB
Updated2025-02-22
MaintainerSungJoo
Model Typellama
Model Files  4.8 GB: 1-of-6   4.9 GB: 2-of-6   4.9 GB: 3-of-6   4.9 GB: 4-of-6   4.9 GB: 5-of-6   2.7 GB: 6-of-6
Supported Languagesen
Model ArchitectureLlamaForCausalLM
Licenseapache-2.0
Context Length4096
Model Max Length4096
Transformers Version4.38.2
Tokenizer ClassLlamaTokenizer
Padding Token[PAD]
Vocabulary Size32001
Torch Data Typefloat32

Best Alternatives to Llama2 7B Sft Detox

Best Alternatives
Context / RAM
Downloads
Likes
2 Very Sci Fi1024K / 16.1 GB3170
...1M 1000000ctx AEZAKMI 3 1 17021024K / 13.5 GB231
... Qwen2.5llamaify 7B V23.1 200K195K / 15.2 GB39433
LlamaStock 8B128K / 16.1 GB111
SuperNeuralDreadDevil 8B128K / 16.1 GB541
Yarn Llama 2 7B 128K128K / 13.5 GB642239
LLaMA 7B PoSE YaRN 128K128K / 13.5 GB73
LLaMA 7B PoSE Linear 96K96K / 27 GB92
LLaMA 7B PoSE YaRN 96K96K / 13.5 GB111
Chat Llama2 7B 80K80K / 13.8 GB80
Note: green Score (e.g. "73.2") means that the model is better than SungJoo/llama2-7b-sft-detox.

Rank the Llama2 7B Sft Detox Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 43470 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227