Georgesung Llama2 7B Chat Uncensored HQQ 1bit Smashed by PrunaAI

 ยป  All LLMs  ยป  PrunaAI  ยป  Georgesung Llama2 7B Chat Uncensored HQQ 1bit Smashed   URL Share it on

  1bit   Autotrain compatible Base model:finetune:prunaai/ge... Base model:prunaai/georgesung-...   Endpoints compatible   Llama   Pruna-ai   Quantized   Region:us   Uncensored

Georgesung Llama2 7b Chat Uncensored HQQ 1bit Smashed Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").

Georgesung Llama2 7B Chat Uncensored HQQ 1bit Smashed Parameters and Internals

LLM NameGeorgesung Llama2 7b Chat Uncensored HQQ 1bit Smashed
Repository ๐Ÿค—https://huggingface.co/PrunaAI/georgesung-llama2_7b_chat_uncensored-HQQ-1bit-smashed 
Base Model(s)  ...at Uncensored HQQ 1bit Smashed   PrunaAI/georgesung-llama2_7b_chat_uncensored-HQQ-1bit-smashed
Model Size7b
Required VRAM1.5 GB
Updated2024-09-07
MaintainerPrunaAI
Model Typellama
Model Files  1.5 GB
Quantization Type1bit
Model ArchitectureLlamaForCausalLM
Context Length2048
Model Max Length2048
Transformers Version4.40.0
Tokenizer ClassLlamaTokenizer
Padding Token[PAD]
Vocabulary Size32000
Torch Data Typefloat16
Georgesung Llama2 7B Chat Uncensored HQQ 1bit Smashed (PrunaAI/georgesung-llama2_7b_chat_uncensored-HQQ-1bit-smashed)

Quantized Models of the Georgesung Llama2 7B Chat Uncensored HQQ 1bit Smashed

Model
Likes
Downloads
VRAM
...at Uncensored HQQ 1bit Smashed071 GB

Best Alternatives to Georgesung Llama2 7B Chat Uncensored HQQ 1bit Smashed

Best Alternatives
Context / RAM
Downloads
Likes
...7B Uncensored SuperHOT 8K Fp168K / 13.5 GB224
....0 Uncensored SuperHOT 8K Fp168K / 13.5 GB94
...at Uncensored HQQ 2bit Smashed2K / 2.3 GB50
...at Uncensored HQQ 4bit Smashed2K / 3.9 GB50
Llama2 7b Chat Uncensored2K / 27 GB1788352
...at Uncensored Bnb 4bit Smashed2K / 4.2 GB70
Luna AI Llama2 Uncensored2K / 27 GB829134
Llama2 7b Chat Uncensored2K / 27 GB81
Smaugv0.1 6.0bpw H6 EXL2195K / 26.4 GB184
Smaugv0.1 5.0bpw H6 EXL2195K / 22.3 GB203

Rank the Georgesung Llama2 7B Chat Uncensored HQQ 1bit Smashed Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 35693 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v2024072803