SEMIKONG 8B GPTQ by pentagoniac

 ยป  All LLMs  ยป  pentagoniac  ยป  SEMIKONG 8B GPTQ   URL Share it on

  4-bit   Autotrain compatible   Conversational   Endpoints compatible   Gptq   License:apache-2.0   Llama   Quantized   Region:us   Safetensors   Sharded   Tensorflow

Rank the SEMIKONG 8B GPTQ Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  
SEMIKONG 8B GPTQ (pentagoniac/SEMIKONG-8b-GPTQ)

Best Alternatives to SEMIKONG 8B GPTQ

Best Alternatives
HF Rank
Context/RAM
Downloads
Likes
... 8B Instruct 262K 4bit GPTQ 02256K / 5.7 GB250
...a 3 8B Instruct 262K 4bit GPTQ256K / 5.8 GB51
...Instruct 80K Qlora Merged GPTQ80K / 5.8 GB180
Llama3 German 8B 32K GPTQ64K / 5.7 GB140
...oLeo Instruct 8B 32K V0.1 GPTQ64K / 5.7 GB50
Llama 3 Soliloquy 8B V2 GPTQ24K / 5.7 GB121
Llama 3 Soliloquy 8B GPTQ16K / 5.7 GB45
Meta Llama 3 8B Gptq 2bit8K / 4 GB130
...a3 8B Unsloth Sft Gptq 2bit V58K / 4 GB90
...Llama 3 8B Int3 GPTQ Wikitext28K / 4.8 GB460

SEMIKONG 8B GPTQ Parameters and Internals

LLM NameSEMIKONG 8B GPTQ
RepositoryOpen on ๐Ÿค— 
Model Size8b
Required VRAM5.8 GB
Updated2024-07-13
Maintainerpentagoniac
Model Typellama
Model Files  2.0 GB: 1-of-3   2.0 GB: 2-of-3   1.8 GB: 3-of-3
GPTQ QuantizationYes
Quantization Typegptq
Model ArchitectureLlamaForCausalLM
Licenseapache-2.0
Context Length8192
Model Max Length8192
Transformers Version4.41.2
Tokenizer ClassPreTrainedTokenizerFast
Padding Token<|eot_id|>
Vocabulary Size128256
Initializer Range0.02
Torch Data Typebfloat16

What open-source LLMs or SLMs are you in search of? 36243 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v2024042801