Llama3 8B Unsloth Sft Quip 4bit by acl-srw-2024

 ยป  All LLMs  ยป  acl-srw-2024  ยป  Llama3 8B Unsloth Sft Quip 4bit   URL Share it on

  4bit   Autotrain compatible   Endpoints compatible   Llama   Lora   Quantized   Region:us   Safetensors

Rank the Llama3 8B Unsloth Sft Quip 4bit Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  
Llama3 8B Unsloth Sft Quip 4bit (acl-srw-2024/llama3-8b-unsloth-sft-quip-4bit)

Best Alternatives to Llama3 8B Unsloth Sft Quip 4bit

Best Alternatives
HF Rank
...olphin Llama3 Zh Cn Uncensored57.70K / 16.1 GB167610
... Student Mental Health Chatbot0K / 0.1 GB50
Llama 3 8B African Aya 4bit0K / 0.2 GB33
Bad Llm Dpov030K / 0.2 GB91
Llama3 8B GenDS0K / 0.2 GB31
Llama3 CSD Doc0K / 0.2 GB2830
Eml Model0K / 0.2 GB560
Lora Model0K / 0.2 GB390
...ama 3 8B Instruct Bnb Telcom 30K / 0.2 GB230
School Assistant0K / 0.2 GB210
Note: green Score (e.g. "73.2") means that the model is better than acl-srw-2024/llama3-8b-unsloth-sft-quip-4bit.

Llama3 8B Unsloth Sft Quip 4bit Parameters and Internals

LLM NameLlama3 8B Unsloth Sft Quip 4bit
RepositoryOpen on ๐Ÿค— 
Model Size8b
Required VRAM0.1 GB
Model Files  0.1 GB
Quantization Type4bit
Model ArchitectureAutoModelForCausalLM
Model Max Length8192
Is Biasednone
Tokenizer ClassPreTrainedTokenizerFast
Padding Token<|reserved_special_token_250|>
LoRA ModelYes
PEFT Target Modulesdown_proj|v_proj|o_proj|gate_proj|k_proj|q_proj|up_proj
LoRA Alpha16
LoRA Dropout0
R Param16

What open-source LLMs or SLMs are you in search of? 34902 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v2024042801