4bit Model by ari2002

 ยป  All LLMs  ยป  ari2002  ยป  4bit Model   URL Share it on

  4-bit   4bit   Autotrain compatible Base model:unsloth/llama-3-8b-...   Bitsandbytes   En   Endpoints compatible   License:apache-2.0   Llama   Quantized   Region:us   Safetensors   Sft   Sharded   Tensorflow   Trl   Unsloth

Rank the 4bit Model Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  
4bit Model (ari2002/4bit_model)

Best Alternatives to 4bit Model

Best Alternatives
HF Rank
Context/RAM
Downloads
Likes
...Antino 3 ANITA 8B Inst DPO ITA75.128K / 16.1 GB659719
Llama 3 Merged Linear73.938K / 16.1 GB86216
...ama 3 SauerkrautLM 8B Instruct73.748K / 16.1 GB2941347
Llama3s Merged Linear73.668K / 16.1 GB13370
Llama 3 8B Ita73.658K / 16.1 GB2123620
Llama 3 Gutenberg 8B73.188K / 16.1 GB16176
Llama 3 8B Instruct V0.873.178K / 16 GB28651
Llama 3 Wissenschaft 8B V273.068K / 16.1 GB13391
NeuralLLaMa 3 8B ORPO V0.372.668K / 16.1 GB50040
NeuralLLaMa 3 8B DT V0.172.528K / 16.1 GB54031
Note: green Score (e.g. "73.2") means that the model is better than ari2002/4bit_model.

4bit Model Parameters and Internals

LLM Name4bit Model
RepositoryOpen on ๐Ÿค— 
Base Model(s)  Llama 3 8B Bnb 4bit   unsloth/llama-3-8b-bnb-4bit
Model Size8b
Required VRAM5.8 GB
Updated2024-06-24
Maintainerari2002
Model Typellama
Model Files  4.7 GB: 1-of-2   1.1 GB: 2-of-2
Supported Languagesen
Quantization Type4bit
Model ArchitectureLlamaForCausalLM
Licenseapache-2.0
Context Length8192
Model Max Length8192
Transformers Version4.41.2
Tokenizer ClassPreTrainedTokenizerFast
Padding Token<|reserved_special_token_250|>
Vocabulary Size128256
Initializer Range0.02
Torch Data Typefloat16

What open-source LLMs or SLMs are you in search of? 34902 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v2024042801