Tinyllama PY CODER 4bit Lora 4K V4 by Ramikan-BR

 ยป  All LLMs  ยป  Ramikan-BR  ยป  Tinyllama PY CODER 4bit Lora 4K V4   URL Share it on

  4bit   Autotrain compatible Base model:ramikan-br/tinyllam...   Codegen   En   Endpoints compatible   Gguf   License:apache-2.0   Llama   Lora   Pytorch   Q4   Quantized   Region:us   Safetensors   Sft   Trl   Unsloth

Tinyllama PY CODER 4bit Lora 4K V4 Parameters and Internals

LLM NameTinyllama PY CODER 4bit Lora 4k V4
RepositoryOpen on ๐Ÿค— 
Base Model(s)  Ramikan-BR/tinyllama_PY-CODER-bnb-4bit-lora_4k-q4_k_m-v3   Ramikan-BR/tinyllama_PY-CODER-bnb-4bit-lora_4k-q4_k_m-v3
Model Size1.1b
Required VRAM0.7 GB
Model Typellama
Model Files  2.2 GB   2.2 GB   0.7 GB
Supported Languagesen
GGUF QuantizationYes
Quantization Typegguf|q4|4bit
Generates CodeYes
Model ArchitectureLlamaForCausalLM
Context Length4096
Model Max Length4096
Transformers Version4.40.1
Tokenizer ClassLlamaTokenizer
Padding Token<unk>
Vocabulary Size32000
LoRA ModelYes
Torch Data Typefloat16
Tinyllama PY CODER 4bit Lora 4K V4 (Ramikan-BR/tinyllama_PY-CODER-4bit-lora_4k-v4)

Quantized Models of the Tinyllama PY CODER 4bit Lora 4K V4

...llama PY CODER 4bit Lora 4k V50130 GB

Best Alternatives to Tinyllama PY CODER 4bit Lora 4K V4

Best Alternatives
HF Rank
Tinyllama Coder Py V130.34K / 0.7 GB1320
Tinyllama Coder Py V120.34K / 0.7 GB1310
Tinyllama Coder Py 4bit V100.34K / 0.7 GB1330
Tinyllama Coder Py 4bit V30.34K / 1.2 GB1080
Tinyllama Coder Py 4bit V40.34K / 1.2 GB150
...llama PY CODER 4bit Lora 4k V50.34K / 0.7 GB130
Tinyllama Coder Py V210.34K / 0.7 GB1310
Tinyllama Coder Py V200.34K / 0.7 GB1270
Tinyllama Coder Py V230.34K / 2.2 GB1140
Tinyllama Coder Py V190.34K / 0.7 GB1310
Note: green Score (e.g. "73.2") means that the model is better than Ramikan-BR/tinyllama_PY-CODER-4bit-lora_4k-v4.

Rank the Tinyllama PY CODER 4bit Lora 4K V4 Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 34266 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v2024071601