Legendary River Koalpaca by ahnyeonchan

 ยป  All LLMs  ยป  ahnyeonchan  ยป  Legendary River Koalpaca   URL Share it on

  Merged Model   Arxiv:2310.06694   Autotrain compatible   Endpoints compatible   Instruct   Instruction ft   Ko   Llama   Lora   Region:us   Safetensors   Sharded   Tensorflow

Legendary River Koalpaca Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Legendary River Koalpaca (ahnyeonchan/legendary-river-koalpaca)

Legendary River Koalpaca Parameters and Internals

Model Type 
text generation
Additional Notes 
This model is remediated specifically for Korean language and built off a pruned, fine-tuned version of Sheared-LLaMA with reduced pre-training tokens.
Supported Languages 
Korean (High)
Training Details 
Data Sources:
Korean Wikipedia, Ko Alpaca
Methodology:
Finetuning with LoRa
Model Architecture:
Pruned and pre-trained from LLaMA2-7B
LLM NameLegendary River Koalpaca
Repository ๐Ÿค—https://huggingface.co/ahnyeonchan/legendary-river-koalpaca 
Merged ModelYes
Model Size1.3b
Required VRAM5.7 GB
Updated2025-02-22
Maintainerahnyeonchan
Model Typellama
Instruction-BasedYes
Model Files  5.0 GB: 1-of-2   0.7 GB: 2-of-2
Supported Languagesko
Model ArchitectureLlamaForCausalLM
Licenseapache-2.0
Context Length4096
Model Max Length4096
Transformers Version4.39.3
Tokenizer ClassLlamaTokenizer
Padding Token</s>
Vocabulary Size49579
LoRA ModelYes
Torch Data Typefloat32

Best Alternatives to Legendary River Koalpaca

Best Alternatives
Context / RAM
Downloads
Likes
Deepseek Coder 1.3B Instruct16K / 2.7 GB64461113
...c Deepseek Coder 1.3B Instruct16K / 5.4 GB740
Speechless Coder Ds 1.3B16K / 2.7 GB18680
Hpc Coder V2.1.3B16K / 2.7 GB1314
Pip Sql 1.3B16K / 5.4 GB112685
... 1.3B Instruct Trt Int4 G64 Hf16K / 0.9 GB1670
Pip Api Expert16K / 5.4 GB373
Pip Code Bandit16K / 2.7 GB2113
Pip Library Etl 1.3B16K / 5.4 GB10644
...t Structured Output Peft Merge16K / 2.7 GB1190
Note: green Score (e.g. "73.2") means that the model is better than ahnyeonchan/legendary-river-koalpaca.

Rank the Legendary River Koalpaca Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 43470 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227