Karasu Lora Jp Qa Chat by aipib

 ยป  All LLMs  ยป  aipib  ยป  Karasu Lora Jp Qa Chat   URL Share it on

  Autotrain compatible   En   Endpoints compatible   Gguf   Instruct   Ja   Lightblue/karasu-1.1b   Llama   Lora   Q6   Quantized   Region:us   Safetensors   Yuiseki/karasu-sake-qa-v0.1

Karasu Lora Jp Qa Chat Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Karasu Lora Jp Qa Chat (aipib/karasu-lora-jp-qa-chat)

Karasu Lora Jp Qa Chat Parameters and Internals

Model Type 
text generation, question answering
Use Cases 
Areas:
rag system with reference input files
Additional Notes 
The model is fine-tuned for Q&A tasks using a lora method.
Supported Languages 
ja (native), en (secondary)
Training Details 
Methodology:
lora method
LLM NameKarasu Lora Jp Qa Chat
Repository ๐Ÿค—https://huggingface.co/aipib/karasu-lora-jp-qa-chat 
Model Size1.1b
Required VRAM0.9 GB
Updated2025-02-22
Maintaineraipib
Model Typellama
Instruction-BasedYes
Model Files  0.9 GB   0.9 GB   0.9 GB   2.2 GB
Supported Languagesja en
GGUF QuantizationYes
Quantization Typeq6|gguf
Model ArchitectureLlamaForCausalLM
Context Length2048
Model Max Length2048
Transformers Version4.40.1
Tokenizer ClassLlamaTokenizer
Vocabulary Size32000
LoRA ModelYes
Torch Data Typebfloat16

Best Alternatives to Karasu Lora Jp Qa Chat

Best Alternatives
Context / RAM
Downloads
Likes
Tinyllama Coder Py 4bit V104K / 0.7 GB1460
...1B 32K Instruct 8.0bpw H8 EXL232K / 1.2 GB61
...1B 32K Instruct 3.0bpw H6 EXL232K / 0.5 GB50
...nish English Asistant 16bit V22K / 2.2 GB80
...llama 1.1B 16K Instructions V432K / 2.2 GB980
Palmer 002 32K32K / 2.2 GB1710
TinyLlama 1.1B 32K Instruct32K / 2.2 GB23512
...lama 1.1B 16K Instructions Rag32K / 2.2 GB250
...diate 1.5T PTBR Instruct V3 8K8K / 2.2 GB1518
TinyLlama 1.1B Instruct 3T4K / 2.2 GB1210
Note: green Score (e.g. "73.2") means that the model is better than aipib/karasu-lora-jp-qa-chat.

Rank the Karasu Lora Jp Qa Chat Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 43470 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227