Phi3 Mini 4K Qlora by Giang07

 ยป  All LLMs  ยป  Giang07  ยป  Phi3 Mini 4K Qlora   URL Share it on

  Autotrain compatible   Conversational   Custom code   En   Endpoints compatible   Instruct   Phi3   Region:us   Safetensors   Sft   Sharded   Tensorflow   Trl

Phi3 Mini 4K Qlora Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Phi3 Mini 4K Qlora (Giang07/phi3-mini-4k-qlora)

Phi3 Mini 4K Qlora Parameters and Internals

Model Type 
text-generation
LLM NamePhi3 Mini 4K Qlora
Repository ๐Ÿค—https://huggingface.co/Giang07/phi3-mini-4k-qlora 
Model Size3.8b
Required VRAM7.7 GB
Updated2025-01-15
MaintainerGiang07
Model Typephi3
Instruction-BasedYes
Model Files  5.0 GB: 1-of-2   2.7 GB: 2-of-2
Supported Languagesen
Model ArchitecturePhi3ForCausalLM
Licensemit
Context Length4096
Model Max Length4096
Transformers Version4.41.2
Tokenizer ClassLlamaTokenizer
Padding Token<unk>
Vocabulary Size32064
Torch Data Typefloat16

Best Alternatives to Phi3 Mini 4K Qlora

Best Alternatives
Context / RAM
Downloads
Likes
Phi 3.5 Mini Instruct128K / 7.7 GB560025752
Phi 3 Mini 128K Instruct128K / 7.7 GB3943051626
NuExtract V1.5128K / 7.7 GB10851189
NuExtract 1.5128K / 7.7 GB10379187
Glider128K / 15.4 GB157530
Phi 3.5 Mini TitanFusion 0.1128K / 7.7 GB180
ECE EIFFEL 3Bv2128K / 7.7 GB130
Phi3.5 Comets 3.8B128K / 7.7 GB1290
Samantha2.0 Phi 3.5 Mini ITA128K / 7.7 GB39500
Artemide 3.5128K / 7.7 GB68172
Note: green Score (e.g. "73.2") means that the model is better than Giang07/phi3-mini-4k-qlora.

Rank the Phi3 Mini 4K Qlora Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 41418 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227