Phi3 Mini 4K Qlora by Giang07

 ยป  All LLMs  ยป  Giang07  ยป  Phi3 Mini 4K Qlora   URL Share it on

  Autotrain compatible   Conversational   Custom code   En   Endpoints compatible   Instruct   Phi3   Region:us   Safetensors   Sft   Sharded   Tensorflow   Trl

Phi3 Mini 4K Qlora Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Phi3 Mini 4K Qlora (Giang07/phi3-mini-4k-qlora)

Phi3 Mini 4K Qlora Parameters and Internals

Model Type 
text-generation
LLM NamePhi3 Mini 4K Qlora
Repository ๐Ÿค—https://huggingface.co/Giang07/phi3-mini-4k-qlora 
Model Size3.8b
Required VRAM7.7 GB
Updated2025-02-05
MaintainerGiang07
Model Typephi3
Instruction-BasedYes
Model Files  5.0 GB: 1-of-2   2.7 GB: 2-of-2
Supported Languagesen
Model ArchitecturePhi3ForCausalLM
Licensemit
Context Length4096
Model Max Length4096
Transformers Version4.41.2
Tokenizer ClassLlamaTokenizer
Padding Token<unk>
Vocabulary Size32064
Torch Data Typefloat16

Best Alternatives to Phi3 Mini 4K Qlora

Best Alternatives
Context / RAM
Downloads
Likes
Phi 3.5 Mini Instruct128K / 7.7 GB1146566786
Phi 3 Mini 128K Instruct128K / 7.7 GB2368271631
NuExtract 1.5128K / 7.7 GB109096196
NuExtract V1.5128K / 7.7 GB10851189
Phi 3.5 Mini TitanFusion 0.1128K / 7.7 GB1320
Glider128K / 15.4 GB86535
ECE EIFFEL 3Bv2128K / 7.7 GB50
Phi3.5 Comets 3.8B128K / 7.7 GB1590
Samantha2.0 Phi 3.5 Mini ITA128K / 7.7 GB41910
Artemide 3.5128K / 7.7 GB80812
Note: green Score (e.g. "73.2") means that the model is better than Giang07/phi3-mini-4k-qlora.

Rank the Phi3 Mini 4K Qlora Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 42577 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227