Phi 3 Mini 128K Instruct FP8 by neuralmagic

 ยป  All LLMs  ยป  neuralmagic  ยป  Phi 3 Mini 128K Instruct FP8   URL Share it on

  Autotrain compatible   Conversational   Custom code   Endpoints compatible   Fp8   Instruct   License:mit   Phi3   Region:us   Safetensors   Vllm

Phi 3 Mini 128K Instruct FP8 Parameters and Internals

LLM NamePhi 3 Mini 128K Instruct FP8
RepositoryOpen on ๐Ÿค— 
Model Size3.8b
Required VRAM4 GB
Updated2024-07-20
Maintainerneuralmagic
Model Typephi3
Instruction-BasedYes
Model Files  4.0 GB
Model ArchitecturePhi3ForCausalLM
Licensemit
Context Length131072
Model Max Length131072
Transformers Version4.41.2
Tokenizer ClassLlamaTokenizer
Padding Token<|endoftext|>
Vocabulary Size32064
Torch Data Typebfloat16
Phi 3 Mini 128K Instruct FP8 (neuralmagic/Phi-3-mini-128k-instruct-FP8)

Best Alternatives to Phi 3 Mini 128K Instruct FP8

Best Alternatives
HF Rank
Context/RAM
Downloads
Likes
Phi 3 Mini 128K Instruct0.6128K / 7.7 GB22339541482
...i 128K Instruct Abliterated V30.3128K / 7.7 GB144710
...ruct LinearBunkaScore 4.6K DPO0.3128K / 7.7 GB9182
...struct Mix Spider Bird 1 Epoch0.3128K / 7.7 GB6640
SeaPhi3 Mini0.3128K / 7.7 GB29124
Phi 3 Mini 128K Instruct RU0.3128K / 7.7 GB2544
...ersedLinearBunkaScore 4.6K DPO0.3128K / 7.7 GB6100
...truct Simpo Lr 5e 07 Gamma 1.50.3128K / 7.7 GB2260
...K Peft Finetuned 20000 Dataset0.3128K / 15.4 GB930
Phi3 Mini Context Ignore0.3128K / 7.7 GB610
Note: green Score (e.g. "73.2") means that the model is better than neuralmagic/Phi-3-mini-128k-instruct-FP8.

Rank the Phi 3 Mini 128K Instruct FP8 Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 34255 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v2024071601