Phi 3 Small 8K Instruct Onnx Cuda by microsoft

 ยป  All LLMs  ยป  microsoft  ยป  Phi 3 Small 8K Instruct Onnx Cuda   URL Share it on

  Autotrain compatible   Conversational   Custom code   Dml   Ext 8k   Instruct   Onnx   Onnxruntime   Phi3   Phi3small   Region:us

Phi 3 Small 8K Instruct Onnx Cuda Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Phi 3 Small 8K Instruct Onnx Cuda (microsoft/Phi-3-small-8k-instruct-onnx-cuda)

Phi 3 Small 8K Instruct Onnx Cuda Parameters and Internals

Model Type 
nlp, conversational, text-generation
Use Cases 
Areas:
Research, Commercial applications
Applications:
Conversational agents, Natural Language Processing tasks
Additional Notes 
Models use ONNX Runtime for accelerated inference with Nvidia GPUs. Available in FP16 and INT4 CUDA formats for different batch size optimizations.
Training Details 
Data Sources:
Phi-3 datasets, which include synthetic data and filtered publicly available website data
Methodology:
Supervised fine-tuning and direct preference optimization for instruction following and safety measures.
Context Length:
8000
LLM NamePhi 3 Small 8K Instruct Onnx Cuda
Repository ๐Ÿค—https://huggingface.co/microsoft/Phi-3-small-8k-instruct-onnx-cuda 
Updated2025-02-22
Maintainermicrosoft
Model Typephi3small
Instruction-BasedYes
Context Length8k
Model ArchitecturePhi3SmallForCausalLM
Licensemit
Context Length8192
Model Max Length8192
Transformers Version4.38.1
Vocabulary Size100352
Torch Data Typebfloat16

Best Alternatives to Phi 3 Small 8K Instruct Onnx Cuda

Best Alternatives
Context / RAM
Downloads
Likes
... Small 128K Instruct Onnx Cuda128K /  GB3013
Note: green Score (e.g. "73.2") means that the model is better than microsoft/Phi-3-small-8k-instruct-onnx-cuda.

Rank the Phi 3 Small 8K Instruct Onnx Cuda Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 43470 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227