LLM EXPLORER
 LLM Explorer: A Curated Large Language Model Directory and Analytics
Dark Theme
  LLM  List    LLM Hosting    LLM Leaderboards    Blog    Newsfeed    Advertise

Flow Judge V0.1 AWQ by flowaicom

 »  All LLMs  »  flowaicom  »  Flow Judge V0.1 AWQ   URL Share it on

  2323   
  Merged Model   4-bit   Autoawq   Autotrain compatible   Awq Base model:microsoft/phi-3.5-m... Base model:quantized:microsoft...   Conversational   Custom code   En   Evaluation   Instruct   Lm-judge   Phi3   Quantized   Region:us   Safetensors

Flow Judge V0.1 AWQ Benchmarks

LLME Score: 0.28098
nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").

Flow Judge V0.1 AWQ Parameters and Internals

Model Type 
phi3.5
Use Cases 
Primary Use Cases:
Custom LLM system evaluation tasks.
Limitations:
Performance in specialized task domains like arithmetic or code evaluation may be limited., Support in non-English contexts has not been rigorously tested., Handling long context inputs or parsing structured data formats like JSON is limited.
Additional Notes 
Model is quantized using Flow AI's AWQ safetensors quant.
Supported Languages 
languages_supported (English), proficiency (Full support)
Training Details 
Data Sources:
Synthetically generated datasets
Methodology:
Supervised Fine-Tuning (SFT), RSLoRa fine-tuning, synthetic dataset generation
Context Length:
8192
Model Architecture:
Phi-3.5-mini-instruct
Input Output 
Input Format:
Text prompt format with or without user inputs
Accepted Modalities:
text
Output Format:
Structured evaluation outputs including verbal feedback with <tags> and numeric scores.
Performance Tips:
Ensure modern GPU use and adherence to prompt templates for efficient evaluations.
LLM NameFlow Judge V0.1 AWQ
Repository 🤗https://huggingface.co/flowaicom/Flow-Judge-v0.1-AWQ 
Model NameFlow-Judge-v0.1-AWQ
Model CreatorFlow AI
Base Model(s)  microsoft/Phi-3.5-mini-instruct   microsoft/Phi-3.5-mini-instruct
Merged ModelYes
Model Size682m
Required VRAM2.3 GB
Updated2024-11-21
Maintainerflowaicom
Model Typephi3.5
Instruction-BasedYes
Model Files  2.3 GB
Supported Languagesen
AWQ QuantizationYes
Quantization Typeawq
Model ArchitecturePhi3ForCausalLM
Licenseapache-2.0
Context Length131072
Model Max Length131072
Transformers Version4.44.2
Tokenizer ClassLlamaTokenizer
Padding Token<|endoftext|>
Vocabulary Size32064
Torch Data Typebfloat16
Flow Judge V0.1 AWQ (flowaicom/Flow-Judge-v0.1-AWQ)

Best Alternatives to Flow Judge V0.1 AWQ

Best Alternatives
Context / RAM
Downloads
Likes
Phi 3 Mini 128K Instruct AWQ128K / 2.3 GB16713
...8K Instruct Abliterated V3 AWQ128K / 2.3 GB60
... 3 Mini 128K Instruct AWQ 4bit128K / 2.3 GB21

Rank the Flow Judge V0.1 AWQ Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 38149 in total.

Email us: info@extractum.io. Our Privacy Policy  | Terms and Conditions  | Suggest an improvement.
Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241110
  Support LLM Explorer