Candle Phi 1 by DanielClough

 ยป  All LLMs  ยป  DanielClough  ยป  Candle Phi 1   URL Share it on

  Autotrain compatible   Custom code   Dataset:microsoft/phi-1   En   Endpoints compatible   Gguf   Phi   Q4   Quantized   Region:us   Sharded   Tensorflow

Candle Phi 1 Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Candle Phi 1 (DanielClough/Candle_phi-1)

Candle Phi 1 Parameters and Internals

Model Type 
text generation
Additional Notes 
This model is distributed in `.gguf` format for HuggingFace/Candle implementations and is not compatible with `llama.cpp`.
Supported Languages 
en (English)
LLM NameCandle Phi 1
Repository ๐Ÿค—https://huggingface.co/DanielClough/Candle_phi-1 
Required VRAM2.8 GB
Updated2024-12-22
MaintainerDanielClough
Model Typephi
Model Files  2.8 GB   0.5 GB   0.6 GB   0.8 GB   0.9 GB   0.8 GB   1.0 GB   1.1 GB   1.0 GB   1.2 GB   1.5 GB   1.6 GB   1.6 GB   2.8 GB: 1-of-1
Supported Languagesen
GGUF QuantizationYes
Quantization Typeq4|gguf
Model ArchitecturePhiForCausalLM
Licensemit
Context Length2048
Model Max Length2048
Transformers Version4.37.0.dev0
Vocabulary Size51200
Torch Data Typefloat32

Best Alternatives to Candle Phi 1

Best Alternatives
Context / RAM
Downloads
Likes
MFANN3bv0.7.10 GGUF2K / 1.6 GB50
Candle Phi 1 52K / 2.8 GB4310
Phi 2 GGUF2K / 1.1 GB742
Phi 2 Quantized0K / 1.6 GB42311
Phi 1 5 GGUF0K / 0.6 GB1126
Dolphin 2 6 Phi 2 Candle0K / 0 GB274
Phi 2 Hf 4bit Mlx2K / 1.8 GB14841
Phi 1 5 Q42K /  GB71
Phi1.5 Quantized 22K /  GB90
Merlin1.42K / 5.6 GB680
Note: green Score (e.g. "73.2") means that the model is better than DanielClough/Candle_phi-1.

Rank the Candle Phi 1 Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 40066 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241217