LLM EXPLORER
 LLM Explorer: A Curated Large Language Model Directory and Analytics
Dark Theme
  LLM  List    LLM Hosting    LLM Leaderboards    Blog    Newsfeed    Advertise

Llama Phi 3 DoRA by Ba2han

 »  All LLMs  »  Ba2han  »  Llama Phi 3 DoRA   URL Share it on

  103   
  Autotrain compatible   Conversational Dataset:abacusai/systemchat-1....   Dataset:ba2han/dollyllama-5k Dataset:sao10k/claude-3-opus-i...   En   Endpoints compatible   Instruct   Mistral   Model-index   Region:us   Safetensors   Sharded   Tensorflow

Llama Phi 3 DoRA Benchmarks

MMLU Pro: 32.39
GPQA: 10.18
MUSR: 9.53
BBH: 37.25
IFEval: 51.31 vs 88 (so35)-41.7%
ARC: 62.29 vs 96.7 (so35)-35.6%
HellaSwag: 79.08 vs 95.3 (gpt4)-17%
MMLU: 69.44 vs 88.3 (so35)-21.4%
TruthfulQA: 54.08 vs 59 (gpt4)-8.3%
WinoGrande: 73.4 vs 87.5 (gpt4)-16.1%
GSM8K: 68.01 vs 96.4 (so35)-29.5%
MATH Lvl 5: 10.2
LLME Score: 0.32448
nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").

Llama Phi 3 DoRA Parameters and Internals

LLM NameLlama Phi 3 DoRA
Repository 🤗https://huggingface.co/Ba2han/Llama-Phi-3_DoRA 
Model Size3.8b
Required VRAM7.6 GB
Updated2024-09-07
MaintainerBa2han
Model Typemistral
Instruction-BasedYes
Model Files  5.0 GB: 1-of-2   2.6 GB: 2-of-2
Supported Languagesen
Model ArchitectureMistralForCausalLM
Licensemit
Context Length4096
Model Max Length4096
Transformers Version4.39.3
Tokenizer ClassLlamaTokenizer
Padding Token<|endoftext|>
Vocabulary Size32064
Torch Data Typebfloat16
Llama Phi 3 DoRA (Ba2han/Llama-Phi-3_DoRA)

Best Alternatives to Llama Phi 3 DoRA

Best Alternatives
Context / RAM
Downloads
Likes
Phi 3 Mini 4K Instruct4K / 7.6 GB894941
Empty Phi 3 Mini4K / 7.6 GB60
...i3 Short Story Merged Bfloat164K / 7.6 GB151
...ling Assistant Spanish Pofi V24K / 7.7 GB130
Phi 3 Mini 4K Instruct Orpo V24K / 14.9 GB41
...Word Problems 200K Model 16bit4K / 7.6 GB21700
Porpoise14K / 7.6 GB3000
... 4K Instruct Matter 0.1 Slim A4K / 7.6 GB292
...rser User V9b Epoch 7 Lr 0.0024K / 7.6 GB50
...100 Percent Low Med Perplexity4K / 7.6 GB50

Rank the Llama Phi 3 DoRA Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 35693 in total.

Email us: info@extractum.io. Our Privacy Policy  | Terms and Conditions  | Suggest an improvement.
Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v2024072803
  Support LLM Explorer