LLM EXPLORER
 LLM Explorer: A Curated Large Language Model Directory and Analytics
Dark Theme
  LLM  List    LLM Hosting    LLM Leaderboards    Blog    Newsfeed    Advertise

Upstage Llama 30B Instruct 2048 GGUF by TheBloke

 »  All LLMs  »  TheBloke  »  Upstage Llama 30B Instruct 2048 GGUF   URL Share it on

  303   
Base model:quantized:upstage/l... Base model:upstage/llama-30b-i...   Dataset:gair/lima Dataset:metaeval/scienceqa tex...   Dataset:open-orca/openorca   Dataset:openbookqa   Dataset:sciq   En   Gguf   Instruct   Instruction   Llama   Quantized   Region:us   Upstage
Model Card on HF 🤗: https://huggingface.co/TheBloke/upstage-llama-30b-instruct-2048-GGUF 

Upstage Llama 30B Instruct 2048 GGUF Benchmarks

LLME Score: 0.13684
nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Upstage Llama 30B Instruct 2048 GGUF (TheBloke/upstage-llama-30b-instruct-2048-GGUF)

Upstage Llama 30B Instruct 2048 GGUF Parameters and Internals

Model Type 
text generation
Use Cases 
Areas:
research, commercial applications
Supported Languages 
English (proficient)
Training Details 
Data Sources:
openbookqa, sciq, Open-Orca/OpenOrca, metaeval/ScienceQA_text_only, GAIR/lima
Context Length:
2048
Hardware Used:
A100x8 * 1
Model Architecture:
LLaMA
Input Output 
Input Format:
### System: {system_message} ### User: {prompt} ### Assistant:
Accepted Modalities:
text
LLM NameUpstage Llama 30B Instruct 2048 GGUF
Repository 🤗https://huggingface.co/TheBloke/upstage-llama-30b-instruct-2048-GGUF 
Model NameLlama 30B Instruct 2048
Model Creatorupstage
Base Model(s)  Llama 30B Instruct 2048   upstage/llama-30b-instruct-2048
Model Size30b
Required VRAM13.5 GB
Updated2025-02-22
MaintainerTheBloke
Model Typellama
Instruction-BasedYes
Model Files  13.5 GB   17.3 GB   15.8 GB   14.1 GB   18.4 GB   19.6 GB   18.4 GB   22.4 GB   23.0 GB   22.4 GB   26.7 GB   34.6 GB
Supported Languagesen
GGUF QuantizationYes
Quantization Typegguf
Model ArchitectureAutoModel
Licenseother

Best Alternatives to Upstage Llama 30B Instruct 2048 GGUF

Best Alternatives
Context / RAM
Downloads
Likes
WizardLM 30B Uncensored GGUF0K / 13.5 GB98714
...e Llama 30B Instruct 2048 GGML0K / 13.7 GB2620
Mpt 30B Chat GGML0K / 16.9 GB1873
Mpt 30B Instruct GGML0K / 16.9 GB1543
Note: green Score (e.g. "73.2") means that the model is better than TheBloke/upstage-llama-30b-instruct-2048-GGUF.

Rank the Upstage Llama 30B Instruct 2048 GGUF Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 43508 in total.

Email us: info@extractum.io. Our Privacy Policy  | Terms and Conditions  | Suggest an improvement.
Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227
  Support LLM Explorer