Open Llama 13B Open Instruct by VMware

 ยป  All LLMs  ยป  VMware  ยป  Open Llama 13B Open Instruct   URL Share it on

  Autotrain compatible Dataset:vmware/open-instruct-v...   En   Endpoints compatible   Instruct   Llama   Pytorch   Region:us   Safetensors   Sharded   Tensorflow

Open Llama 13B Open Instruct Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Open Llama 13B Open Instruct (VMware/open-llama-13b-open-instruct)

Open Llama 13B Open Instruct Parameters and Internals

Model Type 
text generation
Additional Notes 
The model might struggle with code as the tokenizer merges multiple spaces.
Supported Languages 
en (Supporting English language)
Training Details 
Data Sources:
VMware/open-instruct-v1-oasst-dolly-hhrlhf
Methodology:
Trained using the Alpaca prompt template.
Input Output 
Input Format:
Below is an instruction that describes a task. Write a response that appropriately completes the request. ### Instruction: {instruction} ### Response:
Accepted Modalities:
text
Output Format:
Textual response
Performance Tips:
Set 'use_fast = False' when instantiating the tokenizer to avoid incorrect encoding.
LLM NameOpen Llama 13B Open Instruct
Repository ๐Ÿค—https://huggingface.co/VMware/open-llama-13b-open-instruct 
Model Size13b
Required VRAM26 GB
Updated2025-04-29
MaintainerVMware
Model Typellama
Instruction-BasedYes
Model Files  9.9 GB: 1-of-3   9.9 GB: 2-of-3   6.2 GB: 3-of-3   9.9 GB: 1-of-3   9.9 GB: 2-of-3   6.2 GB: 3-of-3
Supported Languagesen
Model ArchitectureLlamaForCausalLM
Licensecc-by-sa-3.0
Context Length2048
Model Max Length2048
Transformers Version4.28.1
Tokenizer ClassLlamaTokenizer
Beginning of Sentence Token<s>
End of Sentence Token</s>
Unk Token<unk>
Vocabulary Size32000
Torch Data Typefloat16

Quantized Models of the Open Llama 13B Open Instruct

Model
Likes
Downloads
VRAM
...n Llama 13B Lora Cabra Adapter2100 GB
...n Llama 13B Open Instruct 8bit01113 GB
...n Llama 13B Open Instruct GPTQ1077 GB

Best Alternatives to Open Llama 13B Open Instruct

Best Alternatives
Context / RAM
Downloads
Likes
CodeLlama 13B Instruct Hf16K / 26 GB206942147
NexusRaven V2 13B16K / 26 GB3686465
CodeLlama 13B MORepair16K / 26 GB152
CodeLlama 13B Instruct Hf16K / 26 GB197822
TableLLM 13B16K / 26 GB10027
NexusRaven 13B16K / 26 GB67103
Panda Coder 13B16K / 26 GB2013
... Llama 2 13B Instruct Text2sql16K / 26 GB4927
Gen Sim16K / 0.3 GB72
Llama 3 13B Instruct Ft8K / 26.1 GB82
Note: green Score (e.g. "73.2") means that the model is better than VMware/open-llama-13b-open-instruct.

Rank the Open Llama 13B Open Instruct Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 46792 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227