LLM Explorer: A Curated Large Language Model Directory and Analytics  // 

Llava Llama 2 13B Chat Lightning Gptq by liuhaotian

What open-source LLMs or SLMs are you in search of? 18857 in total.

 ยป  All LLMs  ยป  liuhaotian  ยป  Llava Llama 2 13B Chat Lightning Gptq   URL Share it on

  4bit   Autotrain compatible   Gptq   Llama   Quantized   Region:us

Rank the Llava Llama 2 13B Chat Lightning Gptq Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  
Llava Llama 2 13B Chat Lightning Gptq (liuhaotian/llava-llama-2-13b-chat-lightning-gptq)

Best Alternatives to Llava Llama 2 13B Chat Lightning Gptq

Best Alternatives
HF Rank
Llava V1.5 13B EXL24K / 13.2 GB21
Llava V1.5 13B 4GB 8bit4K / 14.1 GB522
Llava 13B V1.1 4bit 128g2K / 7.5 GB32
Llava V1.5 13B 5GB4K / 15.6 GB872
Llava V1.5 13B4K / 26 GB130590393
...a 2 13B Chat Lightning Preview4K / 26 GB342745
LISA 13B Llama2 V0 Explanatory4K / 26 GB44
LISA 13B Llama2 V04K / 26 GB373
Llava V1.5 13B4K / 26 GB293
Llava V1.5 13B Shard3gb4K / 26.2 GB2913

Llava Llama 2 13B Chat Lightning Gptq Parameters and Internals

LLM NameLlava Llama 2 13B Chat Lightning Gptq
RepositoryOpen on ๐Ÿค— 
Base Model(s)  ...a 2 13B Chat Lightning Preview   liuhaotian/llava-llama-2-13b-chat-lightning-preview
Model Size13b
Required VRAM7.3 GB
Model Typellama
Model Files  7.3 GB
GPTQ QuantizationYes
Quantization Typegptq|4bit
Model ArchitectureLlavaLlamaForCausalLM
Context Length4096
Model Max Length4096
Transformers Version4.31.0
Tokenizer ClassLlamaTokenizer
Beginning of Sentence Token<s>
End of Sentence Token</s>
Unk Token<unk>
Vocabulary Size32000
Initializer Range0.02
Torch Data Typefloat16
Original data from HuggingFace, OpenCompass and various public git repos.
Release v2024022003