30B Lazarus by CalderaAI

 ยป  All LLMs  ยป  CalderaAI  ยป  30B Lazarus   URL Share it on

  Alpaca   Autotrain compatible   Cot   Endpoints compatible   Llama   Merge   Mix   Pytorch   Region:us   Sharded   Uncensored   Vicuna
Model Card on HF ๐Ÿค—: https://huggingface.co/CalderaAI/30B-Lazarus 

30B Lazarus Benchmarks

30B Lazarus (CalderaAI/30B-Lazarus)

30B Lazarus Parameters and Internals

Model Type 
Language Model
Additional Notes 
This model is a result of experimental LoRA applications and model merges. Desired features are applied without diminishing the model's behavior. Limitations include potential intercompetition of LoRAs. Instruct and setup suggestions include Alpaca instruct as primary and Vicuna instruct format as secondary. Various presets in tools like KoboldAI or Text-Generation-WebUI can lead to different outcomes.
LLM Name30B Lazarus
Repository ๐Ÿค—https://huggingface.co/CalderaAI/30B-Lazarus 
Model Size30b
Required VRAM65.2 GB
Updated2025-04-24
MaintainerCalderaAI
Model Typellama
Model Files  9.8 GB: 1-of-7   10.0 GB: 2-of-7   9.9 GB: 3-of-7   9.9 GB: 4-of-7   9.9 GB: 5-of-7   10.0 GB: 6-of-7   5.7 GB: 7-of-7
Model ArchitectureLlamaForCausalLM
Context Length2048
Model Max Length2048
Transformers Version4.28.1
Tokenizer ClassLlamaTokenizer
Beginning of Sentence Token<s>
End of Sentence Token</s>
Unk Token<unk>
Vocabulary Size32000
Torch Data Typefloat16

Quantized Models of the 30B Lazarus

Model
Likes
Downloads
VRAM
30B Lazarus GGUF1100413 GB
30B Lazarus AWQ41817 GB

Best Alternatives to 30B Lazarus

Best Alternatives
Context / RAM
Downloads
Likes
Flash Llama 30M 2000132K / 0.1 GB4320
Smaug Slerp 30B V0.132K / 60.4 GB120
Tenebra 30B Alpha0116K / 65 GB3612
Llama33b 16K16K / 65.2 GB71
Yayi2 30B Llama4K / 121.2 GB43022
... Tokens By Perplexity Bottom K4K / 5.4 GB70
...lue Sample With Temperature2.04K / 5.4 GB1180
...via Sample With Temperature2.04K / 5.4 GB60
... Tokens By Writing Style Top K4K / 5.4 GB60
Yayi2 30B Guanaco4K / 60.6 GB22
Note: green Score (e.g. "73.2") means that the model is better than CalderaAI/30B-Lazarus.

Rank the 30B Lazarus Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 46635 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227