Tenebra 30B Alpha01 FP16 by SicariusSicariiStuff

 ยป  All LLMs  ยป  SicariusSicariiStuff  ยป  Tenebra 30B Alpha01 FP16   URL Share it on

  Autotrain compatible   En   Endpoints compatible   Fp16   License:apache-2.0   Llama   Quantized   Region:us   Safetensors   Sharded   Tensorflow

Rank the Tenebra 30B Alpha01 FP16 Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  
Tenebra 30B Alpha01 FP16 (SicariusSicariiStuff/Tenebra_30B_Alpha01_FP16)

Best Alternatives to Tenebra 30B Alpha01 FP16

Best Alternatives
HF Rank
Alpaca 30B Int465.230K / 16.9 GB215
Alpaca 30B Lora Int457.20K / 16.9 GB568
...nebra 30B Alpha01 EXL2 2 50bpw16K / 10.7 GB80
...nebra 30B Alpha01 EXL2 2 80bpw16K / 11.9 GB81
Tenebra 30B Alpha01 EXL2 3bpw16K / 12.7 GB80
Tenebra 30B Alpha01 3BIT16K / 12.9 GB70
Tenebra 30B Alpha01 4BIT16K / 19.4 GB12600
... 30B Supercot SuperHOT 8K Fp168K / 65.2 GB20194
Platypus 30B SuperHOT 8K Fp168K / 65.2 GB20402
GPlatty 30B SuperHOT 8K Fp168K / 65.2 GB20461
Note: green Score (e.g. "73.2") means that the model is better than SicariusSicariiStuff/Tenebra_30B_Alpha01_FP16.

Tenebra 30B Alpha01 FP16 Parameters and Internals

LLM NameTenebra 30B Alpha01 FP16
RepositoryOpen on ๐Ÿค— 
Model Size30b
Required VRAM65 GB
Model Typellama
Model Files  7.9 GB: 1-of-9   7.8 GB: 2-of-9   8.0 GB: 3-of-9   8.0 GB: 4-of-9   7.8 GB: 5-of-9   8.0 GB: 6-of-9   7.8 GB: 7-of-9   8.0 GB: 8-of-9   1.7 GB: 9-of-9
Supported Languagesen
Quantization Typefp16
Model ArchitectureLlamaForCausalLM
Context Length16384
Model Max Length16384
Transformers Version4.36.0
Tokenizer ClassLlamaTokenizer
Padding Token</s>
Vocabulary Size32000
Initializer Range0.02
Torch Data Typebfloat16

What open-source LLMs or SLMs are you in search of? 34902 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v2024042801