Cat 0.5 By Heralax: Benchmarks, Features and Detailed Analysis. Insights on Cat 0.5.

Autotrain compatible Endpoints compatible F16 Ggml Gguf Llama Pytorch Quantized Region:us Sharded

Cat 0.5 Benchmarks

^nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").

What is the LLM Explorer Rank (Score)

Cat 0.5 Parameters and Internals

LLM Name	Cat 0.5
Repository 🤗	https://huggingface.co/Heralax/Cat-0.5
Model Size	13b
Required VRAM	26 GB
Updated	2024-09-18
Maintainer	Heralax
Model Type	llama
Model Files	9.2 GB 26.0 GB 9.9 GB: 1-of-3 9.9 GB: 2-of-3 6.2 GB: 3-of-3
GGML Quantization	Yes
GGUF Quantization	Yes
Quantization Type	ggml\|gguf
Model Architecture	LlamaForCausalLM
License	llama2
Context Length	4096
Model Max Length	4096
Transformers Version	4.34.1
Tokenizer Class	LlamaTokenizer
Padding Token	<unk>
Vocabulary Size	32000
Torch Data Type	float16

Quantized Models of the Cat 0.5

Model	Likes	Downloads	VRAM
Cat 13B 0.5 GGUF	3	63	5 GB
Cat 13B 0.5 GPTQ	1	6	7 GB
Cat 13B 0.5 AWQ	1	6	7 GB

Best Alternatives to Cat 0.5

Best Alternatives	Context / RAM	Downloads	Likes
Chinese Llama 2 13B Gguf	64K / 5 GB	804	5
... Instruct 13B Alpacamod Lora64	16K / 26 GB	6	0
... Codellama Instruct 13B Lora64	16K / 26 GB	6	0
...ama Instruct 13B Alpaca Lora64	16K / 26 GB	5	0
Openthaigpt 1.0.0 13B Chat	4K / 26.2 GB	1075	6
Estopian	4K / 26 GB	18	0
Orca 2 13B GGUF	4K / 5.4 GB	1770	7
BioinspiredLLM	4K / 26 GB	123	5
Augmental 13B V1.50 B	4K / 26.1 GB	22	2
Augmental 13B V1.50 A	4K / 26.1 GB	20	1

Note: green Score (e.g. "73.2") means that the model is better than Heralax/Cat-0.5.

Rank the Cat 0.5 Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation

What open-source LLMs or SLMs are you in search of? 36026 in total.

Email us: info@extractum.io. Our Privacy Policy | Terms and Conditions | Suggest an improvement.

Our Social Media →

Original data from HuggingFace, OpenCompass and various public git repos.

Release v2024072803

Support LLM Explorer