Vizuosense GGML Q2 by Kimata

 ยป  All LLMs  ยป  Kimata  ยป  Vizuosense GGML Q2   URL Share it on

  Autotrain compatible   Endpoints compatible   Ggml   Gguf   Llama   Pytorch   Q2   Quantized   Region:us

Vizuosense GGML Q2 Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Vizuosense GGML Q2 (Kimata/vizuosense_ggml_q2)

Vizuosense GGML Q2 Parameters and Internals

LLM NameVizuosense GGML Q2
Repository ๐Ÿค—https://huggingface.co/Kimata/vizuosense_ggml_q2 
Model Size7b
Required VRAM2.8 GB
Updated2024-12-22
MaintainerKimata
Model Typellama
Model Files  2.8 GB
GGML QuantizationYes
GGUF QuantizationYes
Quantization Typegguf|ggml|q2
Model ArchitectureLlamaForCausalLM
Context Length4096
Model Max Length4096
Transformers Version4.31.0
Tokenizer ClassLlamaTokenizer
Beginning of Sentence Token<s>
End of Sentence Token</s>
Unk Token<unk>
Vocabulary Size32000
Torch Data Typefloat16

Best Alternatives to Vizuosense GGML Q2

Best Alternatives
Context / RAM
Downloads
Likes
Chef Ai32K / 14.4 GB240
...lumiX 32K Instruct Q4 K M GGUF32K / 4.1 GB113
PULI LlumiX 32K Q4 K M GGUF32K / 4.1 GB71
Openthaigpt 1.0.0 7B Chat4K / 13.7 GB97816
Chinese Llama 2 7B Gguf4K / 2.6 GB4314
...hat Hf Phr Mental Therapy GGUF4K / 1.5 GB180
Llama GGUF4K / 13.5 GB200
Llama2 7b Gguf Yakovlev4K / 7.2 GB240
...7B Chat Hf Function Calling V24K / 13.5 GB716130
Llama2 7B Text Sql Gguf4K / 4.1 GB420
Note: green Score (e.g. "73.2") means that the model is better than Kimata/vizuosense_ggml_q2.

Rank the Vizuosense GGML Q2 Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 40066 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241217