Llama2 7B Gguf Yakovlev by evilfreelancer

 ยป  All LLMs  ยป  evilfreelancer  ยป  Llama2 7B Gguf Yakovlev   URL Share it on

  Autotrain compatible   Endpoints compatible   Ggml   Gguf   Llama   Q8   Quantized   Region:us

Llama2 7b Gguf Yakovlev Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Llama2 7B Gguf Yakovlev (evilfreelancer/llama2_7b_gguf_yakovlev)

Llama2 7B Gguf Yakovlev Parameters and Internals

LLM NameLlama2 7b Gguf Yakovlev
Repository ๐Ÿค—https://huggingface.co/evilfreelancer/llama2_7b_gguf_yakovlev 
Model Size7b
Required VRAM7.2 GB
Updated2024-12-22
Maintainerevilfreelancer
Model Typellama
Model Files  7.2 GB
GGML QuantizationYes
GGUF QuantizationYes
Quantization Typegguf|ggml|q8
Model ArchitectureLlamaForCausalLM
Licensemit
Context Length4096
Model Max Length4096
Transformers Version4.31.0.dev0
Vocabulary Size32000
Torch Data Typefloat16

Best Alternatives to Llama2 7B Gguf Yakovlev

Best Alternatives
Context / RAM
Downloads
Likes
Chef Ai32K / 14.4 GB240
...lumiX 32K Instruct Q4 K M GGUF32K / 4.1 GB113
PULI LlumiX 32K Q4 K M GGUF32K / 4.1 GB71
Openthaigpt 1.0.0 7B Chat4K / 13.7 GB97816
Chinese Llama 2 7B Gguf4K / 2.6 GB4314
...hat Hf Phr Mental Therapy GGUF4K / 1.5 GB180
Llama GGUF4K / 13.5 GB200
...7B Chat Hf Function Calling V24K / 13.5 GB716130
Llama2 7B Text Sql Gguf4K / 4.1 GB420
Vizuosense GGML Q24K / 2.8 GB111
Note: green Score (e.g. "73.2") means that the model is better than evilfreelancer/llama2_7b_gguf_yakovlev.

Rank the Llama2 7B Gguf Yakovlev Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 40066 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241217