Assertain V1.1 Quant Q4 by jlancaster36

 ยป  All LLMs  ยป  jlancaster36  ยป  Assertain V1.1 Quant Q4   URL Share it on

Base model:jlancaster36/code b...   En   Endpoints compatible   Gguf   License:apache-2.0   Llama   Q4   Quantized   Region:us   Unsloth

Rank the Assertain V1.1 Quant Q4 Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  
Assertain V1.1 Quant Q4 (jlancaster36/assertain-v1-1-quant-q4)

Best Alternatives to Assertain V1.1 Quant Q4

Best Alternatives
HF Rank
Likes 8B EarlyPrototype 0.4 GGUF0K /  GB61540
WizardHermes 2 Pro Llama 3 8B0K / 0 GB1731
Model LlamaGGUF0K / 0 GB270
Llama3 Inst Finetune Saxs Gguf0K / 0 GB260
Llama3 Finetune Saxs Gguf0K / 0 GB250
Wolf Coder Llama 8b Bnb 4bit0K / 0 GB210
...3 8B TechnicalReport Bf16 GGUF0K / 0 GB210
...ary Vietnamese Article Gguf V10K / 0.1 GB6171
Llama3 8b Flanv2 Cot0K / 0.2 GB361
Curso Llama3Finetune Unsloth0K / 0.2 GB680

Assertain V1.1 Quant Q4 Parameters and Internals

LLM NameAssertain V1.1 Quant Q4
RepositoryOpen on ๐Ÿค— 
Base Model(s)  Code Bagel Llama 3 8B V1.1   jlancaster36/code_bagel_llama-3-8b-v1.1
Model Size8b
Required VRAM4.9 GB
Model Typellama
Model Files  16.1 GB   4.9 GB
Supported Languagesen
GGUF QuantizationYes
Quantization Typegguf|q4
Model ArchitectureAutoModel

What open-source LLMs or SLMs are you in search of? 36243 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v2024042801