Bling Stable Lm 3B 4e1t V0 GPTQ by TheBloke

 ยป  All LLMs  ยป  TheBloke  ยป  Bling Stable Lm 3B 4e1t V0 GPTQ   URL Share it on

  4-bit   Autotrain compatible Base model:llmware/bling-stabl... Base model:quantized:llmware/b...   Custom code   Gptq   Quantized   Region:us   Safetensors   Stablelm epoch

Bling Stable Lm 3B 4e1t V0 GPTQ Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Bling Stable Lm 3B 4e1t V0 GPTQ (TheBloke/bling-stable-lm-3b-4e1t-v0-GPTQ)

Bling Stable Lm 3B 4e1t V0 GPTQ Parameters and Internals

Model Type 
Instruct-trained decoder
Use Cases 
Areas:
enterprise automation
Applications:
knowledge-intensive industries, financial services, legal and regulatory industries
Primary Use Cases:
question-answering, key-value extraction, summarization
Additional Notes 
BLING models are fine-tuned on a StabilityAI stablelm-3b-4e1t base model, targeted at smaller Instruct-following models in the 1B-3B parameter range.
Supported Languages 
english (native)
Training Details 
Data Sources:
distilled high-quality custom instruct datasets
Methodology:
RAG-instruct training
Model Architecture:
stabilityAI stablelm-3b-4e1t
Input Output 
Input Format:
Prompt formatted as ': {prompt} :'
Accepted Modalities:
text
Output Format:
Text
Performance Tips:
The BLING model benefits from closed-context inputs, with prompts structured in two parts: context and specific question or instruction.
LLM NameBling Stable Lm 3B 4e1t V0 GPTQ
Repository ๐Ÿค—https://huggingface.co/TheBloke/bling-stable-lm-3b-4e1t-v0-GPTQ 
Model NameBling Stable LM 3B 4E1T V0
Model Creatorllmware
Base Model(s)  Bling Stable Lm 3B 4e1t V0   llmware/bling-stable-lm-3b-4e1t-v0
Model Size3b
Required VRAM1.8 GB
Updated2025-02-05
MaintainerTheBloke
Model Typestablelm_epoch
Model Files  1.8 GB
GPTQ QuantizationYes
Quantization Typegptq
Model ArchitectureStableLMEpochForCausalLM
Licenseapache-2.0
Context Length4096
Model Max Length4096
Transformers Version4.36.0.dev0
Tokenizer ClassGPTNeoXTokenizer
Vocabulary Size50304
Torch Data Typebfloat16

Best Alternatives to Bling Stable Lm 3B 4e1t V0 GPTQ

Best Alternatives
Context / RAM
Downloads
Likes
Stable Code 3B GPTQ16K / 1.8 GB3112
Zephyr Quiklang 3B 4K GPTQ4K / 1.8 GB282
Zephyr Quiklang 3B GPTQ4K / 1.8 GB171
Dopeystableplats 3B V1 GPTQ4K / 1.8 GB290
Stablelm Zephyr 3B GPTQ4K / 1.8 GB2012
Rocket 3B GPTQ4K / 1.8 GB250
Nous Capybara 3B V1.9 GPTQ4K / 1.8 GB178
Akins 3B GPTQ4K / 1.8 GB242
Marx 3B V3 GPTQ4K / 1.8 GB172
Stable Code 3B Mlx16K / 5.6 GB41
Note: green Score (e.g. "73.2") means that the model is better than TheBloke/bling-stable-lm-3b-4e1t-v0-GPTQ.

Rank the Bling Stable Lm 3B 4e1t V0 GPTQ Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 42577 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227