LLM EXPLORER
 LLM Explorer: A Curated Large Language Model Directory and Analytics
Dark Theme
  LLM  List    LLM Hosting    LLM Leaderboards    Blog    Newsfeed    Advertise

Zephyr 7B Alpha GPTQ by anezatra

 »  All LLMs  »  anezatra  »  Zephyr 7B Alpha GPTQ   URL Share it on

  2   
  Adapter Base model:adapter:thebloke/ze... Base model:thebloke/zephyr-7b-... Dataset:bitext/bitext-customer...   Finetuned   Generated from trainer   Gptq   Lora   Peft   Quantized   Region:us   Safetensors   Sft   Tensorboard   Trl
Model Card on HF 🤗: https://huggingface.co/anezatra/zephyr-7B-alpha-GPTQ 

Zephyr 7B Alpha GPTQ Benchmarks

LLME Score: 0.18944
nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Zephyr 7B Alpha GPTQ (anezatra/zephyr-7B-alpha-GPTQ)

Zephyr 7B Alpha GPTQ Parameters and Internals

Model Type 
text-generation
Additional Notes 
Large language models have been fine-tuned using hyperparameters such as learning_rate: 0.0002, train_batch_size: 8, eval_batch_size: 8, seed: 42, optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08, lr_scheduler_type: cosine, and training_steps: 250 with mixed_precision_training: Native AMP.
Training Details 
Data Sources:
bitext/Bitext-customer-support-llm-chatbot-training-dataset
Methodology:
Fine-tuning
LLM NameZephyr 7B Alpha GPTQ
Repository 🤗https://huggingface.co/anezatra/zephyr-7B-alpha-GPTQ 
Base Model(s)  Zephyr 7B Alpha GPTQ   TheBloke/zephyr-7B-alpha-GPTQ
Model Size7b
Required VRAM0 GB
Updated2024-12-23
Maintaineranezatra
Model Files  0.0 GB   0.0 GB
GPTQ QuantizationYes
Quantization Typegptq
Model ArchitectureAdapter
Licensemit
Is Biasednone
Tokenizer ClassLlamaTokenizer
Padding Token</s>
PEFT TypeLORA
LoRA ModelYes
PEFT Target Modulesv_proj|q_proj
LoRA Alpha16
LoRA Dropout0.05
R Param16

Best Alternatives to Zephyr 7B Alpha GPTQ

Best Alternatives
Context / RAM
Downloads
Likes
Term Qwen2 7 Json Lora0K / 0.1 GB70
LMS Chatbot0K / 0 GB50
Llama 2 7B Chat Text2code0K / 0 GB114
Selfbot 256 Mistral0K / 0.4 GB50
Thesa0K / 0 GB01
Futadom Mistral0K / 0.2 GB461
Humiliation Mistral0K / 0.2 GB431
Gnosis Reformatted Mistral0K / 0.2 GB170
Zephyr Finetuned Legal0K / 0 GB11
Typhoon 7B Chat Alpaca0K / 0 GB34
Note: green Score (e.g. "73.2") means that the model is better than anezatra/zephyr-7B-alpha-GPTQ.

Rank the Zephyr 7B Alpha GPTQ Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 40123 in total.

Email us: info@extractum.io. Our Privacy Policy  | Terms and Conditions  | Suggest an improvement.
Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241217
  Support LLM Explorer