FDA Guidance Zephyr 7B Beta PEFT by yitzshapiro

 ยป  All LLMs  ยป  yitzshapiro  ยป  FDA Guidance Zephyr 7B Beta PEFT   URL Share it on

  Autotrain   Conversational   Endpoints compatible   Fda   Lora   Peft   Pharma   Region:us   Regulatory   Safetensors   Tensorboard

FDA Guidance Zephyr 7B Beta PEFT Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
FDA Guidance Zephyr 7B Beta PEFT (yitzshapiro/FDA-guidance-zephyr-7b-beta-PEFT)

FDA Guidance Zephyr 7B Beta PEFT Parameters and Internals

Model Type 
text-generation, autotrain, peft
Additional Notes 
This model has been specifically fine-tuned with a synthetic dataset focusing on over 700 pharma-related FDA guidances to understand regulations and policies better.
Training Details 
Methodology:
PEFT adapter model trained on a synthetic dataset derived from over 700 pharma-related FDA guidances.
LLM NameFDA Guidance Zephyr 7B Beta PEFT
Repository ๐Ÿค—https://huggingface.co/yitzshapiro/FDA-guidance-zephyr-7b-beta-PEFT 
Model Size7b
Required VRAM0.2 GB
Updated2025-02-22
Maintaineryitzshapiro
Model Files  0.2 GB   0.0 GB
Model ArchitectureAutoModel
Licenseapache-2.0
Model Max Length2048
Is Biasednone
Tokenizer ClassLlamaTokenizer
Padding Token</s>
PEFT TypeLORA
LoRA ModelYes
PEFT Target Modulesv_proj|gate_proj|down_proj|o_proj|up_proj|k_proj|q_proj
LoRA Alpha32
LoRA Dropout0.05
R Param16

Best Alternatives to FDA Guidance Zephyr 7B Beta PEFT

Best Alternatives
Context / RAM
Downloads
Likes
TroL 7B32K / 17.3 GB36657
MoAI 7B32K / 17.7 GB19745
CoLLaVO 7B32K / 18.6 GB1721
... 7b 448 Qinstruct Preview V0.12K / 17.3 GB104
Janus Pro 7B0K / 14.8 GB4646573080
Autotrain Z7uyk Cwqtz0K / 0.2 GB70
Qwen 2.5 7B 1M RRP V1 Lora0K / 0.2 GB02
Medical Mixtral 7B V2k0K / 0.4 GB1010
Silicon Natsuki 7B0K / 14.4 GB251
...Tulu2 7b Writing Prompts 327680K / 8.5 GB780
Note: green Score (e.g. "73.2") means that the model is better than yitzshapiro/FDA-guidance-zephyr-7b-beta-PEFT.

Rank the FDA Guidance Zephyr 7B Beta PEFT Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 43470 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227