Doctor Llama 160M by mmoreirast

 ยป  All LLMs  ยป  mmoreirast  ยป  Doctor Llama 160M   URL Share it on

  Autotrain compatible   Conversational Dataset:mmoreirast/medicine-ev... Dataset:mmoreirast/medicine-tr...   Endpoints compatible   Llama   Llama2   Medicine   Pt   Region:us   Safetensors

Doctor Llama 160M Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Doctor Llama 160M (mmoreirast/Doctor-Llama-160m)

Doctor Llama 160M Parameters and Internals

Model Type 
fine-tuned, text generation
Use Cases 
Areas:
research
Applications:
medical fine-tuning in Portuguese
Primary Use Cases:
study step-by-step process in fine-tuning models
Limitations:
hallucinations, biases and toxicity, unreliable code, language limitations, repetition and verbosity
Considerations:
Models should not be used in human-facing interactions without oversight.
Additional Notes 
The Doctor Llama model continues the research in fine-tuning language models specifically in the medical domain in Portuguese.
Supported Languages 
Portuguese (High proficiency)
Training Details 
Data Sources:
medicine-training-pt, medicine-evaluation-pt
Methodology:
Fine-tuning
Context Length:
2048
Training Time:
~9 hours
Hardware Used:
NVIDIA L4 GPU
Safety Evaluation 
Risk Categories:
hallucination, bias, toxicity
Ethical Considerations:
The model can produce biased or toxic content inherited from the training data.
Responsible Ai Considerations 
Accountability:
Users are responsible for conducting risk and bias assessments.
Mitigation Strategies:
Users should perform risk analysis and have human oversight in applications.
Input Output 
Input Format:
text
Accepted Modalities:
text
Output Format:
text
Performance Tips:
Ensure proper prompt structure and moderation of outputs.
LLM NameDoctor Llama 160M
Repository ๐Ÿค—https://huggingface.co/mmoreirast/Doctor-Llama-160m 
Model Size160m
Required VRAM0 GB
Updated2025-01-24
Maintainermmoreirast
Model Typellama
Model Files  0.7 GB   1.3 GB   0.0 GB   0.0 GB
Supported Languagespt
Model ArchitectureLlamaForCausalLM
Licenseapache-2.0
Context Length2048
Model Max Length2048
Transformers Version4.38.0
Tokenizer ClassLlamaTokenizer
Padding Token<pad>
Vocabulary Size32002
Torch Data Typefloat32

Best Alternatives to Doctor Llama 160M

Best Alternatives
Context / RAM
Downloads
Likes
Llama 160M2K / 0 GB17634434
Llama 160M Chat V12K / 0.7 GB85419
TeenyTinyLlama Doc 160M2K / 0 GB100
Vicuna 160M2K / 0.7 GB119960
Vicuna 160M2K / 0.7 GB1573
TeenyTinyLlama 160M2K / 0.7 GB4816
Onnx Llama 160M Chat V12K /  GB1561
Llama 160M Base2K / 0 GB210
Spider Llama 160M2K / 0.7 GB140
Full Vicuna 160M2K / 0.7 GB1270
Note: green Score (e.g. "73.2") means that the model is better than mmoreirast/Doctor-Llama-160m.

Rank the Doctor Llama 160M Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 41817 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227