LLM EXPLORER
 LLM Explorer: A Curated Large Language Model Directory and Analytics
Dark Theme
  LLM  List    LLM Hosting    LLM Leaderboards    Blog    Newsfeed    Advertise

TeenyTinyLlama Doc 160M by mmoreirast

 »  All LLMs  »  mmoreirast  »  TeenyTinyLlama Doc 160M   URL Share it on

  10   
  Autotrain compatible   Conversational Dataset:mmoreirast/medicine-ev... Dataset:mmoreirast/medicine-tr...   Endpoints compatible   Llama   Llama2   Medicine   Pt   Region:us   Safetensors
Model Card on HF 🤗: https://huggingface.co/mmoreirast/TeenyTinyLlama-Doc-160m 

TeenyTinyLlama Doc 160M Benchmarks

LLME Score: 0.18623
nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
TeenyTinyLlama Doc 160M (mmoreirast/TeenyTinyLlama-Doc-160m)

TeenyTinyLlama Doc 160M Parameters and Internals

Model Type 
fine-tuned, text generation
Use Cases 
Areas:
research
Applications:
medical fine-tuning in Portuguese
Primary Use Cases:
study step-by-step process in fine-tuning models
Limitations:
hallucinations, biases and toxicity, unreliable code, language limitations, repetition and verbosity
Considerations:
Models should not be used in human-facing interactions without oversight.
Additional Notes 
The Doctor Llama model continues the research in fine-tuning language models specifically in the medical domain in Portuguese.
Supported Languages 
Portuguese (High proficiency)
Training Details 
Data Sources:
medicine-training-pt, medicine-evaluation-pt
Methodology:
Fine-tuning
Context Length:
2048
Training Time:
~9 hours
Hardware Used:
NVIDIA L4 GPU
Safety Evaluation 
Risk Categories:
hallucination, bias, toxicity
Ethical Considerations:
The model can produce biased or toxic content inherited from the training data.
Responsible Ai Considerations 
Accountability:
Users are responsible for conducting risk and bias assessments.
Mitigation Strategies:
Users should perform risk analysis and have human oversight in applications.
Input Output 
Input Format:
text
Accepted Modalities:
text
Output Format:
text
Performance Tips:
Ensure proper prompt structure and moderation of outputs.
LLM NameTeenyTinyLlama Doc 160M
Repository 🤗https://huggingface.co/mmoreirast/TeenyTinyLlama-Doc-160m 
Model Size160m
Required VRAM0 GB
Updated2024-08-24
Maintainermmoreirast
Model Typellama
Model Files  0.7 GB   1.3 GB   0.0 GB   0.0 GB
Supported Languagespt
Model ArchitectureLlamaForCausalLM
Licenseapache-2.0
Context Length2048
Model Max Length2048
Transformers Version4.38.0
Tokenizer ClassLlamaTokenizer
Padding Token<pad>
Vocabulary Size32002
Torch Data Typefloat32

Best Alternatives to TeenyTinyLlama Doc 160M

Best Alternatives
Context / RAM
Downloads
Likes
Mergekit Passthrough Jvjpjlj2K / 0.4 GB170
Llama 160M2K / 0 GB29214634
Llama 160M Chat V12K / 0.7 GB505318
Tucano 160M2K / 0.3 GB13691
Doctor Llama 160M2K / 0 GB630
Vicuna 160M2K / 0.7 GB30092
TeenyTinyLlama 160M2K / 0.7 GB5606
Onnx Llama 160M Chat V12K /  GB3351
Llama 160M Base2K / 0 GB1530
Spider Llama 160M2K / 0.7 GB540
Note: green Score (e.g. "73.2") means that the model is better than mmoreirast/TeenyTinyLlama-Doc-160m.

Rank the TeenyTinyLlama Doc 160M Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 44950 in total.

Email us: info@extractum.io. Our Privacy Policy  | Terms and Conditions  | Suggest an improvement.
Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227
  Support LLM Explorer