Tinyllama 616M Cinder DPO With GGUF by Josephgflowers

 ยป  All LLMs  ยป  Josephgflowers  ยป  Tinyllama 616M Cinder DPO With GGUF   URL Share it on

  Autotrain compatible   Conversational   Endpoints compatible   Gguf   Llama   Quantized   Region:us   Safetensors

Tinyllama 616M Cinder DPO With GGUF Benchmarks

Tinyllama 616M Cinder DPO With GGUF (Josephgflowers/Tinyllama-616M-Cinder-DPO-With-GGUF)

Tinyllama 616M Cinder DPO With GGUF Parameters and Internals

Use Cases 
Considerations:
Model intended as a base that may require additional work
Additional Notes 
Intended for continued training and development, developer requests collaboration via TinyLlama Discord
Training Details 
Data Sources:
Reason with Cinder dataset, open orca, sharegpt, cinder, tiny textbooks
Methodology:
Model pruning and further training on specified datasets
Model Architecture:
Reduced from 22 layers to 11 layers
LLM NameTinyllama 616M Cinder DPO With GGUF
Repository ๐Ÿค—https://huggingface.co/Josephgflowers/Tinyllama-616M-Cinder-DPO-With-GGUF 
Model Size616m
Required VRAM1.2 GB
Updated2024-12-26
MaintainerJosephgflowers
Model Typellama
Model Files  1.2 GB   1.2 GB
GGUF QuantizationYes
Quantization Typegguf
Model ArchitectureLlamaForCausalLM
Licensemit
Context Length4096
Model Max Length4096
Transformers Version4.38.2
Tokenizer ClassLlamaTokenizer
Padding Token</s>
Vocabulary Size32000
Torch Data Typebfloat16

Best Alternatives to Tinyllama 616M Cinder DPO With GGUF

Best Alternatives
Context / RAM
Downloads
Likes
Tinyllama 616M Cinder2K / 0 GB4111
Note: green Score (e.g. "73.2") means that the model is better than Josephgflowers/Tinyllama-616M-Cinder-DPO-With-GGUF.

Rank the Tinyllama 616M Cinder DPO With GGUF Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 40248 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241217