Model Type | language model, instruction following |
|
Use Cases |
Areas: | |
Applications: | text rewriting, summarization, function calling |
|
Primary Use Cases: | Assistive tools for generating English text |
|
Limitations: | Models generate English content, Factually inaccuracy possible, Logical inconsistencies and biases |
|
Considerations: | Verify important information and critically evaluate. |
|
|
Additional Notes | SmolLM2 models offer lightweight capabilities for on-device use. |
|
Supported Languages | |
Training Details |
Data Sources: | FineWeb-Edu, DCLM, The Stack, UltraFeedback, Synth-APIGen-v0.1 |
|
Data Volume: | |
Methodology: | Supervised fine-tuning (SFT), Direct Preference Optimization (DPO) |
|
Hardware Used: | |
Model Architecture: | |
|
Input Output | |