Model Type | Language model, Chat model |
|
Use Cases |
Areas: | Chat in German and English |
|
Limitations: | Not received alignment or comprehensive instruction finetuning |
|
|
Additional Notes | This model is a proof of concept and further finetuning is necessary. It is not fully evaluated and most fine-tuning data is automatically translated from English, which may not lead to high-quality data. |
|
Supported Languages | deu (German language support), eng (English language support) |
|
Training Details |
Data Sources: | Proprietary text collected from the internet |
|
Data Volume: | Limited due to GPU constraints |
|
Methodology: | LoRA finetuning; initial finetuning with English and German data |
|
Context Length: | |
Hardware Used: | |
Model Architecture: | |
|