GEITje-7B – A New Large Open Dutch Language Model
GEITje-7B – A New Large Open Dutch Language Model
Tried my hand at training a large open Dutch language model, for which the pickings are slim right now. GEITje is a large open Dutch language model with 7 billion parameters, based on Mistral 7B. I've continued pretraining it on 10 billion tokens of Dutch text. This has improved its Dutch language skills and increased its knowledge of Dutch topics. There's an experimental chat-finetuned model too, called GEITje-chat. I have to say the experience of gathering a dataset and training a model has been very educational for me. Being forced to deal with every detail yourself really deepens your understanding of a subject. It's all in the hands of the community now. Can't wait to see what they do with it! Want to try it out? There's a demo live at Hugging Face Spaces right now: https://huggingface.co/spaces/Rijgersberg/GEITje-7B-chat
Share cardActual performance
Launch Intel predictions
Analyze your own launch →Correct prediction on native model
Similar products
Personalizing Large Language Model Applications
Refuel-LLM, a large language model for data annotation and enrichment
Uminal – Large language model anyone can extend with new apps/skills
Sustinion - the large opinion collider (in spe)
LLM-A* – Large Language Model Enhanced Incremental Heuristic Search
BrainTripping - language model comedy
NCL – New Configuration Language
The Large Language Messenger
Open-source large model assert management platform
Get nice, large favicons by API