Cerebras-GPT-2.7B finetuned on Stanford Alpaca dataset
Cerebras-GPT-2.7B finetuned on Stanford Alpaca dataset
Yes I know, this is yet another language model. I used PEFT to finetune the Cerebras-GPT-2.7B on Alpaca, which makes for a very very fast, coherent, albeit hallucinating model. It took 5 hours on a vast.ai machine at 29 cents an hour, so less than a dollar and a half to finetune. The repository contains steps to reproduce the model, the dataset, links to the merged-in model on huggingface, a colab notebook, and the LoRA weights. There's also a chatbot app, and a link to a ggml version of the model you can run via https://github.com/ggerganov/ggml on your CPU alone! Enjoy!
Share cardActual performance
Launch Intel predictions
Analyze your own launch →Incorrect prediction on native model
Similar products
Worldbuilding Experiments with GPT-3
Autosummarized HN (With GPT-3)
I composed a sonata with GPT-3 DaVinci-003 and you can too
GPT Classifies HN Titles
Visualized GPT
Hostage Negotiation with GPT-4
Roleplaying GPT
Not Hotdog GPT
Ikigai GPT
7GUIs in Hyphen by GPT