Finetune, build and deploy LLMs with AIKit
Finetune, build and deploy LLMs with AIKit
Hi folks! AIKit is a side project of mine that's aimed to be a one-stop shop to easily and quickly get started to build, fine-tune and deploy large language models (LLMs) with only Docker! I recently added extensible finetuning interface to AIKit. AIKit uses Unsloth under-the-hood for fast and efficent fine tuning of a model. After finetuning, you can take the finetuned model and create a minimal container image for inference, which is OpenAI compatible powered by LocalAI, to create a seamless end-to-end experience. I would love any thoughts and feedback! Get started: https://sozercan.github.io/aikit Demo of finetuning Mistral with OpenHermes and then serving the model as a minimal container image: https://youtu.be/FZuVb-9i-94 https://twitter.com/sozercan/status/1769769695081546236
Share cardActual performance
Launch Intel predictions
Analyze your own launch →Incorrect prediction on native model
Similar products
Monolithization. Build Microservices – Deploy Monolith
GPTCache – Redis for LLMs
prompttest – pytest for LLMs
Deploy Keras without any configuration
LLMOne – Deploy LLMs from bare metal to production in hours
KraspAI Kompass – keep up with new LLMs
Build, Manage and deploy an API with no-code
LLMs in one platform for free
Deploy Erlang and PSQL in Seconds with Zeet
Build and Deploy as Continuations [video]