Fi

Finetune, build and deploy LLMs with AIKit

Hacker News

Finetune, build and deploy LLMs with AIKit

Hi folks! AIKit is a side project of mine that's aimed to be a one-stop shop to easily and quickly get started to build, fine-tune and deploy large language models (LLMs) with only Docker! I recently added extensible finetuning interface to AIKit. AIKit uses Unsloth under-the-hood for fast and efficent fine tuning of a model. After finetuning, you can take the finetuned model and create a minimal container image for inference, which is OpenAI compatible powered by LocalAI, to create a seamless end-to-end experience. I would love any thoughts and feedback! Get started: https://sozercan.github.io/aikit Demo of finetuning Mistral with OpenHermes and then serving the model as a minimal container image: https://youtu.be/FZuVb-9i-94 https://twitter.com/sozercan/status/1769769695081546236

Share card

Actual performance

1points
Did not reach leaderboard

Launch Intel predictions

Analyze your own launch →
Product HuntOn track for Day 1 leaderboard · Strong signals: model, dock, models · Missing: mac, agents, macos
89%89% predicted probability of success on Product Hunt, based on ML models trained on real launch data.
best fitHighest predicted score across all platforms for this description.
Indie HackersFits the IH revenue-focused audience · Strong signals: started, compatible · Missing: supports, reddit linkedin, podcasting
88%88% predicted probability of success on Indie Hackers, based on ML models trained on real launch data.
Hacker NewsStrong engagement from HN community · Strong signals: ide, io · Missing: https docs, excited, just released
73%73% predicted probability of success on Hacker News, based on ML models trained on real launch data.
nativeThis product was originally launched on this platform.
TrustMRRLess likely to generate early MRR · Missing: mobile apps, ios, personal
37%37% predicted probability of success on TrustMRR, based on ML models trained on real launch data.
AppSumoMay struggle as an AppSumo deal · Strong signals: interface · Missing: plus, platform, intuitive
30%30% predicted probability of success on AppSumo, based on ML models trained on real launch data.
Acquire.comPre-revenue stage for this audience · Missing: arr, mrr, revenue
13%13% predicted probability of success on Acquire.com, based on ML models trained on real launch data.
BetaListMay not resonate with beta-testers · Missing: web3, chat, crypto
1%1% predicted probability of success on BetaList, based on ML models trained on real launch data.

Incorrect prediction on native model

Similar products

Mo
Monolithization. Build Microservices – Deploy Monolith65%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Monolithization. Build Microservices – Deploy Monolith

Hacker News7
GP
GPTCache – Redis for LLMs69%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

GPTCache – Redis for LLMs

Hacker News7
pr
prompttest – pytest for LLMs34%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

prompttest – pytest for LLMs

Hacker News2
De
Deploy Keras without any configuration55%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Deploy Keras without any configuration

Hacker News2
LL
LLMOne – Deploy LLMs from bare metal to production in hours53%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

LLMOne – Deploy LLMs from bare metal to production in hours

Hacker News5
Kr
KraspAI Kompass – keep up with new LLMs53%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

KraspAI Kompass – keep up with new LLMs

Hacker News1
Bu
Build, Manage and deploy an API with no-code57%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Build, Manage and deploy an API with no-code

Hacker News1
Integri
Integri42%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

LLMs in one platform for free

Indie Hackerscommitment-side-project
De
Deploy Erlang and PSQL in Seconds with Zeet72%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Deploy Erlang and PSQL in Seconds with Zeet

Hacker News7
Bu
Build and Deploy as Continuations [video]46%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Build and Deploy as Continuations [video]

Hacker News2