Ot

Otlet – Local LLM inference "inside" Postgres

Hacker News

Otlet – Local LLM inference "inside" Postgres

I’ve been working on Otlet, a Postgres extension for running local LLM inference “inside” Postgres (inference runs in a background worker, while Postgres stores the jobs, inputs, outputs, and receipts) I started it while working on an entity resolution problem (determining which rows in a table refer to the same entity). The data was already in Postgres, but using a model meant pulling rows into another process and then writing the results back. I wanted to see whether I could keep more of that workflow in the database right next to where the data lives Right now Otlet lets you start model work from SQL, require structured output, keep a record of each run, review proposed writes before they touch source data, etc. The example in the repo uses a small model for the first pass and a stronger model for uncertain cases This is just something I've been hacking on, not something I would recommend attempting to use in production yet. There’s a Docker demo if anyone wants to try it. I’m mostly posting it because I wanted to share the approach while it’s still rough to see it get ripped to shreds

Share card

Actual performance

2points
1comments
Did not reach leaderboard

Launch Intel predictions

Analyze your own launch →
Product HuntOn track for Day 1 leaderboard · Strong signals: model, dock, using · Missing: mac, agents, macos
94%94% predicted probability of success on Product Hunt, based on ML models trained on real launch data.
best fitHighest predicted score across all platforms for this description.
Indie HackersFits the IH revenue-focused audience · Strong signals: started · Missing: supports, reddit linkedin, podcasting
74%74% predicted probability of success on Indie Hackers, based on ML models trained on real launch data.
Hacker NewsStrong engagement from HN community · Strong signals: ide, io · Missing: https docs, excited, just released
71%71% predicted probability of success on Hacker News, based on ML models trained on real launch data.
nativeThis product was originally launched on this platform.
TrustMRRLess likely to generate early MRR · Missing: mobile apps, ios, personal
44%44% predicted probability of success on TrustMRR, based on ML models trained on real launch data.
AppSumoMay struggle as an AppSumo deal · Missing: plus, platform, intuitive
25%25% predicted probability of success on AppSumo, based on ML models trained on real launch data.
Acquire.comPre-revenue stage for this audience · Missing: arr, mrr, revenue
13%13% predicted probability of success on Acquire.com, based on ML models trained on real launch data.
BetaListMay not resonate with beta-testers · Missing: web3, chat, crypto
0%0% predicted probability of success on BetaList, based on ML models trained on real launch data.

Incorrect prediction on native model

Similar products

On
Onera – Private LLM Inference Inside AMD SEV-SNP Enclaves59%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Onera – Private LLM Inference Inside AMD SEV-SNP Enclaves

Hacker News1
LL
LLM Inference Requirements Profiler59%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

LLM Inference Requirements Profiler

Hacker News4
Bo
BonzAI – self-sovereign, local LLM inference in the browser62%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

BonzAI – self-sovereign, local LLM inference in the browser

Hacker News5
Pg
PgModeler – EER Diagramming for postgres73%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

PgModeler – EER Diagramming for postgres

Hacker News9
Me
Merging RethinkDB and Postgres with GraphQL79%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Merging RethinkDB and Postgres with GraphQL

Hacker News6
Fi
First experiment wih Vertx,Vue,Postgres48%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

First experiment wih Vertx,Vue,Postgres

Hacker News1
Lo
Logchain – ClickHouse/Postgres gRPC hook for logrus81%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Logchain – ClickHouse/Postgres gRPC hook for logrus

Hacker News3
pg
pglockanalyze - See the locks your Postgres migrations will acquire59%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

pglockanalyze - See the locks your Postgres migrations will acquire

Hacker News8
No
Now supporting MySQL, Postgres, Redis, Mongo60%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Now supporting MySQL, Postgres, Redis, Mongo

Hacker News3
Gr
GraphQL for Postgres83%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

GraphQL for Postgres

Hacker News195