I open-sourced my AI toy company that runs on ESP32 and OpenAI realtime

Hacker News

Hi HN! Last year the project I launched here got a lot of good feedback on creating speech to speech AI on the ESP32. Recently I revamped the whole stack, iterated on that feedback and made our project fully open-source—all of the client, hardware, firmware code. This Github repo turns an ESP32-S3 into a realtime AI speech companion using the OpenAI Realtime API, Arduino WebSockets, Deno Edge Functions, and a full-stack web interface. You can talk to your own custom AI character, and it responds instantly. I couldn't find a resource that helped set up a reliable, secure websocket (WSS) AI speech to speech service. While there are several useful Text-To-Speech (TTS) and Speech-To-Text (STT) repos out there, I believe none gets Speech-To-Speech right. OpenAI launched an embedded-repo late last year which sets up WebRTC with ESP-IDF. However, it's not beginner friendly and doesn't have a server side component for business logic. This repo is an attempt at solving the above pains and creating a great speech to speech experience on Arduino with Secure Websockets using Edge Servers (with Deno/Supabase Edge Functions) for fast global connectivity and low latency.

Visit product View on Hacker NewsApr 22, 2025

Share card

Actual performance

177points

94comments

Made the leaderboard

Launch Intel predictions

Analyze your own launch →

Product HuntOn track for Day 1 leaderboard · Strong signals: openai, using, code · Missing: mac, agents, macos

96%96% predicted probability of success on Product Hunt, based on ML models trained on real launch data.

best fitHighest predicted score across all platforms for this description.

Hacker NewsStrong engagement from HN community · Strong signals: ide, io · Missing: https docs, excited, just released

75%75% predicted probability of success on Hacker News, based on ML models trained on real launch data.

nativeThis product was originally launched on this platform.

Indie HackersFits the IH revenue-focused audience · Missing: supports, reddit linkedin, podcasting

61%61% predicted probability of success on Indie Hackers, based on ML models trained on real launch data.

TrustMRRFits verified-revenue profile · Missing: mobile apps, ios, personal

52%52% predicted probability of success on TrustMRR, based on ML models trained on real launch data.

AppSumoMay struggle as an AppSumo deal · Strong signals: friendly, interface · Missing: plus, platform, intuitive

41%41% predicted probability of success on AppSumo, based on ML models trained on real launch data.

Acquire.comPre-revenue stage for this audience · Missing: arr, mrr, revenue

26%26% predicted probability of success on Acquire.com, based on ML models trained on real launch data.

BetaListMay not resonate with beta-testers · Missing: web3, chat, crypto

1%1% predicted probability of success on BetaList, based on ML models trained on real launch data.

Correct prediction on native model

Similar products

I Open-Sourced My AI Toy–ESP32, OpenAI Realtime API on Deno, Supabase69%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

I Open-Sourced My AI Toy–ESP32, OpenAI Realtime API on Deno, Supabase

Hacker News2

Realtime AI and Telephony and DTMF61%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Realtime AI and Telephony and DTMF

Hacker News2

Shareholder Zero31%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

AI runs this company. Subscribers outvote it.

Indie Hackers1ai

Pebble realtime bus departures in Sydney65%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Pebble realtime bus departures in Sydney

Hacker News3

Realtime DAO52%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Realtime DAO

Hacker News3

Realtime Spheretracing in WebGL66%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Realtime Spheretracing in WebGL

Hacker News1

Realtime Blackboard58%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Realtime Blackboard

Hacker News3

Realtime busses (websockets, leaflet and d3) (59%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Realtime busses (websockets, leaflet and d3) (

Hacker News1

gpt-realtime-1.5 by OpenAI94%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Tighter instruction adherence in speech agents

Product Hunt+303API

Polsia83%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

AI that runs your company while you sleep

Product Hunt+139Productivity

Browse all products Analyze your launch