Distributed Inference,Apply DL to WebRTC Video Frames via Redis Streams

Hacker News

Hi HN! I’m so excited to show my another open-source project here. It is a PoC project. Distributed Inference is a project to demonstrate an approach to designing cross-language and distributed pipeline in deep learning/machine learning domain, using WebRTC and Redis Streams. This project consists of multiple services, which are written in Go, Python, and TypeScript, running on Docker. It allows setting up multiple inference services in multiple host machines, in a distributed manner. It does RPC-like calls and service discovery via my other open-source projects, go-inventa and py-inventa, you can find them in my profile too. Also includes a monitoring stack configuration using Grafana, InfluxDB, Telegraf, and Prometheus. The main idea is: - Webcam video will be streamed to the Media Bridge service via WebRTC, - Media Bridge service will capture frame images from the video as JPEG images, pushes them to Redis Streams, - One of available Inference services will pop a JPEG image data from Redis Streams stream, execute YOLOX inference model, push detected objects' name, box coordinates, prediction score, and resolution to other Redis Streams stream, - The Signaling service listens and consumes the Redis Streams stream (predictions), sends the results to relevant participant (by participantId in the JSON) via WebSockets. - Web client will draw boxes for each prediction, and writes results to the browser console. Please check it out and I’d love to read your thoughts! https://github.com/adalkiran/distributed-inference

Visit product View on Hacker NewsFeb 5, 2023

Share card

Actual performance

5points

Did not reach leaderboard

Launch Intel predictions

Analyze your own launch →

Hacker NewsStrong engagement from HN community · Strong signals: excited, ide, pipe · Missing: https docs, just released, exist

74%74% predicted probability of success on Hacker News, based on ML models trained on real launch data.

nativeThis product was originally launched on this platform.

Indie HackersFits the IH revenue-focused audience · Missing: supports, reddit linkedin, podcasting

71%71% predicted probability of success on Indie Hackers, based on ML models trained on real launch data.

Product HuntOn track for Day 1 leaderboard · Strong signals: mac, model, dock · Missing: agents, macos, agent

71%71% predicted probability of success on Product Hunt, based on ML models trained on real launch data.

TrustMRRFits verified-revenue profile · Strong signals: video · Missing: mobile apps, ios, personal

52%52% predicted probability of success on TrustMRR, based on ML models trained on real launch data.

AppSumoMay struggle as an AppSumo deal · Strong signals: host, calls · Missing: plus, platform, intuitive

34%34% predicted probability of success on AppSumo, based on ML models trained on real launch data.

Acquire.comPre-revenue stage for this audience · Missing: arr, mrr, revenue

16%16% predicted probability of success on Acquire.com, based on ML models trained on real launch data.

BetaListMay not resonate with beta-testers · Missing: web3, chat, crypto

1%1% predicted probability of success on BetaList, based on ML models trained on real launch data.

Incorrect prediction on native model

Similar products

Piss off, publisher frames35%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Piss off, publisher frames

Hacker News1

NeuroFlow 55.8x video inference speedup for Vision Transformers PyTorch43%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

NeuroFlow 55.8x video inference speedup for Vision Transformers PyTorch

Hacker News8

Apply to MuckRock’s Thiel Fellowship51%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Apply to MuckRock’s Thiel Fellowship

Hacker News5

Never Apply Again61%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Never Apply Again

Hacker News5

Fundizr49%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Apply for grants, competitions, accelerators, govt funds

Indie Hackers1$980/mogovernment

Ten Ayahs47%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Apply and internalize the Qur'an as you memorize it.

Indie Hackers1b2c

TQNN55%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Fault-tolerant inference for noisy and imperfect data.

Indie Hackers1ai

We just launched MegaAI. It's a 4k30fps, 4W, 4TOPS inference powerhouse69%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

We just launched MegaAI. It's a 4k30fps, 4W, 4TOPS inference powerhouse

Hacker News3

AI in-betweening that generate in-between frames between keyframes25%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

AI in-betweening that generate in-between frames between keyframes

Hacker News1

LLM Inference Requirements Profiler59%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

LLM Inference Requirements Profiler

Hacker News4

Browse all products Analyze your launch