Generative Fill with AI and 3D

Hacker News

Hey all, You've probably seen projects that add objects to an image from a style or text prompt, like InteriorAI (levelsio) and Adobe Firefly. The prevalent issue with these diffusion-based inpainting approaches is that they don't yet have great conditioning on lighting, perspective, and structure. You'll often get incorrect or generic shadows; warped-looking objects; and distorted backgrounds. What is Fill 3D? Fill 3D is an exploration on doing generative fill in 3D to render ultra-realistic results that harmonize with the background image, using industry-standard path tracing, akin to compositing in Hollywood movies. How does it work? 1. Deproject: First, deproject an image to a 3D shell using both geometric and photometric cues from the input image. 2. Place: Draw rectangles and describe what you want in them, akin to Photoshop's Generative Fill feature. 3. Render: Use good ol' path tracing to render ultra-realistic results. Why Fill 3D? + The results are insanely realistic (see video in the github repo, or on the website). + Fast enough: Currently, generations take 40-80 seconds. Diffusion takes ~10seconds, so we're slower, but for the level of realism, it's pretty good. + Potential applications: I'm thinking of virtual staging in real estate media, what do you think? Check it out at https://fill3d.ai + There's API access! :D + Right now, you need an image of an empty room. Will loosen this restriction over time. Fill 3D is built on Function ( https://fxn.ai ). With Function, I can run the Python functions that do the steps above on powerful GPUs with only code (no Dockerfile, YAML, k8s, etc), and invoke them from just about anywhere. I'm the founder of fxn. Tell me what you think!! PS: This is my first Show HN, so please be nice :)

Visit product View on Hacker NewsSep 28, 2023

Share card

Actual performance

360points

102comments

Made the leaderboard

Launch Intel predictions

Analyze your own launch →

Indie HackersFits the IH revenue-focused audience · Missing: supports, reddit linkedin, podcasting

86%86% predicted probability of success on Indie Hackers, based on ML models trained on real launch data.

best fitHighest predicted score across all platforms for this description.

Product HuntOn track for Day 1 leaderboard · Strong signals: dock, using, code · Missing: mac, agents, macos

86%86% predicted probability of success on Product Hunt, based on ML models trained on real launch data.

Hacker NewsStrong engagement from HN community · Strong signals: ide, io · Missing: https docs, excited, just released

60%60% predicted probability of success on Hacker News, based on ML models trained on real launch data.

nativeThis product was originally launched on this platform.

TrustMRRLess likely to generate early MRR · Strong signals: video · Missing: mobile apps, ios, personal

49%49% predicted probability of success on TrustMRR, based on ML models trained on real launch data.

AppSumoMay struggle as an AppSumo deal · Missing: plus, platform, intuitive

34%34% predicted probability of success on AppSumo, based on ML models trained on real launch data.

Acquire.comPre-revenue stage for this audience · Missing: arr, mrr, revenue

16%16% predicted probability of success on Acquire.com, based on ML models trained on real launch data.

BetaListMay not resonate with beta-testers · Missing: web3, chat, crypto

0%0% predicted probability of success on BetaList, based on ML models trained on real launch data.

Correct prediction on native model

Similar products

Petri Dish – Generative Flocking47%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Petri Dish – Generative Flocking

Hacker News5

Generative Artistry47%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Generative Artistry

Hacker News3

Ob1: Generative Back Ends70%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Ob1: Generative Back Ends

Hacker News11

Generative Impressionism47%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Generative Impressionism

Hacker News2

Extendimage.ai 2.0 – Generative image outpainting30%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Extendimage.ai 2.0 – Generative image outpainting

Hacker News2

Soundescape – Generative 3D audio environments for focused work59%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Soundescape – Generative 3D audio environments for focused work

Hacker News9

SapientML – Generative AutoML for Tabular Data48%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

SapientML – Generative AutoML for Tabular Data

Hacker News82

GrandpaCAD52%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Modeling for 3D Printers with AI

Indie Hackers1$200/moai

Generative 3D Assets in Blender55%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Generative 3D Assets in Blender

Hacker News1

Interactive and Generative Impressionist Paintings60%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Interactive and Generative Impressionist Paintings

Hacker News4

Browse all products Analyze your launch