MultiMatte, a Promptable Image Background Removal Model

Hacker News

Share card

MultiMatte, a Promptable Image Background Removal Model

Hey HN, I'm Shreyash from Feyn. We help companies build custom models from their data. Today we're releasing MultiMatte, a background removal model you can aim with words. Name an object in your image. MultiMatte keeps just that thing, and removes everything else. Try it out on your images: https://usefeyn.com/multimatte/ . Demo video: https://youtu.be/XZ5BJWAkOjs MultiMatte is open source. Build with it using our NoBg library https://github.com/feyninc/nobg . Model card here: https://hf.co/feyninc/multimatte MultiMatte is the second iteration of our background removal models. The first was FeyNoBg, which we released here https://news.ycombinator.com/item?id=49072462 . The big upgrade is promptability. Most models keep all foreground elements when cutting the background. MultiMatte lets you prompt the exact objects you want to keep and remove everything else. For example, If you have an image with a dog and a bowl, you can ask MultiMatte to keep just the dog. MultiMatte is built on Meta's SAM 3, a concept-promptable detector that already understands phrases. Our biggest change was in masking. Instead of binary masks that classify each pixel as being inside or outside an object, MultiMatte uses alpha mattes that assign an opacity value to each pixel, with respect to an object. This allows us to better represent hair, fur, motion blur, and other kinds of fuzzy boundaries. Across all our measured benchmarks, MultiMatte shows a step improvement over SAM 3. On DIS5K, S-measure rises from 0.674 to 0.908 (a 34.6% relative gain), and on DUT-OMRON from 0.792 to 0.901 (13.7%). Our blog covers more of the training details and results https://usefeyn.com/blog/multimatte . Happy to answer any questions!