Newton Eyes – AI-powered vision companion for the visually challenged

Hacker News

Share card

Newton Eyes – AI-powered vision companion for the visually challenged

Hi HN, I'm excited to be working on Newton Eyes, an AI-powered app designed to be a vision companion for the visually challenged. By simply taking a picture, users receive a detailed description of their surroundings, enabling them to perceive the world in ways previously unimaginable. Features -------- AI-Driven Descriptions: Capture photos with your camera to get detailed, accurate descriptions, helping you understand your surroundings better. Voice Input and Feedback: Interact with the app through voice commands and receive audio feedback, making it fully accessible for visually impaired users. Intuitive Interface: Designed with accessibility in mind, ensuring ease of use for all users. Multi-Language & Talkback Support: Works with accessibility features like Talkback and supports Indian languages like Hindi, Telugu, Tamil, Malayalam, and Kannada. How It Works -------- Identify Objects: Get detailed descriptions of photos captured with your camera. Voice-Powered Interactivity: Use voice commands to interact with the app and receive audio feedback. Settings: Customize verbosity, enable/disable the "describe pic" feature, and choose between camera or gallery for image selection. Download : https://play.google.com/store/apps/details?id=co.tanay.newto... Check out the website: https://newton-eyes.app/ I'd love to hear your thoughts and feedback! Alternatives: BeMyEyes provides a similar functionality through their recent addition BeMyAI. This is a late post. While this looked fancy at the time of launch, the previews from OpenAI in March that showed LiveVideo interactions definitely make this look dated. What was a surprising learning to me is that when I worked with a couple of blind schools in India (in February 2024) in taking initial feedback, they were surprised and excited to use it. What is unfortunate is that - by that time BeMyAI existed and was easily accessible to them, and ideally they should have been making the best of it already by then. So more than the tools required, coaching and enabling disabled people on the tools they have at their disposal looks to be a larger challenge than the availability of the tools themselves! To do: Google Single Sign On (currently has a simple email based signup) Tanay