I built an GPT-4o powered Siri for Apple Devices and it's not an App

Hacker News

Share card

I built an GPT-4o powered Siri for Apple Devices and it's not an App

Hi HN community, It's 2024, ChatGPT has been around for about 2 years. And the voice assistant still couldn't understand you. So I decided to change that. I built an GPT-4o powered Siri to work across all apple devices. Setup in 1 minute. Simply say "Hey, Siri Ultra" to your iPhone, iPad, Mac, Apple Watch or Vision Pro to start a continuous chat with AI (even when your iPhone is locked). No need to buy new "AI Gadget" (sorry AI Pin, Rabbit R1, Limited Pendant, etc.), use what you already have. Nothing to learn, it use Siri voice interface, you may already know how to activate Siri so that you can stay in your flow. Even no new app to be installed! It's a shortcuts that takes 1 minute to setup and works across all your devices (thanks to iCloud sync). Besides conversation, it helps you get more done. Search information from the web, summarize, take a note, call a number, take a photo (yes, it has VISION!), etc... You can get from question to answer, from problem to results ultra fast all in one single conversation. checkout the demo video at YT channel: @shortcuts-ai (sorry Arc Call) Siri voice interface is not the only way to activate it, you can type your message too, here are a list of ways you can get start (pick what you feel comfortable): 1. "Siri Ultra or Hi Siri Ultra" on lock screen or any screen when unlocked (iOS, WatchOS, MacOS, VisionOS, you need to enable this in "Siri and Search" settings) 3. Hold power button on iPhone, iPad or Watch, then say "Ultra", 4. Press speech key or click Siri status bar icon on Mac, then say "Ultra" (need to enable in setting) 5. Use shortcut widget on lock screen then click on it to start chat by typing 6. Add shortcut to home screen on iPhone or iPad, then click on it to start chat by typing. Best part you can customize icon and name to it. 7. Bind iPhone 15 action button to the shortcut to start chat by typing 8. Click on shortcut icon on the Mac status bar to start chat by typing 9. Share a website, image or whatever to "Ultra", then start chat by typing. Even better, the item you shared can be used as a context, so that you can ask it anything about it or ask it to summarize to your note. 10. ... I think this is yet the fastest and easiest AI experience you can get. Features that I'm working on: 1. Customize your assistant: name, language, system prompt, platform, model, AI api base url. So that it can really work for you in the best way you like and speak in your language. 2. Integrate more functionalities executed both on remote and on device. Such as share a PDF with Ultra, then get "Chat With PDF" experience, even on an iPhone! 3. Hey Siri Ultra, pick up from our last conversation... If you have ideas or encounter problems, feel free to reach out on X: @DavidWShadow