ChatGPT in an iOS Shortcut | Ultimate HomeKit Voice Assistant

I built the world's smartest home assistant using Siri Shortcuts by interacting with GPT-3, the powerful model behind ChatGPT. This home assistant can control your HomeKit home and even provide answers to a variety of questions around life, parenting, and more.

Building this assistant is made possible by using Shortcuts, a powerful automation tool on iOS, macOS or iPadOS. I came up with a clever prompt that lets me instruct GPT-3 to return a JSON format with specific actions and commands. Using if-else statements in Shortcuts, I could then handle the returns and trigger the necessary actions or simply answer the question.

What makes this home assistant so smart is its ability to understand and analyze responses. This works fundamentally differently from Siri or Alexa.

If you are interested in how I built it, head over to the detailed instructions:

[IanHobday]

Feels like Star Trek, or JARVIS. Really amazing.

[vivekpujaravp]

Phenomenal work. Vastly more powerful AI assistant. Really got my imagination going with what else would be possible.

[charlysgenaux]

you have just won 5 years in advance for apple with siri. you found the solution to their problems. you deserve a lot of recognition from them man. in your place, I would not have published how I did it, just the video. they would have come to ask you how you did.

[JoshuaNashcanada]

This is absolutely brilliant!

Would you be able to create a video, breaking down the steps to set this up on your phone or iPad? The page you created is unfortunately not that clear for the majority of people that would like to configure this incredible functionality.

[RastiMuzic]

This is absolutely insane! Can I ask how you were able to get it to respond with such low latency?

[schmimboschwumbo]

This is really great! Am I right in assuming that this shortcut should also be accessible via Siri on a HomePod? Thank you also for the explanation!

[keyser]

« I’m sorry Dave, i’m afraid i can’t do that… »

[pallemaniac]

This is so cool! Genius! I'm getting on with my integration right away! 😁 A moment ago I was just pondering over why Google assistant/Siri was so bad at controlling my smart home, so I started to search for integrations with ChatGPT, and voila, here you are! Thanks! 👏😂

[fortniteharambe]

This is really cool, but I think I may be even more impressed by the heated towel rack.

[pacificcoltrane]

Well done implementation to control Homekit. Although I've been sceptical of the benefits of using voice assistants to control my own automations (I'd prefer to have them run quietly in the background) - this may actually be useful.

This was brilliant.

[LabFlurry]

Dreamy. I hope it not takes too long for Google Assistant and Alexa being updated to this!

[Thmk]

Great work man, downloaded your shortcut and went messing around with it.

Got it working perfectly for my smart home and love how easy it is to change the behavior since it understands wat you want it to do.

[pogmemer]

This is amazing, please provide a tutorial

[TheNameOfJesus]

I found a way to have dictation on MacOS continually feeding my spoken words to a file, and I found a way to have the words in that file being sent to an app as soon as they appear. I started to implement my own version of Siri, but after about 10 commands I realized that that was a lot of work, so I dropped this project.

[jensenjensen]

Awesome. Could this also be done in some way with Google Assistant?

[kevinreutter]

Such a great demonstration! Thank you!

[travelIsVitaminOfLife]

This is sick. Really want to see the script. Oh I found your comment below! Super great job and thank you!

[jimdiroffii]

Apple is now scrambling to enable this by default. Great work on a good idea. What issues have you noticed now that you have it working so well?

[YouTubeUserLol]

Excellent job man. Best video ever watched.

[colincampbell]

Thanks for making this! I have adapted it ! You did the hard work! Thanks again