Create an AI Voice Character app only using AI in less than 40 min (Cursor, Next.js, Daily Bots)

In this episode, I am joined by Eric Min Jun Kim, an engineer who’s focused unbuilding consumer AI apps , we dive deep into the process of building character voice apps only using AI. Eric shares his process and demonstrates how to use tools such as Daily Bots, Cursor AI and Next js, to create and deploy apps in hours. Learn how to launch your next startup without needing to know how to code!

00:00 Intro
03:01 Key tools for building voice AI and setting up
06:55 Testing Audio Functionality
08:42 Understanding the Daily Bots Configuration
12:16 Characters are the “new apps”
14:38 Exploring Function Calling Documentation
17:35 Implementing Weather Functionality
25:26 Testing the Weather Bot
28:47 Deployment of the Application
32:16 Eric Demo’s his VTuber Voice App (get inspired)

1) The power of AI voice apps:
• Create wow-worthy demos in minutes
• 10X improvement over text-based chatbots
• Exciting & easy to build, even for coding newbies

2) Key tools for building voice AI:
•Daily - handles the heavy lifting (voice, LLMs, etc.)
• Daily Bots - simplifies LLM integration
• Cursor - AI-powered code editor

3) Setting up your AI assistant:
• Clone Daily Bots demo repo
• Get API key from Daily dashboard
• Run "yarn dev" command
• Access locally at localhost URL

4) Customizing your AI's personality:
•Edit the config file to create new characters
• Modify prompts to shape AI behavior
• Pro tip: Think of characters as the new apps!

5) Adding function calling (e.g., weather reports):
• Define tools in config file
• Align function names across files
• Get creative with responses (e.g., "raining cats and dogs")

6) Deploying your app:
• Install Vercel CLI
• Run "vercel" command in project directory
• App goes live in minutes!

7) Taking it further:
• Build iOS apps from web-based prototypes
• Explore more advanced tools like Pipecat for greater control
• Consider creating VTuber-style experiences

8) Key takeaways:
• Start small, build incrementally
• Leverage existing demos and tools
• Focus on creating viral-worthy moments
• The future of apps = AI characters!

9) Want to see the end result?
• Check out Eric's VTuber FaceTime app featuring Minji, an AI-powered anime character you can chat with!

Want more free ideas? I collect the best ideas from the pod and give them to you for free in a database. Most of them cost $0 to start (my fav)

🎯 To build your own portfolio businesses powered by community you might enjoy my membership.

You'll get my full course with all my secrets on building businesses, peer-groups to keep you accountable, business ideas every single month and more!

Spots are limited.

📬 Join my free newsletter to get weekly startup insights for free:

70,000+ people are already subscribed.

To improve your rankings your business on Google and using AI for SEO, sign up to

FIND ME ON SOCIAL

FIND ERIC ON SOCIAL

[GregIsenberg]

NEW CHARACTER UNLOCKED VOICE BOT ENGINEER ERIC HELLO! LIKE/COMMENT/SUBSCRIBE FOR MORE TUTORIALS IN YOUR FEED AND TO SAY THANK YOU

[theaccountantguy]

Vote here to see rhe full walkthrough of how the character was built from scratch or build another voice assistant like weatherman.

Technology is going places, so much to learn and build for people around.

Awesome video and great explanation by Eric and thanks Greg for bringing this up 🎉🎉

[pravanjanpatnaik]

What is the total monthly expenses for all 3rd party integrated?

[aimflow]

Always get great ideas when watching your videos, would it be possible to have a quick chat about startups, and your advice for a 15 year old trying to make his first startup

[bh]

This was absolutely amazing! Thank you so much for sharing this. I would love to see more content like this and more details on how to build these kinds of apps.

[FrankObserver]

I am going to create an app like this for me. I like the narration it provides. It will be great to hear narration outside of my head for once. ☕

[GraemeCrawford]

So many possibilities. A journal bot that you talk to at the end of each day to clear your mind? An AI friend to watch a series with you that none of your IRL friends like? An AI fashion advisor.

Even more wild that anyone willing to put in some focused learning effort can make these.

Guess my CS degree just became obsolete. 😅

[c.athompson]

Can this work for language learning? Like say training it to behave like a CIA language instructor?

[jamie_SF]

I would love to see a follow up to this with the release of the realtime api from open ai. Great video, thanks as always, v interesting

[quierovivirensanantoniotex]

this is great as always. is there a Tutorial ??

[MR-imvg]

Great episode Greg!!! Thank you guys so much! Any chance to get such kind of a tutorial for the "second step" as well? On how to deploy and connect the avatar to the voice bot? Really curious how Eric did that :)

[itsmnjn]

woohoo 🎉 so exciting to think abt characters as the new apps!!

[mingadas]

Finally understood what function calling is. Great explanation 👏

[givingswag]

How was Eric able to get the character to comment on the color and taste of the smoothie?

[garycambridge]

Dude, thanks for bringing these stories to the rest of us. There’s so much going on, it’s tough to decide in what area you’d like to focus

[seunghoim]

I'm really enjoying your videos. However, the screen share video always appears in a blurry state. The two of you on camera appear in normal quality, though.

[PawPerfectPets]

Connecting the user interface seems nontrivial. Awesome content. I would definitely be interested in the front-end deployment.

[nealbrown]

I watch at 1.2 speed but bro flew through this. Would be cool to see a proper walkthrough. Hopefully you’ll add the instructions to the ideas guide 🤞

[xbshp]

I'm finishing up a similar platform...even their UI is similar.

[coreyamccoy]

Me clicking like before the intro is over 😅😅