Transcribe Twilio Phone Calls in Real-Time with AssemblyAI | JavaScript WebSockets Tutorial

Learn how to transcribe Twilio phone calls in real-time with AssemblyAI using JavaScript and websockets.
We use Twilio Media Streams and AssemblyAI's Real-Time Streaming Transcription for this.

References:

Docs:

▬▬▬▬▬▬▬▬▬▬▬▬ CONNECT ▬▬▬▬▬▬▬▬▬▬▬▬

▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬

Timestamps:
00:00 Demo
00:44 WebSockets + Server setup
02:56 Twilio Voice Streams
10:50 AssemblyAI Transcription
19:33 Create Website

#JavaScript

[dev_ression]

this is actually so cool, thanks for the tutorial bro!

[ryanoconnor]

Such a cool combination of different technologies

[prasantamondal]

Instead of twillo if you will show us example of direct usage of website navigator.usermedia, and direct recording and getting the transcript in realtime from assembly ai end, that will be more helpful for integration with the other usage context.

[AICreativityTime]

not working.I have downloaded your sourcecode from github, Then install the dependencies manually.replaces the API key of assembly ai, install ngrok and configure it.Then I copy the server address to twilio at when a calls come in.Did all the setup, A new call has connected.
Starting Media Stream
New Connection Initiated
New Connection Initiated
Call Has Ended all of this showing but in the website calls transcript is not coming.Can you help me sir?

[jpsl]

My friend we are using your solution but we have a problem, this only works for incoming calls, for outgoing calls the stream from twilio looks like S### and hears like it,
How do you handle the outgoing call stream.

The way we are doing it only works some times

[piyushpanchal]

from free account should i transcribe with this code ?

paid upgrade is mandatory ?

[nareshpurushotham]

Hi There, I'm getting websocket is not open error, don't know where I'm going wrong. I used same code receiving buffer data from twilio but when I try to send the data to assembly I'm getting websocket not open error. Please help on this.

[Ebizzill]

can it record and transcribe audio from the person on the other end ?