How Spotify’s AI-Driven Recommendations Work | WSJ Tech Behind

Spotify is the leader in music streaming, thanks in part to its AI-driven recommendation algorithm. But how do playlists like ‘Discover Weekly’ know you well enough to show you a personalized collection of new music?

Here’s an inside look at how the platform uses machine learning technology to customize several aspects of a user’s experience.

0:00 Spotify's personalized playlists
0:37 The evolution of Spotify’s recommendation algorithm
1:42 Using user data to create a map of songs and artists
2:59 Content-based filtering tech
4:09 The dangers of algorithmic bias
6:19 Spotify’s future plans in AI

Tech Behind
'The Tech Behind' explores the amazing engineering, computing, science and algorithms that power our favorite tech.

#Spotify #Tech #WSJ

[nithinsastrytellapuri]

We need more of these than the "briefing" videos

[RemotHuman]

the problem with these algorithms is they get stuck in a loop and it keeps recommending the same type of music to you or keeping you in a bubble. Related songs to a song are different for each user so it ends up showing you more of the same (you can test this yourself, make another spotify account and check, this also applies to top songs from an artist and even spotify official playlists). At least I notice this problem with youtube music recommendations, maybe spotify is better with regards to this (I don't use spotify that much) but I still don't like it.
Another problem besides getting stuck in a bubble and accidentally reinforcing certain cultures of music over others is that algorithms can be intentionally manipulated to devalue certain types of music/content and users won't notice. This gives a few tech company executives the power to shape public opinion, even to the point of changing results of elections for example, by subtly shifting what content is valued or devalued. (this also affects what content is created in the first place as creators make content that gets more views or money). This is more clearly a problem for writing/language content recommendations like twitter or tiktok style apps, but I think it could apply to music too, music is also speech and can also show people and/or normalize certain ideas.

[gallaxian]

I’m surprised that with the advanced algorithm and massive database, Spotify so rarely suggests a new song that I actually like.

[beornmorder]

I've tried every major streaming service... Spotify's algorithms are light years ahead of everyone. That + curated playlist = no competition.

[KnowDAOself]

I personally like Spotifys algorithm. It’s recommended so many good songs to me over the years. I’m sure it can be better, however it’s the best out there imo

[theartofbiz]

As seems to be the experience of many commentors here, algorithms/recommendations are becoming an increasingly crucial element of differentiation between Spotify & its competitors (Apple Music, YouTube Music, Amazon Music etc). Music streaming is a unique industry in that all the players have virtually all the music content available (unlike movie streaming like Netflix where they won't have all of the world's movies), and everyone is priced the same ($10.99/month in the US). This may be how Spotify can differentiate from the crowd, though only time will tell if its enough to help drive profitability in the future. I made a video on Spotify's persistent lack of profits and how they compare vs the other streaming platforms, may be interesting to you.

[smc]

Often, people get in my car with me and at some point they'll say "Ohh, I love this song! I've forgotten all about this song!" Then I answer back with something like, "That's why I still pay for SiriusXM. Even though I have Spotify Premium, you get stuck in loops on Spotify where you do hear the same songs over and over. With satellite radio, it's not trying to guess what I'll like so the variety is much wider."

[ambbarofficial]

I am from Chile, but Spotify assumes that we hear Mexican and Puerto Rican music here. This is like treating Canada and New Zealand as two provinces of the same country just because in both places people speak English.

[renalxdo]

Just make the shuffle actually shuffle. I keep hearing the same 5 songs on my 300 song playlist

[djtomoy]

To be honest I think YouTube does a much better job of serving me new interesting music mixes than any of these streaming services

[toofy]

Spotify recommended a playlist way better than m own. I'm usually picky with music, but have to admit they did a great job

[davidl]

spotify needs to introduce an option to give negative feedback on my home screen recommendations

[kidfreejones]

Spotify is the best except for their lack of hifi quality option. Us audiophiles who want to hear all that a artist and producer out in to a track miss out and with Tidal or Apple Music for example offering it, it's a shame Spotify doesn't want to.

[clintgolub]

The largest area Spotify lags is in classical music (which admittedly probably the majority of listeners aren’t impacted by) but Apple Music’s new ‘Classical’ app is insanely good in this respect and is actually “Primephonic” which Apple bought out, and rebranded as its own if anyone remembers that from last decade. It’s able to filter and categorize even better than ‘IDAGIO’ with insanely rich ‘Dolby Atmos’ recordings. 5-star experience all the way 👍

[RichB]

Spotify Algorithm = play the same 17 songs in a genre for eternity

[shmookins]

There is a personalized DJ AI out there?! That sound awesome!
I look forward to when it matures enough that I can give it input (via speech or text) to tell it what mood of music I want to listen to at any one time. Also, it would be cool if an AI can do remixes for me on the fly. A while back, I found that someone mixed Mozart with 'Like a Hurricane' and it is one of the best things I've heard.

[ArielNoname]

Very fancy, but when are they fixing the shuffle mode in Liked Songs?

[MNA]

I use Apple Music because of its unparalleled music quality, but I miss Pandora’s recommendations. Discovered so many of now my favorite bands, back in the day.

[Semper_Iratus]

AI is like Teflon, once it’s in the environment it will be impossible to remove.

[ambition]

0:01: 🎧 Spotify, the world's largest music streaming service, uses AI and collaborative filtering to personalize user experiences on the platform.
3:00: 🎵 Spotify's algorithm uses content-based filtering to make recommendations, but it has potential biases and limitations.
6:03: 🎧 Spotify's algorithm is not optimized for providing additional context about music, unlike Apple Music's new app.
Recap by Tammy AI