HDBSCAN, Fast Density Based Clustering, the How and the Why - John Healy

preview_player
Показать описание
PyData NYC 2018

HDBSCAN is a popular hierarchical density based clustering algorithm with an efficient python implementation. In this talk we show how it works, why it works and why it should be among the first algorithms you use when exploring a new data set. Further we will show how we took an inherently O(n^2) algorithm and turned it into the O(nlogn) algorithm that is available in scikit-learn-contrib.

===

PyData is an educational program of NumFOCUS, a 501(c)3 non-profit organization in the United States. PyData provides a forum for the international community of users and developers of data analysis tools to share ideas and learn from each other. The global PyData network promotes discussion of best practices, new approaches, and emerging technologies for data management, processing, analytics, and visualization. PyData communities approach data science using many languages, including (but not limited to) Python, Julia, and R.

PyData conferences aim to be accessible and community-driven, with novice to advanced level presentations. PyData tutorials and talks bring attendees the latest project features along with cutting-edge use cases. 00:00 Welcome!
00:10 Help us add time stamps or captions to this video! See the description for details.

Рекомендации по теме
Комментарии
Автор

A very impressive presentation and algorithm! Thank you for teaching all this!

hannahnelson
Автор

this is exactly what I have been looking for! great presentation.

alexanderdevaux
Автор

Nice presentation, I see 200% confidence and eloquence

reocam
Автор

Wow I love the enthusiasm! It really makes it so much nicer to watch. Very insightful as well thank you very much!

MrRaisin
Автор

Absolutely fantastic presentation, thank you

rufus
Автор

Wow, what a great talk! Love the intuitive explanations and visuals. Super helpful. Thank you!

-beee-
Автор

Sorry has to comment because of the ass animation! Brilliant.

vampierkill
Автор

Thank you so much. It was exactly what I was looking for 🎉🎉

alaaelhadba
Автор

15:30 there might be a misprint in the formula: d(X_i, X_j), not d(X_j, X_j)

valeryzuev
Автор

Thank you for the super interesting talk! I was wondering if you have worked with the new HDBSCAN integrated in sklearn 1.3.0? Is it possible to draw the cluster tree with this implementation?

maximillianweil
Автор

Any idea why the GPU version of this method can't take a pre-computed distance matrix?

RoulDukeGonzo
Автор

can someone tell me about his linkedin or his full name please or how to connect to him

ahmedayman
Автор

The coloring of the tree at 14:00 is needlessly confusing. See figure 3a in their paper McInnes & Healy 2017 to clarify things

TrixieFromSanFran
Автор

clustering is highly driven by the formatting of how the data relates to itself
and is near impossible to accomplish using a single method of approach.

MVR_