Which Python Package Manager Should You Use?

In this episode of AI Adventures, Yufeng discusses some of the options available when it comes to managing your Python environment for machine learning and data science, and helps you make an informed decision based on your needs.

Resources:

#AIAdventures

[MouldyCheesePie]

Now i finally fkn understand packages and virtual libraries. Spent hours confused about this yesterday... The youtube algorithm is just too good, it knows exactly what I need.

[GregoryYepes]

Fantastic video and super useful. Thanks for sharing!

[amdenis]

You can, and too often will, get difficult to unravel conflicts when using two alternative pacman environments such as pyenv along with conda. The problem is that there are significant discrepancies between their dependencies/conflicts look-up tables. Also, the complexity of interactions when adding pipelining (e.g. Kubeflow, Airflow, etc), can become even more problematic, since a lot less real life usage testing generally occurs across those two, verses even bare in-environment pip usage (i.e. no assumptions made via a limited number of testers, which would be the case with pyenv competing with Conda/AC).

[meljuncortes]

Very good explanation and elaboration. I like this kind of demo where there is a direct elaboration of the topics unlike other video tutorial difficult to understand beside of the accent of language.

[jorgeastiazaran]

Thanks for your clarification.
I was struggling to understand the differences between them, since I was following different tutorials on ML and they use different methods to manage their Venvs.

[vvzen]

Anaconda/miniconda can actually handle the python version too, it’s kinda the main goal. It’s a bit sad that he missed that point. Also conda is meant as a way to handle lower level libraries too, like c++ dependencies, not just pure python packages.

[stevequan]

Thank you for sharing! Anaconda is kinda "too well packaged/organized", I uninstalled is but only keeping miniconda then combining with venv.

[bijenderkumar]

I mostly work in nodejs and sometime I have to use python which makes me confused about which package manager to choose, your explaination help me clarifying the differences between them. thanks!

[dryogeshbhirud]

awesome presentation with great video editing. which software did u use to edit the video?

[amburghermozzarella]

thank you for the video!

how can I install a python library that I created and use it in anaconda? I need it to create power bi scripts

[Aka]

I like using the jupyter docker images for data science stuff

[AndrewStorey]

Great video. What are your thoughts on using Docker for this?

[RenanBenedicto]

Thank you!
It was so easy to understand and I could share with my teammates.
Could you please post a video explaining maven and how use it to manage and compile Java for DataFlow and Apache Beam?

[rhythmsharma]

best video on python package manager 👍, i use anaconda and pip

[roshunepp]

I've been struggling with my anaconda env. Trying to update my python version to 3.9.6 but it's been running for 3 days dealing with conflicts. It's partially my fault for wanting the latest in conda navigator and not leaving well enough alone with 3.9.4.

[rudeadyet]

I use pyenv and pyenv-virtualenv. A bit confusing at the beginning, but once you begin to understand, it’s like a butter.

[matejjukic]

Do you know how to resolve conflict between packages? I need 2 different versions of the same package for my code to work but pip deinstalls the older and installs only the newer.

[enstein]

I use anaconda for separation and pip for package management 😅

[marcpanther]

Is `virtualenv` still useful given that `venv` is now part of Python 3?

[rezamirkhani]

I use miniconda but I'll give pyenv a go to see what it can do