filmov
tv
Michal Wysokinski - Running Python code in parallel and asynchronously

Показать описание
"Running Python code in parallel and asynchronously
[EuroPython 2017 - Talk - 2017-07-11 - Anfiteatro 2]
[Rimini, Italy]
My outline will be:
1) What does it mean to run code in parallel in Python? How does it differ from concurrency? Can they be applied at the some time?
2) GIL and why it complicates parallelism in Python (CPython), but only to some extent.
3) Difference between a thread and a process from the OS point of view.
4) When parallelism in Python is useful and when to avoid it.
5) Description of how to achieve parallel execution in CPython and how to do it properly.
6) Possible traps when using parallel programming in Python.
7) What happens if the code runs both in parallel and asynchronously?
8) Is it really beneficial?
9) How such execution can be achieved?
As the outline shows I will focus on the parallel part as it is an important topic in our current time of multicore processors and multiprocessor systems.
The topic has been discussed a lot of times but mainly from the scientific point of view, where it's been used for speeding up calulcations time. I will not go into these use cases (e.g. using MPI) but rather discuss it from web development point of view (e.g. multi worker applications).
[EuroPython 2017 - Talk - 2017-07-11 - Anfiteatro 2]
[Rimini, Italy]
My outline will be:
1) What does it mean to run code in parallel in Python? How does it differ from concurrency? Can they be applied at the some time?
2) GIL and why it complicates parallelism in Python (CPython), but only to some extent.
3) Difference between a thread and a process from the OS point of view.
4) When parallelism in Python is useful and when to avoid it.
5) Description of how to achieve parallel execution in CPython and how to do it properly.
6) Possible traps when using parallel programming in Python.
7) What happens if the code runs both in parallel and asynchronously?
8) Is it really beneficial?
9) How such execution can be achieved?
As the outline shows I will focus on the parallel part as it is an important topic in our current time of multicore processors and multiprocessor systems.
The topic has been discussed a lot of times but mainly from the scientific point of view, where it's been used for speeding up calulcations time. I will not go into these use cases (e.g. using MPI) but rather discuss it from web development point of view (e.g. multi worker applications).
Michal Wysokinski - Running Python code in parallel and asynchronously
PyCon PL 2016: Michał Wysokiński 'Parallel Python'
Michal Wysokinski - AsyncIO in production - War Stories
Michał Wysokiński - AsyncIO in production - War Stories - PyCode Conference 2018
PyWaw #78 - AsyncIO in production - War Stories
Parallel Python (PHY479 - 2017)
The Many Faces of Concurrency in Python by Sagiv Malihi
Jyrki Pulliainen - How-To: Build a local Python community
🐍 Tech Forces meetup. Python: asynchronous programming
Michał Bultrowicz - Python microservices on PaaS done right
Concurrency and Parallelism From The Ground Up
Emmanuel Leblond - Trio: A pythonic way to do async programming
Ville Säävuori - Pythonic JavaScript for Web Developers
Writing robust, readable, and maintainable concurrent programs in Python - PyCon APAC 2018
Asyncio in production
Asyncio in the Wild
Scheduling Finite Difference Approximations for DAG-Modeled Large Scale Applications
Tim Großmann - Automating Instagram with Python and Selenium
[ENG] Lynn Root: 'asyncio in Practice: We Did It Wrong' / #PiterPy
Samuel Colvin - Python's Parallel Programming Possibilities - 4 levels of concurrency
SLCPython January 2019: New Year, New Python + Asyncio
Python 3 Async/Await: Better Concurrency
4Developers 2019: Deep Learning Atlas, Michał Karzyński
PyWaw #88 - AsyncIO and Music
Комментарии