How to save thousands on your Databricks Jobs

preview_player
Показать описание
Рекомендации по теме
Комментарии
Автор

How to install private package in serverless compute? I used init_script with normal compute to add private package access details in /etc/pip.conf BUT with serverless, initi scripts can't be used

ngneerin
Автор

Excellent reminder! I got into this pitfall the first time since I was already testing/dev-ing with my AP cluster, I might as well use it to test the workflows - and left it there. Thankfully I realized it was incurring different costs.

Is there an easy way to monitor costs directly through Databricks?

RaiOkami
Автор

One of the challenge I have is, how to pass task specific parameter to Python file apart from job parameters in same job cluster. Can you please let me know how to do it .

anandahs
welcome to shbcf.ru