Kohya SS GUI How To Set Accelerate Config

preview_player
Показать описание
Many people having issues due to inaccurate Accelerate setup. This is how to setup to make it work properly

1-click installers and best configs for Kohya FLUX training :

Рекомендации по теме
Комментарии
Автор

i'm wondering about your take between FP16 and BF16. i'm aware about the change of range vs the floating points. i'm refering about practical difference in machine learning over random paterns in this case. one eminent Kohya ss contributer is pointing that it is the cause of the overall blurry details of SD1 and XL. Mostly caused by the choice of SAI going for Intel cluster GPU who only supports their bf16. sd3 is using FP16 but i cannot just link that to FP16 since it use a loseless VAE with many other differences on top of that this time around.
but i'm not qualified enough to gauge his take. so here the question for you :).
thanks for your hard work !

lefourbe
Автор

Looks like an useful install. Do you think it would work on RTX 3080 16gb vram?

WhySoBroke
Автор

Come on... that last option about numa efficency does NOT appear from me. Latest kohya 24.1.7 installation. And i have terrible problems getting kohya to go through a whole training. always chrash in the middle, or beginning, or when its 2 min left. was on win10, but even got win11 to try on. totally clean windows 11 with suggested installs. No luck, still chrash. and NO support on github.
I9, 64Gb RAM, rtx4080super 16Gb, tried both win 10 and win 11.

Erlandsson
visit shbcf.ru