Picture Yourself with Stable Diffusion

A quick tutorial about creating your own Stable Diffusion model in four easy steps, using just a few photos of yourself and training them with Dreambooth.

All you need to do is running the free fast-Dreambooth notebook by theLastBen, using Google Colab, to create your Custom model and then import it into a local Stable Diffusion app, like Automatic1111.

To watch some more great music videos created with StableDiffusion, Unreal Engine and Blender, visit our YouTube music channel:

----------------------------

Chapters:
00:00 Intro
00:22 Four easy steps to create your Stable Diffusion model
01:59 Preparing & uploading your photos
03:27 Training your model with Dreambooth
06:57 Downloading and importing your model into Automatic1111
07:51 How to use your model
08:25 Sample Prompts

Workflow:
----------------
Take 15 portrait photos (more or less),
good lighting and contrast, no hard shadows, face fully visible
no other people, different backgrounds, different angles, different expressions

Rename the 512 x 512 px photos, using a unique expression, which will be the trigger word for using it in prompts. All the photos should have the same name plus a sequence number (veroLab (1).png, veroLab (2).png ... veroLab (15).png). Leave a space between the keyword and the sequence number.

If you want to train several people into one model, rename the photos of each person with a different keyword (sophieLab (1).png, sophieLab (2).png, ... geraldLab (1).png, geraldLab (2).png)

Upload the renamed images into a new folder on your Google Drive. (If you haven't got a Google Drive, create a free Gmail address on Google and log into your browser first)

Open the lastBen fast-Dreambooth notebook on Google Colab to train your model (detailed explanation in the video)

Download the trained model from your Google Drive and import it into your StableDiffusion App. I would recommend Automatic1111 but there are also alternatives available

Local installation guide for Automatic1111 on a Windows-PC:
and on a Mac with Apple Silicon:

other SD Apps:

Downloading custom models for Stable Diffusion:

-----------------------------------------

Some great Youtube channels, covering Stable Diffusion:

#stablediffusion #automatic1111 #dreambooth

[katieweiss]

Absolutely brilliant!! I can't thank you enough. I am now addicted to generating images in Stable Diffusion from self-models following this tutorial. So fantastic I could hug you. 😃

[ruanth]

This is an excellent guide!. I followed this step by step and it worked! can't thank you enough for the clarity of this tutorial. honeslty I think your channel is underrated. If I had one request it would be to ask for that prompt in the final section in your description, or perhaps prompt styles/guidelines that would work best with this trained model. Thanks again!

[burakelmas]

It really works. It will be very helpful for those who do not have a powerful graphics card but want to create a ckpt model. I've been looking for something like this for a few days. Thanks.👌

[gingerginy]

Thank you so much fow this easy and detailed tutorial! im a total noob with computers and very new to stable diffusion and until this video i was just confused and intimidated because i dot know any of these words and couldt follow. but this time i made it and it worked and tbh it was so much easier than expected... thx a lot!!!

[vipbossman]

I am subscribed. Can you make a tutorial on how to train a model locally using your own computer ?

[h.o]

Please tell me about the difference between learning objects (people etc.) and learning concepts (painting style, etc.). Thank you very much. The explanation was very easy to understand, and I am grateful.

[arek.szumacher]

Any solution for

AttributeError: 'NoneType' object has no attribute 'pop'

after try load model?

[TurtleTorture]

bro you go step by step and then at 8:13 you just quickly selected multiple specific options and styles that you did not describe in the video, and did not describe how to get those styles for 1111 for first time users like me. Gave me surprisingly different results when I first tried it myself - I appreciate the rest of the video though and will continue researching how to make better portrait photos

[robcalif]

Tried running this but errored out... in your video you have the safetensors check box, but the link in your comment section does not show it.

changing setting sd_model_checkpoint to Jen.ckpt [afdbcad2ef]: AttributeError
Traceback (most recent call last):
File "C:\SD\stable-diffusion-webui\modules\options.py", line 146, in set
option.onchange()
File "C:\SD\stable-diffusion-webui\modules\call_queue.py", line 13, in f
res = func(*args, **kwargs)
File "C:\SD\stable-diffusion-webui\modules\initialize_util.py", line 174, in <lambda>
shared.opts.onchange("sd_model_checkpoint", wrap_queued_call(lambda: sd_models.reload_model_weights()), call=False)
File "C:\SD\stable-diffusion-webui\modules\sd_models.py", line 773, in reload_model_weights
state_dict = get_checkpoint_state_dict(checkpoint_info, timer)
File "C:\SD\stable-diffusion-webui\modules\sd_models.py", line 330, in get_checkpoint_state_dict
res =
File "C:\SD\stable-diffusion-webui\modules\sd_models.py", line 314, in read_state_dict
sd =
File "C:\SD\stable-diffusion-webui\modules\sd_models.py", line 253, in
pl_sd = pl_sd.pop("state_dict", pl_sd)
AttributeError: 'NoneType' object has no attribute 'pop'

[ppimentell]

what if i wanted to generate pictures of two different real people in the same picture?

[jimmasessa]

Has something changed with this process? It seems like the "Safetensors" checkbox in the Model Download section is gone.

[chihsainchen]

does anyone know how to fix "Expected all tensors to be on the same device, but found at least two devices"? I followed the tutorial but alway got this error.

[raananberger]

I have done all the process but in the end stable diffusion don't let me to choose my custom model. One thing I notice is that my model is a ckpt file, and all the other models that I can choose ends with safetensors

[sarpsomer]

Good results. So don't you need text files for the images ?

[kanall]

5:01 in civitai you said that need that information don t see you saing about it. Ah one more thing my colab don t have safetensors check>>?? give me error

[socialistrevolt]

untimeError: Expected all tensors to be on the same device, but found at least two devices, cpu and cuda:0! (when checking argument for argument index in method wrapper_CUDA__index_select) Got this error

[levandejacob]

Thank you for a very easy to follow guide! Do you know a good guide that shows how to do the same with google collab but creating a Lora instead?

[mgnkhcv]

the safetensors check mark doesn't show up and i am unable to connect to a model. I am stuck at this point. thanks

[vyrilldk]

thank you, can traine kohya-LoRA-dreambooth?

[amssoporte]

Thanks, but when i try to load the model (.ckpt) it errors out... tried twice because i loaded the images with .jpg first and it error out. I changed to .png but still error...
What I notice is that "SafeTensor" option is missing in the google colab.

EDIT: NVM. I updated SD to latest version and it all worked. Thanks for the great tutorial!