Mirrors
/
waifu-diffusion
mirror of https://github.com/harubaru/waifu-diffusion.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

oops forgot layer norm 

this is probably why i was getting garbage in training
This commit is contained in:
harubaru 2022-10-13 01:39:01 -07:00
parent adbbc73e19
commit c4d8e967e9
1 changed files with 1 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
ldm/modules/encoders/modules.py
View File

@ -158,6 +158,7 @@ class FrozenCLIPEmbedder(AbstractEncoder):
if self.penultimate: if self.penultimate:
z = outputs.hidden_states[-2] # simple enough z = outputs.hidden_states[-2] # simple enough
z = self.transformer.text_model.final_layer_norm(z)
else: else:
z = outputs.last_hidden_state z = outputs.last_hidden_state