deviandice/DL-Art-School
1
0
Fork 0
forked from mrq/DL-Art-School
Code Issues Pull Requests Packages Projects Releases Wiki Activity

whoops

Browse Source
This commit is contained in:
James Betker 2022-06-11 11:22:34 -06:00
parent 00b9f332ee
commit 999a140f9f
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
codes/models/audio/music/transformer_diffusion9.py
View File

@ -57,7 +57,7 @@ class DietAttentionBlock(TimestepBlock):
h = torch.cat([ah, h], dim=-1)
h = F.gelu(self.attnorm(h))
h = checkpoint(self.ff, h)
return h * self.exit_mult
return h * self.exit_mult + x
class TransformerDiffusion(nn.Module):