mrq/torchscale
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

fix a bug which overrides the default constructed output_projection when none is

Browse Source 
passed in
This commit is contained in:
Matthew Chang 2022-12-21 16:24:44 -06:00
parent 7e12b582e4
commit adcd995595
1 changed files with 0 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
torchscale/architecture/decoder.py
View File

@ -260,8 +260,6 @@ class Decoder(nn.Module):
else: else:
self.layer_norm = None self.layer_norm = None
self.output_projection = output_projection
self.self_attn_relative_position = None self.self_attn_relative_position = None
self.cross_attn_relative_position = None self.cross_attn_relative_position = None