mrq/torchscale
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Merge pull request #9 from MatthewChang/fix_output_projection_decoder

Browse Source 
fix a bug that overrides the default constructed output_projection
This commit is contained in:
Shuming Ma 2022-12-22 11:19:25 +08:00 committed by GitHub
commit 21ed0056d7
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 0 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
torchscale/architecture/decoder.py
View File

@ -260,8 +260,6 @@ class Decoder(nn.Module):
else: else:
self.layer_norm = None self.layer_norm = None
self.output_projection = output_projection
self.self_attn_relative_position = None self.self_attn_relative_position = None
self.cross_attn_relative_position = None self.cross_attn_relative_position = None