DL-Art-School

mrq/DL-Art-School

Fork 5

Commit Graph

Author	SHA1	Message	Date
James Betker	773753073f	More NSG improvements (v3) Move to a fully fixup residual network for the switch (no batch norms). Fix a bunch of other small bugs. Add in a temporary latent feed-forward from the bottom of the switch. Fix several initialization issues.	2020-06-29 20:26:51 -06:00
James Betker	4b82d0815d	NSG improvements - Just use resnet blocks for the multiplexer trunk of the generator - Every block initializes itself, rather than everything at the end - Cleans up some messy parts of the architecture, including unnecessary kernel sizes and places where BN is not used properly.	2020-06-29 10:09:51 -06:00
James Betker	978036e7b3	Add NestedSwitchGenerator An evolution of SwitchedResidualGenerator, this variant nests attention modules upon themselves to extend the representative capacity of the model significantly.	2020-06-28 21:22:05 -06:00

Author

SHA1

Message

Date

James Betker

773753073f

More NSG improvements (v3)

Move to a fully fixup residual network for the switch (no
batch norms). Fix a bunch of other small bugs. Add in a
temporary latent feed-forward from the bottom of the
switch. Fix several initialization issues.

2020-06-29 20:26:51 -06:00

James Betker

4b82d0815d

NSG improvements

- Just use resnet blocks for the multiplexer trunk of the generator
- Every block initializes itself, rather than everything at the end
- Cleans up some messy parts of the architecture, including unnecessary
  kernel sizes and places where BN is not used properly.

2020-06-29 10:09:51 -06:00

James Betker

978036e7b3

Add NestedSwitchGenerator

An evolution of SwitchedResidualGenerator, this variant nests attention
modules upon themselves to extend the representative capacity of the
model significantly.

2020-06-28 21:22:05 -06:00

3 Commits