mrq/ai-voice-cloning
31
74
Fork 43
Code Issues 223 Pull Requests 5 Packages Projects Releases Wiki Activity

Update 'Training'

mrq 2023-03-12 05:58:51 +00:00
parent aec298b553
commit 6e880d189a
1 changed files with 7 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

7
Training.md

@ -107,6 +107,13 @@ If you're looking to quickly get something trained in under 100 epochs, these se
However, if you want accuracy, I suggest an LR of 1e-5 (0.00001), as longer training at low LRs definitely make the best models.
The learning rate is definitely important, as:
* too large of a learning rate will have it very hard for it to land at the absolute minimum
* too little of a learning rate and it will either:
- take much much longer to reach the absolute minimum, if in the right well
- get stuck at the local minimum, and never can find the absolute minimum
+ LR restarts help alleviate this, as it will "shake" things out of any local-but-not-absolute minimums.
### Resuming Training
You can easily resume from a previous training state within the web UI as well.