From 70e047a53bddda4e439ce453886ca52d65115560 Mon Sep 17 00:00:00 2001 From: Shuming Ma Date: Fri, 11 Aug 2023 11:26:19 +0800 Subject: [PATCH] Update README.md --- README.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/README.md b/README.md index fe66d75..e757cbb 100644 --- a/README.md +++ b/README.md @@ -155,7 +155,7 @@ We plan to provide more examples regarding different tasks (e.g. vision pretrain ### Stability Evaluation

- +

The training curve is smooth by using TorchScale, while the baseline Transformer cannot converge. @@ -163,7 +163,7 @@ The training curve is smooth by using TorchScale, while the baseline Transformer ### Scaling-up Experiments

- +

TorchScale supports arbitrary depths and widths, successfully scaling-up the models without pain.