From 7f076093614a28abf75bf5e99de3a72ba6fe6c92 Mon Sep 17 00:00:00 2001 From: sunyt32 Date: Thu, 28 Sep 2023 14:26:56 +0000 Subject: [PATCH] update README.md --- README.md | 1 + 1 file changed, 1 insertion(+) diff --git a/README.md b/README.md index e757cbb..a7bd11a 100644 --- a/README.md +++ b/README.md @@ -19,6 +19,7 @@ Fundamental research to develop new architectures for foundation models and A(G) ## News +- October, 2023: Update RMSNorm and SwiGLU as the default module in RetNet - November, 2022: TorchScale 0.1.1 released [[Paper](https://arxiv.org/abs/2211.13184)] [[PyPI](https://pypi.org/project/torchscale/)] ## Installation