diff --git a/README.md b/README.md
index e757cbb..a7bd11a 100644
--- a/README.md
+++ b/README.md
@@ -19,6 +19,7 @@ Fundamental research to develop new architectures for foundation models and A(G)
 
 ## News
 
+- October, 2023: Update RMSNorm and SwiGLU as the default module in RetNet
 - November, 2022: TorchScale 0.1.1 released [[Paper](https://arxiv.org/abs/2211.13184)] [[PyPI](https://pypi.org/project/torchscale/)]
 
 ## Installation