Update README.md

README.md

@@ -10,13 +10,16 @@ model_type: llama
 
 # Llama3.1 Swallow
 
-Our Swallow model has undergone continual pre-training from the [Llama 3.1 family](https://huggingface.co/collections/meta-llama/llama-31-669fc079a0c406a149a5738f), primarily with the addition of Japanese language data. The Instruct versions use supervised fine-tuning (SFT). Links to other models can be found in the index.
+Llama 3.1 Swallow is a series of large language models (8B, 70B) that were built by continual pre-training on the [Meta Llama 3.1](https://huggingface.co/collections/meta-llama/llama-31-669fc079a0c406a149a5738f) models.
+Llama 3.1 Swallow enhanced the Japanese language capabilities of the original Llama 3.1 while retaining the English language capabilities.
+We use approximately 200 billion tokens that were sampled from a large Japanese web corpus (Swallow Corpus Version 2), Japanese and English Wikipedia articles, and mathematical and
+coding contents, etc (see the Training Datasets section) for continual pre-training.
+The instruction-tuned models (Instruct) were built by supervised fine-tuning (SFT) on the synthetic data specially built for Japanese.
+See the Swallow Model Index section to find other model variants.
 
+# Release History
 
-# Model Release Updates
-
-We are excited to share the release schedule for our latest models:
-- **October 08, 2024**: Released the [Llama-3.1-Swallow-8B-v0.1](https://huggingface.co/tokyotech-llm/Llama-3.1-Swallow-8B-v0.1), [Llama-3.1-Swallow-8B-Instruct-v0.1](https://huggingface.co/tokyotech-llm/Llama-3.1-Swallow-8B-Instruct-v0.1), [Llama-3.1-Swallow-70B-v0.1](https://huggingface.co/tokyotech-llm/Llama-3.1-Swallow-70B-v0.1), and [Llama-3.1-Swallow-70B-Instruct-v0.1](https://huggingface.co/tokyotech-llm/Llama-3.1-Swallow-70B-Instruct-v0.1).
+- **October 08, 2024**: Released [Llama-3.1-Swallow-8B-v0.1](https://huggingface.co/tokyotech-llm/Llama-3.1-Swallow-8B-v0.1), [Llama-3.1-Swallow-8B-Instruct-v0.1](https://huggingface.co/tokyotech-llm/Llama-3.1-Swallow-8B-Instruct-v0.1), [Llama-3.1-Swallow-70B-v0.1](https://huggingface.co/tokyotech-llm/Llama-3.1-Swallow-70B-v0.1), and [Llama-3.1-Swallow-70B-Instruct-v0.1](https://huggingface.co/tokyotech-llm/Llama-3.1-Swallow-70B-Instruct-v0.1).
 
 ## Swallow Model Index
 
@@ -27,7 +30,7 @@ We are excited to share the release schedule for our latest models:
 
 ![logo](./logo.png)
 
-This repository provides large language models developed by [Swallow-LLM](https://swallow-llm.github.io/).
+The website [https://swallow-llm.github.io/](https://swallow-llm.github.io/) provides large language models developed by the Swallow team.
 
 ## Model Details
 
@@ -119,9 +122,14 @@ The models released here are still in the early stages of our research and devel
 
 ## Acknowledgements
 
-We thank Meta Research for releasing Llama 3.1 under an open license for others to build on.
+We thank Meta Research for releasing Llama 3.1 under a generous open license.
+
+We received various supports including:
 
-Our project is supported by the [Large Generative AI Development Support Program](https://abci.ai/en/link/lfm_support_program.html) of the National Institute of Advanced Industrial Science and Technology. 
++ AIST project: “Research and Development of Foundation Models for Generative AI in the Physical Domain”
++ NEDO project: “Development of Artificial Intelligence Application Technology to Support Judgment in Design Risk Assessment Work Based on the Perspective of Skilled Persons" (JPNP18002) of “Development of Integration Technology as the Core of Next Generation Artificial Intelligence and Robotics”
++ MEXT project: "Formation of R&D center to ensure transparency and reliability of generative AI models"
++ AIST program: [Large Generative AI Development Support Program](https://abci.ai/en/link/lfm_support_program.html)
 
 ## License