* Yoshikai et al. 2024 Yasuhiro Yoshikai, Tadahaya Mizuno, Shumpei Nemoto, and Hiroyuki Kusuhara.  A novel molecule generative model of VAE combined with Transformer for unseen structure generation, April 2024.  URL http://arxiv.org/abs/2402.11950.  arXiv:2402.11950 [physics, q-bio].
  * Qian et al. 2024a Ying Qian, Minghua Shi, and Qian Zhang.  CONSMI: Contrastive Learning in the Simplified Molecular Input Line Entry System Helps Generate Better Molecules.  _Molecules_ , 29(2):495, January 2024a.  ISSN 1420-3049.  doi:10.3390/molecules29020495.  URL https://www.mdpi.com/1420-3049/29/2/495.  Number: 2 Publisher: Multidisciplinary Digital Publishing Institute.
  * Yan et al. 2024 Xiaoying Yan, Chi Gu, Yuehua Feng, and Jiaxin Han.  Predicting Drug-drug Interaction with Graph Mutual Interaction Attention Mechanism.  _Methods_ , 223:16–25, March 2024.  ISSN 1046-2023.  doi:10.1016/j.ymeth.2024.01.009.  URL https://www.sciencedirect.com/science/article/pii/S1046202324000276.
  * Shen et al. 2024b Tao Shen, Jiale Guo, Zunsheng Han, Gao Zhang, Qingxin Liu, Xinxin Si, Dongmei Wang, Song Wu, and Jie Xia.  AutoMolDesigner for Antibiotic Discovery: An AI-Based Open-Source Software for Automated Design of Small-Molecule Antibiotics.  _Journal of Chemical Information and Modeling_ , 64(3):575–583, February 2024b.  ISSN 1549-9596.  doi:10.1021/acs.jcim.3c01562.  URL https://doi.org/10.1021/acs.jcim.3c01562.  Publisher: American Chemical Society.
  * Bickerton et al. 2012 G Richard Bickerton, Gaia V Paolini, Jérémy Besnard, Sorel Muresan, and Andrew L Hopkins.  Quantifying the chemical beauty of drugs.  _Nature chemistry_ , 4(2):90–98, 2012.
  * Subramanian et al. 2016 Govindan Subramanian, Bharath Ramsundar, Vijay Pande, and Rajiah Aldrin Denny.  Computational modeling of $\beta$-secretase 1 (bace-1) inhibitors using ligand based approaches.  _Journal of chemical information and modeling_ , 56(10):1936–1949, 2016.
  * Xu et al. 2008 Guozhang Xu, Marta C Abad, Peter J Connolly, Michael P Neeper, Geoffrey T Struble, Barry A Springer, Stuart L Emanuel, Niranjan Pandey, Robert H Gruninger, Mary Adams, et al.  4-amino-6-arylamino-pyrimidine-5-carbaldehyde hydrazones as potent erbb-2/egfr dual kinase inhibitors.  _Bioorganic & medicinal chemistry letters_, 18(16):4615–4619, 2008.
  * Yu et al. 2022b Leiye Yu, Licong He, Bing Gan, Rujuan Ti, Qingjie Xiao, Xin Yang, Hongli Hu, Lizhe Zhu, Sheng Wang, and Ruobing Ren.  Structural insights into sphingosine-1-phosphate receptor activation.  _Proceedings of the National Academy of Sciences_ , 119(16):e2117716119, 2022b.
  * Xu et al. 2021 Peiyu Xu, Sijie Huang, Huibing Zhang, Chunyou Mao, X Edward Zhou, Xi Cheng, Icaro A Simon, Dan-Dan Shen, Hsin-Yung Yen, Carol V Robinson, et al.  Structural insights into the lipid and ligand regulation of serotonin receptors.  _Nature_ , 592(7854):469–473, 2021.
  * Sun et al. 2017 Jiangming Sun, Nina Jeliazkova, Vladimir Chupakhin, Jose-Felipe Golib-Dzib, Ola Engkvist, Lars Carlsson, Jörg Wegner, Hugo Ceulemans, Ivan Georgiev, Vedrin Jeliazkov, et al.  Excape-db: an integrated large scale dataset facilitating big data analysis in chemogenomics.  _Journal of cheminformatics_ , 9:1–9, 2017.
  * Han et al. 2024 Zeyu Han, Chao Gao, Jinyang Liu, Jeff Zhang, and Sai Qian Zhang.  Parameter-efficient fine-tuning for large models: A comprehensive survey.  _arXiv [cs.LG]_ , March 2024.  URL http://arxiv.org/abs/2403.14608.
  * Ding et al. 2023 Ning Ding, Yujia Qin, Guang Yang, Fuchao Wei, Zonghan Yang, Yusheng Su, Shengding Hu, Yulin Chen, Chi-Min Chan, Weize Chen, Jing Yi, Weilin Zhao, Xiaozhi Wang, Zhiyuan Liu, Hai-Tao Zheng, Jianfei Chen, Yang Liu, Jie Tang, Juanzi Li, and Maosong Sun.  Parameter-efficient fine-tuning of large-scale pre-trained language models.  _Nat. Mach. Intell._ , 5(3):220–235, March 2023.  ISSN 2522-5839,2522-5839.  doi:10.1038/s42256-023-00626-4.  URL https://www.nature.com/articles/s42256-023-00626-4.
  * Hu et al. 2021 Edward J Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, and Weizhu Chen.  LoRA: Low-rank adaptation of large language models.  _arXiv [cs.CL]_ , June 2021.  URL http://arxiv.org/abs/2106.09685.
  * Guzman-Pando et al. 2023 Abimael Guzman-Pando, Graciela Ramirez-Alonso, Carlos Arzate-Quintana, and Javier Camarillo-Cisneros.  Deep learning algorithms applied to computational chemistry.  _Molecular Diversity_ , December 2023.  ISSN 1573-501X.  doi:10.1007/s11030-023-10771-y.  URL https://doi.org/10.1007/s11030-023-10771-y.
  * Fromer and Coley 2023 Jenna C. Fromer and Connor W. Coley.  Computer-aided multi-objective optimization in small molecule discovery.  _Patterns_ , 4(2):100678, February 2023.  ISSN 2666-3899.  doi:10.1016/j.patter.2023.100678.  URL https://www.sciencedirect.com/science/article/pii/S2666389923000016.
  * Vogt 2023 Martin Vogt.  Exploring chemical space — Generative models and their evaluation.  _Artificial Intelligence in the Life Sciences_ , 3:100064, December 2023.  ISSN 2667-3185.  doi:10.1016/j.ailsci.2023.100064.  URL https://www.sciencedirect.com/science/article/pii/S2667318523000089.
  * Goel et al. 2023 Manan Goel, Rishal Aggarwal, Bhuvanesh Sridharan, Pradeep Kumar Pal, and U. Deva Priyakumar.  Efficient and enhanced sampling of drug-like chemical space for virtual screening and molecular design using modern machine learning methods.  _WIREs Computational Molecular Science_ , 13(2):e1637, 2023.  ISSN 1759-0884.  doi:10.1002/wcms.1637.  URL https://onlinelibrary.wiley.com/doi/abs/10.1002/wcms.1637.  _eprint: https://onlinelibrary.wiley.com/doi/pdf/10.1002/wcms.1637.
  * Fang et al. 2023b Yin Fang, Ningyu Zhang, Zhuo Chen, Lingbing Guo, Xiaohui Fan, and Huajun Chen.  Domain-agnostic molecular generation with chemical feedback.  _arXiv [cs.LG]_ , January 2023b.  URL http://arxiv.org/abs/2301.11259.
  * Vaucher et al. 2020 Alain C Vaucher, Federico Zipoli, Joppe Geluykens, Vishnu H Nair, Philippe Schwaller, and Teodoro Laino.  Automated extraction of chemical synthesis actions from experimental procedures.  _Nat. Commun._ , 11(1):3601, July 2020.  ISSN 2041-1723.  doi:10.1038/s41467-020-17266-6.  URL http://dx.doi.org/10.1038/s41467-020-17266-6.
  * Edwards et al. 2021 Carl Edwards, ChengXiang Zhai, and Heng Ji.  Text2Mol: Cross-modal molecule retrieval with natural language queries.  In Marie-Francine Moens, Xuanjing Huang, Lucia Specia, and Scott Wen-tau Yih, editors, _Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing_ , pages 595–607, Online and Punta Cana, Dominican Republic, November 2021. Association for Computational Linguistics.  doi:10.18653/v1/2021.emnlp-main.47.  URL https://aclanthology.org/2021.emnlp-main.47.
  * Shenvi 2024 Ryan A. Shenvi.  Natural product synthesis in the 21st century: Beyond the mountain top.  _ACS Central Science_ , 10(3):519–528, 2024.  doi:10.1021/acscentsci.3c01518.  URL https://doi.org/10.1021/acscentsci.3c01518.
  * Ai et al. 2024 Qianxiang Ai, Fanwang Meng, Jiale Shi, Brenden Pelkie, and Connor W. Coley.  Extracting Structured Data from Organic Synthesis Procedures Using a Fine-Tuned Large Language Model, April 2024.  URL https://chemrxiv.org/engage/chemrxiv/article-details/661064e921291e5d1d2bc860.
  * Corey 1988 E. J. Corey.  Robert Robinson Lecture. Retrosynthetic thinking—essentials and examples.  _Chemical Society Reviews_ , 17(0):111–133, January 1988.  ISSN 1460-4744.  doi:10.1039/CS9881700111.  URL https://pubs.rsc.org/en/content/articlelanding/1988/cs/cs9881700111.  Publisher: The Royal Society of Chemistry.
  * Nerenberg et al. 1993 Jennie B. Nerenberg, Deborah T. Hung, Patricia K. Somers, and Stuart L. Schreiber.  Total synthesis of the immunosuppressive agent (-)-discodermolide.  _Journal of the American Chemical Society_ , 115(26):12621–12622, 1993.  doi:10.1021/ja00079a066.  URL https://doi.org/10.1021/ja00079a066.  _eprint: https://doi.org/10.1021/ja00079a066.
  * Nam and Kim 2016 Juno Nam and Jurae Kim.  Linking the Neural Machine Translation and the Prediction of Organic Chemistry Reactions, December 2016.  URL http://arxiv.org/abs/1612.09529.  arXiv:1612.09529 [cs].
  * Liu et al. 2017 Bowen Liu, Bharath Ramsundar, Prasad Kawthekar, Jade Shi, Joseph Gomes, Quang Luu Nguyen, Stephen Ho, Jack Sloane, Paul Wender, and Vijay Pande.  Retrosynthetic Reaction Prediction Using Neural Sequence-to-Sequence Models.  _ACS Central Science_ , 3(10):1103–1113, October 2017.  ISSN 2374-7943.  doi:10.1021/acscentsci.7b00303.  URL https://doi.org/10.1021/acscentsci.7b00303.  Publisher: American Chemical Society.
  * Schneider et al. 2016 Nadine Schneider, Nikolaus Stiefl, and Gregory A. Landrum.  What’s what: The (nearly) definitive guide to reaction role assignment.  _Journal of Chemical Information and Modeling_ , 56(12):2336–2346, 2016.  doi:10.1021/acs.jcim.6b00564.  URL https://doi.org/10.1021/acs.jcim.6b00564.  PMID: 28024398.
  * August 2016 Matthew Gunther10 August 2016.  Software could revolutionise chemistry.  URL https://www.chemistryworld.com/news/software-could-revolutionise-chemistry/1017236.article.
  * Klucznik et al. 2018 Tomasz Klucznik, Barbara Mikulak-Klucznik, Michael P. McCormack, Heather Lima, Sara Szymkuć, Manishabrata Bhowmick, Karol Molga, Yubai Zhou, Lindsey Rickershauser, Ewa P. Gajewska, Alexei Toutchkine, Piotr Dittwald, Michał P. Startek, Gregory J. Kirkovits, Rafał Roszak, Ariel Adamski, Bianka Sieredzińska, Milan Mrksich, Sarah L. J. Trice, and Bartosz A. Grzybowski.  Efficient Syntheses of Diverse, Medicinally Relevant Targets Planned by Computer and Executed in the Laboratory.  _Chem_ , 4(3):522–532, March 2018.  ISSN 2451-9294, 2451-9308.  doi:10.1016/j.chempr.2018.02.002.  URL https://www.cell.com/chem/abstract/S2451-9294(18)30063-9.  Publisher: Elsevier.
  * Segler and Waller 2017 Marwin H S Segler and Mark P Waller.  Neural-symbolic machine learning for retrosynthesis and reaction prediction.  _Chemistry_ , 23(25):5966–5971, May 2017.  ISSN 0947-6539, 1521-3765.  doi:10.1002/chem.201605499.  URL https://chemistry-europe.onlinelibrary.wiley.com/doi/10.1002/chem.201605499.
  * Somnath et al. 2021 Vignesh Ram Somnath, Charlotte Bunne, Connor W. Coley, Andreas Krause, and Regina Barzilay.  Learning Graph Models for Retrosynthesis Prediction, June 2021.  URL http://arxiv.org/abs/2006.07038.  arXiv:2006.07038 [cs, stat].
  * Wellawatte and Schwaller 2023 Geemi P Wellawatte and Philippe Schwaller.  Extracting human interpretable structure-property relationships in chemistry using XAI and large language models.  _arXiv [physics.chem-ph]_ , November 2023.  URL http://arxiv.org/abs/2311.04047.
  * Cadeddu et al. 2014 Andrea Cadeddu, Elizabeth K. Wylie, Janusz Jurczak, Matthew Wampler-Doty, and Bartosz A. Grzybowski.  Organic Chemistry as a Language and the Implications of Chemical Linguistics for Structural and Retrosynthetic Analyses.  _Angewandte Chemie International Edition_ , 53(31):8108–8112, 2014.  ISSN 1521-3773.  doi:10.1002/anie.201403708.  URL https://onlinelibrary.wiley.com/doi/abs/10.1002/anie.201403708.  _eprint: https://onlinelibrary.wiley.com/doi/pdf/10.1002/anie.201403708.
  * Schwaller et al. 2018 Philippe Schwaller, Théophile Gaudin, Dávid Lányi, Costas Bekas, and Teodoro Laino.  “Found in Translation”: predicting outcomes of complex organic chemistry reactions using neural sequence-to-sequence models.  _Chemical Science_ , 9(28):6091–6098, July 2018.  ISSN 2041-6539.  doi:10.1039/C8SC02339E.  URL https://pubs.rsc.org/en/content/articlelanding/2018/sc/c8sc02339e.  Publisher: The Royal Society of Chemistry.
  * Jin et al. 2017 Wengong Jin, Connor W. Coley, Regina Barzilay, and Tommi Jaakkola.  Predicting Organic Reaction Outcomes with Weisfeiler-Lehman Network, December 2017.  URL http://arxiv.org/abs/1709.04555.  arXiv:1709.04555 [cs, stat].
  * Bradshaw et al. 2019 John Bradshaw, Matt J. Kusner, Brooks Paige, Marwin H. S. Segler, and José Miguel Hernández-Lobato.  A Generative Model For Electron Paths, March 2019.  URL http://arxiv.org/abs/1805.10970.  arXiv:1805.10970 [physics, stat].
  * Schwaller et al. 2020b Philippe Schwaller, Riccardo Petraglia, Valerio Zullo, Vishnu H. Nair, Rico Andreas Haeuselmann, Riccardo Pisoni, Costas Bekas, Anna Iuliano, and Teodoro Laino.  Predicting retrosynthetic pathways using transformer-based models and a hyper-graph exploration strategy.  _Chemical Science_ , 11(12):3316–3325, March 2020b.  ISSN 2041-6539.  doi:10.1039/C9SC05704H.  URL https://pubs.rsc.org/en/content/articlelanding/2020/sc/c9sc05704h.  Publisher: The Royal Society of Chemistry.
  * Chen and Jung 2021 Shuan Chen and Yousung Jung.  Deep Retrosynthetic Reaction Prediction using Local Reactivity and Global Attention.  _JACS Au_ , 1(10):1612–1620, August 2021.  ISSN 2691-3704.  doi:10.1021/jacsau.1c00246.  URL https://doi.org/10.1021/jacsau.1c00246.  Publisher: American Chemical Society.
  * Westerlund et al. 2024 Annie M. Westerlund, Siva Manohar Koki, Supriya Kancharla, Alessandro Tibo, Lakshidaa Saigiridharan, Mikhail Kabeshov, Rocio Mercado, and Samuel Genheden.  Do Chemformers Dream of Organic Matter? Evaluating a Transformer Model for Multistep Retrosynthesis.  _JOURNAL OF CHEMICAL INFORMATION AND MODELING_ , 64(8):3021–3033, April 2024.  ISSN 1549-9596, 1549-960X.  doi:10.1021/acs.jcim.3c01685.  URL https://www.webofscience.com/api/gateway?GWVersion=2&SrcAuth=DynamicDOIArticle&SrcApp=UA&KeyAID=10.1021%2Facs.jcim.3c01685&DestApp=DOI&SrcAppSID=USW2EC0C6Dsgh6m89jbQCLUMIbTAg&SrcJTitle=JOURNAL+OF+CHEMICAL+INFORMATION+AND+MODELING&DestDOIRegistrantName=American+Chemical+Society.  Num Pages: 13 Place: Washington Publisher: Amer Chemical Soc Web of Science ID: WOS:001201284600001.
  * Zheng et al. 2020 Shuangjia Zheng, Jiahua Rao, Zhongyue Zhang, Jun Xu, and Yuedong Yang.  Predicting Retrosynthetic Reactions Using Self-Corrected Transformer Neural Networks.  _Journal of Chemical Information and Modeling_ , 60(1):47–55, January 2020.  ISSN 1549-9596.  doi:10.1021/acs.jcim.9b00949.  URL https://doi.org/10.1021/acs.jcim.9b00949.  Publisher: American Chemical Society.
  * Lowe 2012 Daniel Mark Lowe.  Extraction of chemical structures and reactions from the literature.  October 2012.  URL http://www.dspace.cam.ac.uk/handle/1810/244727.
  * Li et al. 2024 Junren Li, Lei Fang, and Jian-Guang Lou.  Retro-BLEU: quantifying chemical plausibility of retrosynthesis routes through reaction template sequence analysis.  _Digital Discovery_ , 3(3):482–490, 2024.  doi:10.1039/D3DD00219E.  URL https://pubs.rsc.org/en/content/articlelanding/2024/dd/d3dd00219e.  Publisher: Royal Society of Chemistry.
  * Papineni et al. 2002 Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu.  BLEU: a method for automatic evaluation of machine translation.  In Pierre Isabelle, Eugene Charniak, and Dekang Lin, editors, _Proceedings of the 40th Annual Meeting on Association for Computational Linguistics - ACL ’02_ , pages 311–318, Philadelphia, Pennsylvania, USA, July 2002. Association for Computational Linguistics.  doi:10.3115/1073083.1073135.  URL http://portal.acm.org/citation.cfm?doid=1073083.1073135.
  * Lin 2004 Chin-Yew Lin.  ROUGE: A Package for Automatic Evaluation of Summaries.  In _Text Summarization Branches Out_ , pages 74–81, Barcelona, Spain, July 2004. Association for Computational Linguistics.  URL https://aclanthology.org/W04-1013.
  * Carstensen and Attarchi 1988 J. T. Carstensen and Faraneh Attarchi.  Decomposition of Aspirin in the Solid State in the Presence of Limited Amounts of Moisture III: Effect of Temperature and a Possible Mechanism.  _Journal of Pharmaceutical Sciences_ , 77(4):318–321, April 1988.  ISSN 0022-3549.  doi:10.1002/jps.2600770407.  URL https://www.sciencedirect.com/science/article/pii/S0022354915476658.
  * Seidl et al. 2023 Philipp Seidl, Andreu Vall, Sepp Hochreiter, and Guenter Klambauer.  Enhancing Activity Prediction Models in Drug Discovery with the Ability to Understand Human Language.  _Arxiv_ , 2023.
  * Xu et al. 2023a Hanwen Xu, Addie Woicik, Hoifung Poon, Russ B. Altman, and Sheng Wang.  Multilingual translation for zero-shot biomedical classification using BioTranslator.  _NATURE COMMUNICATIONS_ , 14(1), February 2023a.  ISSN 2041-1723.  doi:10.1038/s41467-023-36476-2.
  * Liu et al. 2023b Shengchao Liu, Jiongxiao Wang, Yijin Yang, Chengpeng Wang, Ling Liu, Hongyu Guo, and Chaowei Xiao.  ChatGPT-powered Conversational Drug Editing Using Retrieval and Domain Feedback.  _Arxiv_ , 2023b.
  * Shoghi et al. 2024 Nima Shoghi, Adeesh Kolluru, John R. Kitchin, Zachary W. Ulissi, C. Lawrence Zitnick, and Brandon M. Wood.  From Molecules to Materials: Pre-training Large Generalizable Models for Atomic Property Prediction, May 2024.  URL http://arxiv.org/abs/2310.16802.  arXiv:2310.16802 [cs].
  * Liu et al. 2023c Zequn Liu, Wei Zhang, Yingce Xia, Lijun Wu, Shufang Xie, Tao Qin, Ming Zhang, and Tie-Yan Liu.  MolXPT: Wrapping Molecules with Text for Generative Pre-training.  _Arxiv_ , 2023c.
  * Zhang et al. 2024b Haohui Zhang, Juntong Wu, Shichao Liu, and Shen Han.  A pre-trained multi-representation fusion network for molecular property prediction.  _INFORMATION FUSION_ , 103, March 2024b.  ISSN 1566-2535.  doi:10.1016/j.inffus.2023.102092.
  * Liu et al. 2024a Pengfei Liu, Yiming Ren, Jun Tao, and Zhixiang Ren.  Git-mol: A multi-modal large language model for molecular science with graph, image, and text.  _Computers in Biology and Medicine_ , 171:108073, March 2024a.  ISSN 0010-4825.  doi:10.1016/j.compbiomed.2024.108073.  URL http://dx.doi.org/10.1016/j.compbiomed.2024.108073.
  * Gao et al. 2024a Changnan Gao, Wenjie Bao, Shuang Wang, Jianyang Zheng, Lulu Wang, Yongqi Ren, Linfang Jiao, Jianmin Wang, and Xun Wang.  DockingGA: enhancing targeted molecule generation using transformer neural network and genetic algorithm with docking simulation.  _BRIEFINGS IN FUNCTIONAL GENOMICS_ , April 2024a.  ISSN 2041-2649.  doi:10.1093/bfgp/elae011.
  * Zhou et al. 2024 Peng Zhou, Jianmin Wang, Chunyan Li, Zixu Wang, Yiping Liu, Siqi Sun, Jianxin Lin, Longyue Wang, and Xiangxiang Zeng.  Instruction Multi-Constraint Molecular Generation Using a Teacher-Student Large Language Model.  _Arxiv_ , 2024.
  * Zhu et al. 2024 Huaisheng Zhu, Teng Xiao, and Vasant G Honavar.  3M-Diffusion: Latent Multi-Modal Diffusion for Text-Guided Generation of Molecular Graphs.  _Arxiv_ , 2024.
  * Gong et al. 2024 Haisong Gong, Qiang Liu, Shu Wu, and Liang Wang.  Text-Guided Molecule Generation with Diffusion Language Model.  _Arxiv_ , 2024.
  * Fang et al. 2024 Junfeng Fang, Shuai Zhang, Chang Wu, Zhiyuan Liu, Sihang Li, Kun Wang, Wenjie Du, and Xiang Wang.  MolTC: Towards Molecular Relational Modeling In Language Models.  _Arxiv_ , 2024.
  * Soares et al. 2023 Eduardo Soares, Emilio Vital Brazil, Karen Fiorela Aquino Gutierrez, Renato Cerqueira, Dan Sanders, Kristin Schmidt, and Dmitry Zubarev.  Beyond Chemical Language: A Multimodal Approach to Enhance Molecular Property Prediction, June 2023.  URL http://arxiv.org/abs/2306.14919.  arXiv:2306.14919 [physics, q-bio].
  * mim 2021 MIMIC-III documentation.  https://mimic.mit.edu/docs/iii/, 2021.  URL https://mimic.mit.edu/docs/iii/.  Accessed: 2024-3-25.
  * Liu et al. 2019b Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov.  RoBERTa: A robustly optimized BERT pretraining approach.  _arXiv [cs.CL]_ , July 2019b.  URL http://arxiv.org/abs/1907.11692.
  * Smith et al. 2019 Hannah Smith, Zeyu Zhang, John Culnan, and Peter Jansen.  ScienceExamCER: A high-density fine-grained science-domain corpus for common entity recognition.  _arXiv [cs.CL]_ , November 2019.  URL http://arxiv.org/abs/1911.10436.
  * Swain and Cole 2016 Matthew C Swain and Jacqueline M Cole.  ChemDataExtractor: A toolkit for automated extraction of chemical information from the scientific literature.  _J. Chem. Inf. Model._ , 56(10):1894–1904, October 2016.  ISSN 1549-9596, 1549-960X.  doi:10.1021/acs.jcim.6b00207.  URL http://dx.doi.org/10.1021/acs.jcim.6b00207.
  * 340 Santiago Ibanez.  chemie-turk: Mechanical turk on your own machine for chemical literature annotation.  URL https://github.com/asibanez/chemie-turk.
  * Shoeybi et al. 2019 Mohammad Shoeybi, Mostofa Patwary, Raul Puri, Patrick LeGresley, Jared Casper, and Bryan Catanzaro.  Megatron-LM: Training multi-billion parameter language models using model parallelism.  _arXiv [cs.CL]_ , September 2019.  URL http://arxiv.org/abs/1909.08053.
  * Rajpurkar et al. 2016 Pranav Rajpurkar, Jian Zhang, Konstantin Lopyrev, and Percy Liang.  SQuAD: 100,000+ questions for machine comprehension of text.  _arXiv [cs.CL]_ , June 2016.  URL http://arxiv.org/abs/1606.05250.
  * Peng et al. 2020 Yifan Peng, Qingyu Chen, and Zhiyong Lu.  An empirical study of multi-task learning on BERT for biomedical text mining.  _arXiv [cs.CL]_ , May 2020.  URL http://arxiv.org/abs/2005.02799.
  * Welbl et al. 2017 Johannes Welbl, Nelson F Liu, and Matt Gardner.  Crowdsourcing multiple choice science questions.  _arXiv [cs.HC]_ , July 2017.  URL http://arxiv.org/abs/1707.06209.
  * Jin et al. 2021 Di Jin, Eileen Pan, Nassim Oufattole, Wei-Hung Weng, Hanyi Fang, and Peter Szolovits.  What disease does this patient have? a large-scale open domain question answering dataset from medical exams.  _Preprints_ , May 2021.  URL http://arxiv.org/abs/2009.13081.
  * Pal et al. 2022 Ankit Pal, Logesh Kumar Umapathi, and Malaikannan Sankarasubbu.  MedMCQA : A large-scale multi-subject multi-choice dataset for medical domain question answering.  _arXiv [cs.CL]_ , March 2022.  URL http://arxiv.org/abs/2203.14371.
  * Jin et al. 2019 Qiao Jin, Bhuwan Dhingra, Zhengping Liu, William W Cohen, and Xinghua Lu.  PubMedQA: A dataset for biomedical research question answering.  _arXiv [cs.CL]_ , September 2019.  URL http://arxiv.org/abs/1909.06146.
  * Castro Nascimento and Pimentel 2023 Cayque Monteiro Castro Nascimento and André Silva Pimentel.  Do Large Language Models Understand Chemistry? A Conversation with ChatGPT.  _Journal of Chemical Information and Modeling_ , 63(6):1649–1655, March 2023.  ISSN 1549-9596.  doi:10.1021/acs.jcim.3c00285.  URL https://doi.org/10.1021/acs.jcim.3c00285.  Publisher: American Chemical Society.
  * Humphry and Fuller 2023 Tim Humphry and Amy L. Fuller.  Potential ChatGPT Use in Undergraduate Chemistry Laboratories.  _JOURNAL OF CHEMICAL EDUCATION_ , 100(4):1434–1436, April 2023.  ISSN 0021-9584.  doi:10.1021/acs.jchemed.3c00006.
  * Emenike and Emenike 2023 Mary E. Emenike and Bright U. Emenike.  Was This Title Generated by ChatGPT? Considerations for Artificial Intelligence Text-Generation Software Programs for Chemists and Chemistry Educators.  _JOURNAL OF CHEMICAL EDUCATION_ , 100(4):1413–1418, April 2023.  ISSN 0021-9584.  doi:10.1021/acs.jchemed.3c00063.
  * Fergus et al. 2023 Suzanne Fergus, Michelle Botha, and Mehrnoosh Ostovar.  Evaluating Academic Answers Generated Using ChatGPT.  _JOURNAL OF CHEMICAL EDUCATION_ , 100(4):1672–1675, April 2023.  ISSN 0021-9584.  doi:10.1021/acs.jchemed.3c00087.
  * Zheng et al. 2023a Zhiling Zheng, Ali H. Alawadhi, Saumil Chheda, S. Ephraim Neumann, Nakul Rampal, Shengchao Liu, Ha L. Nguyen, Yen-hsu Lin, Zichao Rong, J. Ilja Siepmann, Laura Gagliardi, Anima Anandkumar, Christian Borgs, Jennifer T. Chayes, and Omar M. Yaghi.  Shaping the Water-Harvesting Behavior of Metal-Organic Frameworks Aided by Fine-Tuned GPT Models.  _JOURNAL OF THE AMERICAN CHEMICAL SOCIETY_ , 145(51):28284–28295, December 2023a.  ISSN 0002-7863.  doi:10.1021/jacs.3c12086.
  * Zheng et al. 2023b Zhiling Zheng, Oufan Zhang, Christian Borgs, Jennifer T. Chayes, and Omar M. Yaghi.  ChatGPT Chemistry Assistant for Text Mining and the Prediction of MOF Synthesis.  _Journal of the American Chemical Society_ , 145(Copyright © 2024 American Chemical Society (ACS). All Rights Reserved.; Copyright © 2024 U.S. National Library of Medicine.):18048–18062, 2023b.  ISSN 1520-5126.  doi:10.1021/jacs.3c05819.  Publisher: American Chemical Society.
  * Xie et al. 2024 Zikai Xie, Xenophon Evangelopoulos, Ömer H. Omar, Alessandro Troisi, Andrew I. Cooper, and Linjiang Chen.  Fine-tuning GPT-3 for machine learning electronic and functional properties of organic molecules.  _Chemical Science_ , 15(2):500–510, January 2024.  ISSN 2041-6539.  doi:10.1039/D3SC04610A.  URL https://pubs.rsc.org/en/content/articlelanding/2024/sc/d3sc04610a.  Publisher: The Royal Society of Chemistry.
  * Zheng et al. 2023c Zhiling Zheng, Zichao Rong, Nakul Rampal, Christian Borgs, Jennifer T. Chayes, and Omar M. Yaghi.  A GPT-4 Reticular Chemist for Guiding MOF Discovery.  _ANGEWANDTE CHEMIE-INTERNATIONAL EDITION_ , 62(46), November 2023c.  ISSN 1433-7851.  doi:10.1002/anie.202311983.
  * Deb et al. 2024 Jyotirmoy Deb, Lakshi Saikia, Kripa Dristi Dihingia, and G. Narahari Sastry.  Chatgpt in the material design: Selected case studies to assess the potential of chatgpt.  _Journal of Chemical Information and Modeling_ , 64(3):799–811, 2024.  doi:10.1021/acs.jcim.3c01702.  URL https://doi.org/10.1021/acs.jcim.3c01702.  PMID: 38237025.
  * Bloom 1968 Benjamin S Bloom.  _Taxonomy of Educational Objectives: The Classification of Educational Goals; Handbook. Cognitive Domain_.  McKay, 1968.
  * Bloom 2010 Benjamin Samuel Bloom.  _A taxonomy for learning, teaching, and assessing: A revision of Bloom’s taxonomy of educational objectives_.  Longman, 2010.
  * Coley et al. 2019b Connor W. Coley, Dale A. Thomas, Justin A. M. Lummiss, Jonathan N. Jaworski, Christopher P. Breen, Victor Schultz, Travis Hart, Joshua S. Fishman, Luke Rogers, Hanyu Gao, Robert W. Hicklin, Pieter P. Plehiers, Joshua Byington, John S. Piotti, William H. Green, A. John Hart, Timothy F. Jamison, and Klavs F. Jensen.  A robotic platform for flow synthesis of organic compounds informed by AI planning.  _Science_ , 365(6453):eaax1566, August 2019b.  doi:10.1126/science.aax1566.  URL https://www.science.org/doi/full/10.1126/science.aax1566.  Publisher: American Association for the Advancement of Science.
  * Gromski et al. 2020 Piotr S. Gromski, Jarosław M. Granda, and Leroy Cronin.  Universal Chemical Synthesis and Discovery with ‘The Chemputer’.  _Trends in Chemistry_ , 2(1):4–12, January 2020.  ISSN 25895974.  doi:10.1016/j.trechm.2019.07.004.  URL https://linkinghub.elsevier.com/retrieve/pii/S2589597419301868.
  * Grisoni et al. 2021 Francesca Grisoni, Berend J. H. Huisman, Alexander L. Button, Michael Moret, Kenneth Atz, Daniel Merk, and Gisbert Schneider.  Combining generative artificial intelligence and on-chip synthesis for de novo drug design.  _Science Advances_ , 7(24):eabg3338, June 2021.  doi:10.1126/sciadv.abg3338.  URL https://www.science.org/doi/full/10.1126/sciadv.abg3338.  Publisher: American Association for the Advancement of Science.
  * Goldman et al. 2022 Brian Goldman, Steven Kearnes, Trevor Kramer, Patrick Riley, and W. Patrick Walters.  Defining Levels of Automated Chemical Design.  _Journal of Medicinal Chemistry_ , 65(10):7073–7087, May 2022.  ISSN 0022-2623, 1520-4804.  doi:10.1021/acs.jmedchem.2c00334.  URL https://pubs.acs.org/doi/10.1021/acs.jmedchem.2c00334.
  * Schneider 2018 Gisbert Schneider.  Automating drug discovery.  _Nature Reviews Drug Discovery_ , 17(2):97–113, February 2018.  ISSN 1474-1784.  doi:10.1038/nrd.2017.232.  URL https://doi.org/10.1038/nrd.2017.232.
  * Janet et al. 2023 Jon Paul Janet, Lewis Mervin, and Ola Engkvist.  Artificial intelligence in molecular de novo design: Integration with experiment.  _Current Opinion in Structural Biology_ , 80:102575, June 2023.  ISSN 0959-440X.  doi:10.1016/j.sbi.2023.102575.  URL https://www.sciencedirect.com/science/article/pii/S0959440X23000490.
  * Coley et al. 2020a Connor W. Coley, Natalie S. Eyke, and Klavs F. Jensen.  Autonomous Discovery in the Chemical Sciences Part I: Progress.  _Angewandte Chemie International Edition_ , 59(51):22858–22893, 2020a.  ISSN 1521-3773.  doi:10.1002/anie.201909987.  URL https://onlinelibrary.wiley.com/doi/abs/10.1002/anie.201909987.  _eprint: https://onlinelibrary.wiley.com/doi/pdf/10.1002/anie.201909987.
  * Coley et al. 2020b Connor W. Coley, Natalie S. Eyke, and Klavs F. Jensen.  Autonomous Discovery in the Chemical Sciences Part II: Outlook.  _Angewandte Chemie International Edition_ , 59(52):23414–23436, 2020b.  ISSN 1521-3773.  doi:10.1002/anie.201909989.  URL https://onlinelibrary.wiley.com/doi/abs/10.1002/anie.201909989.  _eprint: https://onlinelibrary.wiley.com/doi/pdf/10.1002/anie.201909989.
  * Thakkar et al. 2021 Amol Thakkar, Simon Johansson, Kjell Jorner, David Buttar, Jean-Louis Reymond, and Ola Engkvist.  Artificial intelligence and automation in computer aided synthesis planning.  _Reaction Chemistry & Engineering_, 6(1):27–51, January 2021.  ISSN 2058-9883.  doi:10.1039/D0RE00340A.  URL https://pubs.rsc.org/en/content/articlelanding/2021/re/d0re00340a.  Publisher: The Royal Society of Chemistry.
  * Shen et al. 2021 Yuning Shen, Julia E. Borowski, Melissa A. Hardy, Richmond Sarpong, Abigail G. Doyle, and Tim Cernak.  Automation and computer-assisted planning for chemical synthesis.  _Nature Reviews Methods Primers_ , 1(1):23, March 2021.  ISSN 2662-8449.  doi:10.1038/s43586-021-00022-5.  URL https://www.nature.com/articles/s43586-021-00022-5.
  * Liu et al. 2021 Yuxiao Liu, Lingyu Sun, Hui Zhang, Luoran Shang, and Yuanjin Zhao.  Microfluidics for Drug Development: From Synthesis to Evaluation.  _Chemical Reviews_ , 121(13):7468–7529, July 2021.  ISSN 0009-2665.  doi:10.1021/acs.chemrev.0c01289.  URL https://doi.org/10.1021/acs.chemrev.0c01289.  Publisher: American Chemical Society.
  * Darvish et al. 2024 Kourosh Darvish, Marta Skreta, Yuchi Zhao, Naruki Yoshikawa, Sagnik Som, Miroslav Bogdanovic, Yang Cao, Han Hao, Haoping Xu, Alán Aspuru-Guzik, Animesh Garg, and Florian Shkurti.  ORGANA: A robotic assistant for automated chemistry experimentation and characterization.  _arXiv [cs.RO]_ , January 2024.  URL http://arxiv.org/abs/2401.06949.
  * Šalamon 2011 Tomáš Šalamon.  _Design of Agent-based Models: Developing Computer Simulations for a Better Understanding of Social Processes_.  Tomáš Bruckner, Repin, CZE, 2011.  ISBN 9788090466111.  URL https://play.google.com/store/books/details?id=2rCdKnltaH8C.
  * Xi et al. 2023a Zhiheng Xi, Wenxiang Chen, Xin Guo, Wei He, Yiwen Ding, Boyang Hong, Ming Zhang, Junzhe Wang, Senjie Jin, Enyu Zhou, Rui Zheng, Xiaoran Fan, Xiao Wang, Limao Xiong, Yuhao Zhou, Weiran Wang, Changhao Jiang, Yicheng Zou, Xiangyang Liu, Zhangyue Yin, Shihan Dou, Rongxiang Weng, Wensen Cheng, Qi Zhang, Wenjuan Qin, Yongyan Zheng, Xipeng Qiu, Xuanjing Huang, and Tao Gui.  The rise and potential of large language model based agents: A survey.  _arXiv [cs.AI]_ , September 2023a.  URL http://arxiv.org/abs/2309.07864.
  * Gao et al. 2024b Shanghua Gao, Ada Fang, Yepeng Huang, Valentina Giunchiglia, Ayush Noori, Jonathan Richard Schwarz, Yasha Ektefaie, Jovana Kondic, and Marinka Zitnik.  Empowering biomedical discovery with AI agents.  _arXiv [cs.AI]_ , April 2024b.  URL http://arxiv.org/abs/2404.02831.
  * Wang et al. 2024a Lei Wang, Chen Ma, Xueyang Feng, Zeyu Zhang, Hao Yang, Jingsen Zhang, Zhiyuan Chen, Jiakai Tang, Xu Chen, Yankai Lin, Wayne Xin Zhao, Zhewei Wei, and Jirong Wen.  A survey on large language model based autonomous agents.  _Front. Comput. Sci._ , 18(6), December 2024a.  ISSN 2095-2228,2095-2236.  doi:10.1007/s11704-024-40231-1.  URL http://dx.doi.org/10.1007/s11704-024-40231-1.
  * Weng 2023 Lilian Weng.  LLM powered autonomous agents.  https://lilianweng.github.io/posts/2023-06-23-agent/, June 2023.  URL https://lilianweng.github.io/posts/2023-06-23-agent/.  Accessed: 2024-1-22.
  * Sumers et al. 2023 Theodore R Sumers, Shunyu Yao, Karthik Narasimhan, and Thomas L Griffiths.  Cognitive architectures for language agents.  _arXiv [cs.AI]_ , September 2023.  URL http://arxiv.org/abs/2309.02427.
  * Wang et al. 2023d Bing Wang, Xinnian Liang, Jian Yang, Hui Huang, Shuangzhi Wu, Peihao Wu, Lu Lu, Zejun Ma, and Zhoujun Li.  Enhancing large language model with self-controlled memory framework.  _arXiv [cs.CL]_ , April 2023d.  URL http://arxiv.org/abs/2304.13343.
  * Zhang et al. 2023b Yi Zhang, Zhongyang Yu, Wanqi Jiang, Yufeng Shen, and Jin Li.  Long-term memory for large language models through topic-based vector database.  In _2023 International Conference on Asian Language Processing (IALP)_. IEEE, November 2023b.  doi:10.1109/ialp61005.2023.10337079.  URL https://ieeexplore.ieee.org/document/10337079/.
  * Zhu et al. 2023 Xizhou Zhu, Yuntao Chen, Hao Tian, Chenxin Tao, Weijie Su, Chenyu Yang, Gao Huang, Bin Li, Lewei Lu, Xiaogang Wang, Yu Qiao, Zhaoxiang Zhang, and Jifeng Dai.  Ghost in the minecraft: Generally capable agents for open-world environments via large language models with text-based knowledge and memory.  _arXiv [cs.AI]_ , May 2023.  URL http://arxiv.org/abs/2305.17144.
  * Zhong et al. 2023 Wanjun Zhong, Lianghong Guo, Qiqi Gao, He Ye, and Yanlin Wang.  MemoryBank: Enhancing large language models with long-term memory.  _arXiv [cs.CL]_ , May 2023.  URL http://arxiv.org/abs/2305.10250.
  * Han et al. 2023b Yikun Han, Chunjiang Liu, and Pengfei Wang.  A comprehensive survey on vector database: Storage and retrieval technique, challenge.  _arXiv [cs.DB]_ , October 2023b.  URL http://arxiv.org/abs/2310.11703.
  * Zhao et al. 2023a Andrew Zhao, Daniel Huang, Quentin Xu, Matthieu Lin, Yong-Jin Liu, and Gao Huang.  ExpeL: LLM agents are experiential learners.  _arXiv [cs.LG]_ , August 2023a.  URL http://arxiv.org/abs/2308.10144.
  * 383 ANN-benchmarks.  https://ann-benchmarks.com/.  URL https://ann-benchmarks.com/.  Accessed: 2024-2-1.
  * Hatalis et al. 2023 Kostas Hatalis, Despina Christou, Joshua Myers, Steven Jones, Keith Lambert, Adam Amos-Binks, Zohreh Dannenhauer, and Dustin Dannenhauer.  Memory matters: The need to improve Long-Term memory in LLM-Agents.  _AAAI-SS_ , 2(1):277–280, 2023.  ISSN 2994-4317, 2994-4317.  doi:10.1609/aaaiss.v2i1.27688.  URL https://ojs.aaai.org/index.php/AAAI-SS/article/view/27688.
  * Brown et al. 2020 Tom B Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel M Ziegler, Jeffrey Wu, Clemens Winter, Christopher Hesse, Mark Chen, Eric Sigler, Mateusz Litwin, Scott Gray, Benjamin Chess, Jack Clark, Christopher Berner, Sam McCandlish, Alec Radford, Ilya Sutskever, and Dario Amodei.  Language Models are Few-Shot Learners.  _arXiv [cs.CL]_ , May 2020.  URL http://arxiv.org/abs/2005.14165.
  * Park et al. 2023 Joon Sung Park, Joseph C O’Brien, Carrie J Cai, Meredith Ringel Morris, Percy Liang, and Michael S Bernstein.  Generative agents: Interactive simulacra of human behavior.  _arXiv [cs.HC]_ , April 2023.  URL http://arxiv.org/abs/2304.03442.
  * Raman et al. 2022 S S Raman, V Cohen, E Rosen, and I Idrees.  Planning with large language models via corrective re-prompting.  _Foundation Models_ , November 2022.  URL https://openreview.net/pdf?id=cMDMRBe1TKs.
  * Dhuliawala et al. 2023 Shehzaad Dhuliawala, Mojtaba Komeili, Jing Xu, Roberta Raileanu, Xian Li, Asli Celikyilmaz, and Jason Weston.  Chain-of-verification reduces hallucination in large language models.  _arXiv [cs.CL]_ , September 2023.  URL http://arxiv.org/abs/2309.11495.
  * Huang et al. 2022 Wenlong Huang, Fei Xia, Ted Xiao, Harris Chan, Jacky Liang, Pete Florence, Andy Zeng, Jonathan Tompson, Igor Mordatch, Yevgen Chebotar, Pierre Sermanet, Noah Brown, Tomas Jackson, Linda Luu, Sergey Levine, Karol Hausman, and Brian Ichter.  Inner monologue: Embodied reasoning through planning with language models.  _arXiv [cs.RO]_ , July 2022.  URL http://arxiv.org/abs/2207.05608.
  * Kojima et al. 2022 Takeshi Kojima, Shixiang Shane Gu, Machel Reid, Yutaka Matsuo, and Yusuke Iwasawa.  Large language models are zero-shot reasoners.  _arXiv [cs.CL]_ , pages 22199–22213, May 2022.  URL https://proceedings.neurips.cc/paper_files/paper/2022/file/8bb0d291acd4acf06ef112099c16f326-Paper-Conference.pdf.
  * Wei et al. 2022 Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, E Chi, F Xia, Quoc Le, and Denny Zhou.  Chain of thought prompting elicits reasoning in large language models.  _Neural Inf Process Syst_ , abs/2201.11903, January 2022.  URL http://arxiv.org/abs/2201.11903.
  * Wang et al. 2022c Xuezhi Wang, Jason Wei, Dale Schuurmans, Quoc Le, Ed Chi, Sharan Narang, Aakanksha Chowdhery, and Denny Zhou.  Self-consistency improves chain of thought reasoning in language models.  _arXiv [cs.CL]_ , March 2022c.  URL http://arxiv.org/abs/2203.11171.
  * Yao et al. 2022 Shunyu Yao, Jeffrey Zhao, Dian Yu, Nan Du, Izhak Shafran, Karthik Narasimhan, and Yuan Cao.  ReAct: Synergizing reasoning and acting in language models.  _arXiv [cs.CL]_ , October 2022.  URL http://arxiv.org/abs/2210.03629.
  * Hao et al. 2023 Shibo Hao, Yi Gu, Haodi Ma, Joshua Jiahua Hong, Zhen Wang, Daisy Zhe Wang, and Zhiting Hu.  Reasoning with language model is planning with world model.  _arXiv [cs.CL]_ , May 2023.  URL http://arxiv.org/abs/2305.14992.
  * Liu et al. 2023d Hao Liu, Carmelo Sferrazza, and Pieter Abbeel.  Chain of hindsight aligns language models with feedback.  _arXiv [cs.LG]_ , February 2023d.  URL http://arxiv.org/abs/2302.02676.
  * Yao et al. 2023 Shunyu Yao, Dian Yu, Jeffrey Zhao, Izhak Shafran, Thomas L Griffiths, Yuan Cao, and Karthik Narasimhan.  Tree of thoughts: Deliberate problem solving with large language models.  _arXiv [cs.CL]_ , May 2023.  URL http://arxiv.org/abs/2305.10601.
  * Kang et al. 2023a Jikun Kang, Romain Laroche, Xingdi Yuan, Adam Trischler, Xue Liu, and Jie Fu.  Think before you act: Decision transformers with working memory.  _arXiv [cs.LG]_ , May 2023a.  URL http://arxiv.org/abs/2305.16338.
  * Qian et al. 2024b Cheng Qian, Shihao Liang, Yujia Qin, Yining Ye, Xin Cong, Yankai Lin, Yesai Wu, Zhiyuan Liu, and Maosong Sun.  Investigate-consolidate-exploit: A general strategy for inter-task agent self-evolution.  _arXiv [cs.CL]_ , January 2024b.  URL http://arxiv.org/abs/2401.13996.
  * Anil et al. 2023 Rohan Anil, Andrew M Dai, Orhan Firat, Melvin Johnson, Dmitry Lepikhin, Alexandre Passos, Siamak Shakeri, Emanuel Taropa, Paige Bailey, Zhifeng Chen, Eric Chu, Jonathan H Clark, Laurent El Shafey, Yanping Huang, Kathy Meier-Hellstern, Gaurav Mishra, Erica Moreira, Mark Omernick, Kevin Robinson, Sebastian Ruder, Yi Tay, Kefan Xiao, Yuanzhong Xu, Yujing Zhang, Gustavo Hernandez Abrego, Junwhan Ahn, Jacob Austin, Paul Barham, Jan Botha, James Bradbury, Siddhartha Brahma, Kevin Brooks, Michele Catasta, Yong Cheng, Colin Cherry, Christopher A Choquette-Choo, Aakanksha Chowdhery, Clément Crepy, Shachi Dave, Mostafa Dehghani, Sunipa Dev, Jacob Devlin, Mark Díaz, Nan Du, Ethan Dyer, Vlad Feinberg, Fangxiaoyu Feng, Vlad Fienber, Markus Freitag, Xavier Garcia, Sebastian Gehrmann, Lucas Gonzalez, Guy Gur-Ari, Steven Hand, Hadi Hashemi, Le Hou, Joshua Howland, Andrea Hu, Jeffrey Hui, Jeremy Hurwitz, Michael Isard, Abe Ittycheriah, Matthew Jagielski, Wenhao Jia, Kathleen Kenealy, Maxim Krikun, Sneha Kudugunta, Chang Lan, Katherine Lee, Benjamin Lee, Eric Li, Music Li, Wei Li, Yaguang Li, Jian Li, Hyeontaek Lim, Hanzhao Lin, Zhongtao Liu, Frederick Liu, Marcello Maggioni, Aroma Mahendru, Joshua Maynez, Vedant Misra, Maysam Moussalem, Zachary Nado, John Nham, Eric Ni, Andrew Nystrom, Alicia Parrish, Marie Pellat, Martin Polacek, Alex Polozov, Reiner Pope, Siyuan Qiao, Emily Reif, Bryan Richter, Parker Riley, Alex Castro Ros, Aurko Roy, Brennan Saeta, Rajkumar Samuel, Renee Shelby, Ambrose Slone, Daniel Smilkov, David R So, Daniel Sohn, Simon Tokumine, Dasha Valter, Vijay Vasudevan, Kiran Vodrahalli, Xuezhi Wang, Pidong Wang, Zirui Wang, Tao Wang, John Wieting, Yuhuai Wu, Kelvin Xu, Yunhan Xu, Linting Xue, Pengcheng Yin, Jiahui Yu, Qiao Zhang, Steven Zheng, Ce Zheng, Weikang Zhou, Denny Zhou, Slav Petrov, and Yonghui Wu.  PaLM 2 technical report.  _arXiv [cs.CL]_ , May 2023.  URL http://arxiv.org/abs/2305.10403.
  * Cobbe et al. 2021 Karl Cobbe, Vineet Kosaraju, Mohammad Bavarian, Mark Chen, Heewoo Jun, Lukasz Kaiser, Matthias Plappert, Jerry Tworek, Jacob Hilton, Reiichiro Nakano, Christopher Hesse, and John Schulman.  Training verifiers to solve math word problems.  _arXiv [cs.LG]_ , October 2021.  URL http://arxiv.org/abs/2110.14168.
  * Jie et al. 2022 Zhanming Jie, Jierui Li, and Wei Lu.  Learning to reason deductively: Math word problem solving as complex relation extraction.  _arXiv [cs.CL]_ , March 2022.  URL http://arxiv.org/abs/2203.10316.
  * Lan et al. 2021 Yihuai Lan, Lei Wang, Qiyuan Zhang, Yunshi Lan, Bing Tian Dai, Yan Wang, Dongxiang Zhang, and Ee-Peng Lim.  MWPToolkit: An open-source framework for deep learning-based math word problem solvers.  _arXiv [cs.CL]_ , September 2021.  URL http://arxiv.org/abs/2109.00799.
  * Besta et al. 2023 Maciej Besta, Nils Blach, Ales Kubicek, Robert Gerstenberger, Michal Podstawski, Lukas Gianinazzi, Joanna Gajda, Tomasz Lehmann, Hubert Niewiadomski, Piotr Nyczyk, and Torsten Hoefler.  Graph of thoughts: Solving elaborate problems with large language models.  _arXiv [cs.CL]_ , August 2023.  URL http://arxiv.org/abs/2308.09687.
  * Sel et al. 2023 Bilgehan Sel, Ahmad Al-Tawaha, Vanshaj Khattar, Ruoxi Jia, and Ming Jin.  Algorithm of thoughts: Enhancing exploration of ideas in large language models.  _arXiv [cs.CL]_ , August 2023.  URL http://arxiv.org/abs/2308.10379.
  * Liang et al. 2023 Tian Liang, Zhiwei He, Wenxiang Jiao, Xing Wang, Yan Wang, Rui Wang, Yujiu Yang, Zhaopeng Tu, and Shuming Shi.  Encouraging divergent thinking in large language models through multi-agent debate.  _arXiv [cs.CL]_ , May 2023.  URL http://arxiv.org/abs/2305.19118.
  * Du et al. 2023 Yilun Du, Shuang Li, Antonio Torralba, Joshua B Tenenbaum, and Igor Mordatch.  Improving factuality and reasoning in language models through multiagent debate.  _arXiv [cs.CL]_ , May 2023.  URL http://arxiv.org/abs/2305.14325.
  * Chan et al. 2023 Chi-Min Chan, Weize Chen, Yusheng Su, Jianxuan Yu, Wei Xue, Shan Zhang, Jie Fu, and Zhiyuan Liu.  ChatEval: Towards better LLM-based evaluators through multi-agent debate.  _ArXiv_ , abs/2308.07201, August 2023.  ISSN 2331-8422.  doi:10.48550/arXiv.2308.07201.  URL http://dx.doi.org/10.48550/arXiv.2308.07201.
  * Song et al. 2022 Chan Hee Song, Jiaman Wu, Clayton Washington, Brian M Sadler, Wei-Lun Chao, and Yu Su.  LLM-planner: Few-shot grounded planning for embodied agents with large language models.  _arXiv [cs.AI]_ , December 2022.  URL http://arxiv.org/abs/2212.04088.
  * Liu et al. 2023e Bo Liu, Yuqian Jiang, Xiaohan Zhang, Qiang Liu, Shiqi Zhang, Joydeep Biswas, and Peter Stone.  LLM+P: Empowering large language models with optimal planning proficiency.  _arXiv [cs.AI]_ , April 2023e.  URL http://arxiv.org/abs/2304.11477.
  * Madaan et al. 2023 Aman Madaan, Niket Tandon, Prakhar Gupta, Skyler Hallinan, Luyu Gao, Sarah Wiegreffe, Uri Alon, Nouha Dziri, Shrimai Prabhumoye, Yiming Yang, Shashank Gupta, Bodhisattwa Prasad Majumder, Katherine Hermann, Sean Welleck, Amir Yazdanbakhsh, and Peter Clark.  Self-refine: Iterative refinement with self-feedback.  _arXiv [cs.CL]_ , March 2023.  URL http://arxiv.org/abs/2303.17651.
  * Xi et al. 2023b Zhiheng Xi, Senjie Jin, Yuhao Zhou, Rui Zheng, Songyang Gao, Tao Gui, Qi Zhang, and Xuanjing Huang.  Self-polish: Enhance reasoning in large language models via problem refinement.  _arXiv [cs.CL]_ , May 2023b.  URL http://arxiv.org/abs/2305.14497.
  * Zhang et al. 2024c Yusen Zhang, Ruoxi Sun, Yanfei Chen, Tomas Pfister, Rui Zhang, and Sercan Ö Arik.  Chain of agents: Large language models collaborating on long-context tasks.  _arXiv [cs.CL]_ , June 2024c.  URL http://arxiv.org/abs/2406.02818.
  * Wang et al. 2023e Zihao Wang, Shaofei Cai, Guanzhou Chen, Anji Liu, Xiaojian Ma, and Yitao Liang.  Describe, explain, plan and select: Interactive planning with large language models enables open-world multi-task agents.  _arXiv [cs.AI]_ , February 2023e.  URL http://arxiv.org/abs/2302.01560.
  * Deshpande et al. 2023 Ameet Deshpande, Vishvak Murahari, Tanmay Rajpurohit, Ashwin Kalyan, and Karthik Narasimhan.  Toxicity in ChatGPT: Analyzing persona-assigned language models.  _arXiv [cs.CL]_ , April 2023.  URL http://arxiv.org/abs/2304.05335.
  * Hong et al. 2023 Sirui Hong, Mingchen Zhuge, Jonathan Chen, Xiawu Zheng, Yuheng Cheng, Ceyao Zhang, Jinlin Wang, Zili Wang, Steven Ka Shing Yau, Zijuan Lin, Liyang Zhou, Chenyu Ran, Lingfeng Xiao, Chenglin Wu, and Jurgen Schmidhuber.  MetaGPT: Meta programming for a multi-agent collaborative framework.  _arXiv [cs.AI]_ , August 2023.  URL http://arxiv.org/abs/2308.00352.
  * Li et al. 2023 Guohao Li, Hasan Abed Al Kader Hammoud, Hani Itani, Dmitrii Khizbullin, and Bernard Ghanem.  CAMEL: Communicative agents for “mind” exploration of large language model society.  _arXiv [cs.AI]_ , March 2023.  URL http://arxiv.org/abs/2303.17760.
  * Jinxin et al. 2023 Shi Jinxin, Zhao Jiabao, Wang Yilei, Wu Xingjiao, Li Jiawen, and He Liang.  CGMI: Configurable general multi-agent interaction framework.  _arXiv [cs.AI]_ , August 2023.  URL http://arxiv.org/abs/2308.12503.
  * Qian et al. 2023a Chen Qian, Xin Cong, Wei Liu, Cheng Yang, Weize Chen, Yusheng Su, Yufan Dang, Jiahao Li, Juyuan Xu, Dahai Li, Zhiyuan Liu, and Maosong Sun.  Communicative agents for software development.  _arXiv [cs.SE]_ , July 2023a.  URL http://arxiv.org/abs/2307.07924.
  * Shao et al. 2023 Yunfan Shao, Linyang Li, Junqi Dai, and Xipeng Qiu.  Character-LLM: A trainable agent for role-playing.  _arXiv [cs.CL]_ , October 2023.  URL http://arxiv.org/abs/2310.10158.
  * Ke et al. 2023 Pei Ke, Bosi Wen, Zhuoer Feng, Xiao Liu, Xuanyu Lei, Jiale Cheng, Shengyuan Wang, Aohan Zeng, Yuxiao Dong, Hongning Wang, Jie Tang, and Minlie Huang.  CritiqueLLM: Scaling LLM-as-critic for effective and explainable evaluation of large language model generation.  _arXiv [cs.CL]_ , November 2023.  URL http://arxiv.org/abs/2311.18702.
  * Wang et al. 2023f Lei Wang, Jingsen Zhang, Hao Yang, Zhiyuan Chen, Jiakai Tang, Zeyu Zhang, Xu Chen, Yankai Lin, Ruihua Song, Wayne Xin Zhao, Jun Xu, Zhicheng Dou, Jun Wang, and Ji-Rong Wen.  User behavior simulation with large language model based agents.  _arXiv [cs.IR]_ , June 2023f.  URL http://arxiv.org/abs/2306.02552.
  * Argyle et al. 2023 Lisa P Argyle, Ethan C Busby, Nancy Fulda, Joshua R Gubler, Christopher Rytting, and David Wingate.  Out of one, many: Using language models to simulate human samples.  _Polit. Anal._ , 31(3):337–351, July 2023.  ISSN 1047-1987, 1476-4989.  doi:10.1017/pan.2023.2.  URL https://www.cambridge.org/core/journals/political-analysis/article/out-of-one-many-using-language-models-to-simulate-human-samples/035D7C8A55B237942FB6DBAD7CAA4E49.
  * Kirillov et al. 2023 Alexander Kirillov, Eric Mintun, Nikhila Ravi, Hanzi Mao, Chloe Rolland, Laura Gustafson, Tete Xiao, Spencer Whitehead, Alexander C Berg, Wan-Yen Lo, Piotr Dollár, and Ross Girshick.  Segment anything.  _arXiv [cs.CV]_ , April 2023.  URL http://arxiv.org/abs/2304.02643.
  * Open 2023 AI Open.  GPT-4V(ision) system card, 2023.  URL https://cdn.openai.com/papers/GPTV_System_Card.pdf.
  * Liu et al. 2023f Haotian Liu, Chunyuan Li, Qingyang Wu, and Yong Jae Lee.  Visual instruction tuning.  _arXiv [cs.CV]_ , April 2023f.  URL http://arxiv.org/abs/2304.08485.
  * Zhao et al. 2023b Yang Zhao, Zhijie Lin, Daquan Zhou, Zilong Huang, Jiashi Feng, and Bingyi Kang.  BuboGPT: Enabling visual grounding in multi-modal LLMs.  _arXiv [cs.CV]_ , July 2023b.  URL http://arxiv.org/abs/2307.08581.
  * Lyu et al. 2023 Chenyang Lyu, Minghao Wu, Longyue Wang, Xinting Huang, Bingshuai Liu, Zefeng Du, Shuming Shi, and Zhaopeng Tu.  Macaw-LLM: Multi-modal language modeling with image, audio, video, and text integration.  _arXiv [cs.CL]_ , June 2023.  URL http://arxiv.org/abs/2306.09093.
  * Wang et al. 2024b Chenyu Wang, Weixin Luo, Qianyu Chen, Haonan Mai, Jindi Guo, Sixun Dong, Xiaohua, Xuan, Zhengxin Li, Lin Ma, and Shenghua Gao.  Tool-LMM: A large multi-modal model for tool agent learning.  _arXiv [cs.CV]_ , January 2024b.  URL http://arxiv.org/abs/2401.10727.
  * Gao et al. 2023 Difei Gao, Lei Ji, Luowei Zhou, Kevin Qinghong Lin, Joya Chen, Zihan Fan, and Mike Zheng Shou.  AssistGPT: A general multi-modal assistant that can plan, execute, inspect, and learn.  _arXiv [cs.CV]_ , June 2023.  URL http://arxiv.org/abs/2306.08640.
  * Wang et al. 2023g Guanzhi Wang, Yuqi Xie, Yunfan Jiang, Ajay Mandlekar, Chaowei Xiao, Yuke Zhu, Linxi Fan, and Anima Anandkumar.  Voyager: An open-ended embodied agent with large language models.  _arXiv [cs.AI]_ , May 2023g.  URL http://arxiv.org/abs/2305.16291.
  * Ahn et al. 2022 Michael Ahn, Anthony Brohan, Noah Brown, Yevgen Chebotar, Omar Cortes, Byron David, Chelsea Finn, Chuyuan Fu, Keerthana Gopalakrishnan, Karol Hausman, Alex Herzog, Daniel Ho, Jasmine Hsu, Julian Ibarz, Brian Ichter, Alex Irpan, Eric Jang, Rosario Jauregui Ruano, Kyle Jeffrey, Sally Jesmonth, Nikhil J Joshi, Ryan Julian, Dmitry Kalashnikov, Yuheng Kuang, Kuang-Huei Lee, Sergey Levine, Yao Lu, Linda Luu, Carolina Parada, Peter Pastor, Jornell Quiambao, Kanishka Rao, Jarek Rettinghouse, Diego Reyes, Pierre Sermanet, Nicolas Sievers, Clayton Tan, Alexander Toshev, Vincent Vanhoucke, Fei Xia, Ted Xiao, Peng Xu, Sichun Xu, Mengyuan Yan, and Andy Zeng.  Do as I can, not as I say: Grounding language in robotic affordances.  _arXiv [cs.RO]_ , April 2022.  URL http://arxiv.org/abs/2204.01691.
  * Chen et al. 2021 Mark Chen, Jerry Tworek, Heewoo Jun, Qiming Yuan, Henrique Ponde de Oliveira Pinto, Jared Kaplan, Harri Edwards, Yuri Burda, Nicholas Joseph, Greg Brockman, Alex Ray, Raul Puri, Gretchen Krueger, Michael Petrov, Heidy Khlaaf, Girish Sastry, Pamela Mishkin, Brooke Chan, Scott Gray, Nick Ryder, Mikhail Pavlov, Alethea Power, Lukasz Kaiser, Mohammad Bavarian, Clemens Winter, Philippe Tillet, Felipe Petroski Such, Dave Cummings, Matthias Plappert, Fotios Chantzis, Elizabeth Barnes, Ariel Herbert-Voss, William Hebgen Guss, Alex Nichol, Alex Paino, Nikolas Tezak, Jie Tang, Igor Babuschkin, Suchir Balaji, Shantanu Jain, William Saunders, Christopher Hesse, Andrew N Carr, Jan Leike, Josh Achiam, Vedant Misra, Evan Morikawa, Alec Radford, Matthew Knight, Miles Brundage, Mira Murati, Katie Mayer, Peter Welinder, Bob McGrew, Dario Amodei, Sam McCandlish, Ilya Sutskever, and Wojciech Zaremba.  Evaluating large language models trained on code.  _arXiv [cs.LG]_ , July 2021.  URL http://arxiv.org/abs/2107.03374.
  * Qin et al. 2023 Yujia Qin, Shengding Hu, Yankai Lin, Weize Chen, Ning Ding, Ganqu Cui, Zheni Zeng, Yufei Huang, Chaojun Xiao, Chi Han, Yi Ren Fung, Yusheng Su, Huadong Wang, Cheng Qian, Runchu Tian, Kunlun Zhu, Shihao Liang, Xingyu Shen, Bokai Xu, Zhen Zhang, Yining Ye, Bowen Li, Ziwei Tang, Jing Yi, Yuzhang Zhu, Zhenning Dai, Lan Yan, Xin Cong, Yaxi Lu, Weilin Zhao, Yuxiang Huang, Junxi Yan, Xu Han, Xian Sun, Dahai Li, Jason Phang, Cheng Yang, Tongshuang Wu, Heng Ji, Zhiyuan Liu, and Maosong Sun.  Tool learning with foundation models.  _arXiv [cs.CL]_ , April 2023.  URL https://github.com/OpenBMB/BMTools.
  * Nakano et al. 2021 Reiichiro Nakano, Jacob Hilton, Suchir Balaji, Jeff Wu, Long Ouyang, Christina Kim, Christopher Hesse, Shantanu Jain, Vineet Kosaraju, William Saunders, Xu Jiang, Karl Cobbe, Tyna Eloundou, Gretchen Krueger, Kevin Button, Matthew Knight, Benjamin Chess, and John Schulman.  WebGPT: Browser-assisted question-answering with human feedback.  _arXiv [cs.CL]_ , December 2021.  URL http://arxiv.org/abs/2112.09332.
  * Schick et al. 2023 Timo Schick, Jane Dwivedi-Yu, Roberto Dessì, Roberta Raileanu, Maria Lomeli, Luke Zettlemoyer, Nicola Cancedda, and Thomas Scialom.  Toolformer: Language models can teach themselves to use tools.  _arXiv [cs.CL]_ , February 2023.  URL http://arxiv.org/abs/2302.04761.
  * Parisi et al. 2022 Aaron Parisi, Yao Zhao, and Noah Fiedel.  TALM: Tool augmented language models.  _arXiv [cs.CL]_ , May 2022.  URL http://arxiv.org/abs/2205.12255.
  * Qian et al. 2023b Cheng Qian, Chenyan Xiong, Zhenghao Liu, and Zhiyuan Liu.  Toolink: Linking toolkit creation and using through chain-of-solving on open-source model.  _arXiv [cs.CL]_ , October 2023b.  URL http://arxiv.org/abs/2310.05155.
  * Karpas et al. 2022 Ehud Karpas, Omri Abend, Yonatan Belinkov, Barak Lenz, Opher Lieber, Nir Ratner, Yoav Shoham, Hofit Bata, Yoav Levine, Kevin Leyton-Brown, Dor Muhlgay, Noam Rozen, Erez Schwartz, Gal Shachaf, Shai Shalev-Shwartz, Amnon Shashua, and Moshe Tenenholtz.  MRKL systems: A modular, neuro-symbolic architecture that combines large language models, external knowledge sources and discrete reasoning.  _arXiv [cs.CL]_ , May 2022.  URL http://arxiv.org/abs/2205.00445.
  * Chen et al. 2023a Zhipeng Chen, Kun Zhou, Beichen Zhang, Zheng Gong, Wayne Xin Zhao, and Ji-Rong Wen.  ChatCoT: Tool-augmented chain-of-thought reasoning on chat-based large language models.  _arXiv [cs.CL]_ , May 2023a.  URL http://arxiv.org/abs/2305.14323.
  * Cai et al. 2023a Tianle Cai, Xuezhi Wang, Tengyu Ma, Xinyun Chen, and Denny Zhou.  Large language models as tool makers.  _arXiv [cs.LG]_ , May 2023a.  URL http://arxiv.org/abs/2305.17126.
  * Qian et al. 2023c Cheng Qian, Chi Han, Yi R Fung, Yujia Qin, Zhiyuan Liu, and Heng Ji.  CREATOR: Disentangling abstract and concrete reasonings of large language models through tool creation.  _arXiv [cs.CL]_ , May 2023c.  URL http://arxiv.org/abs/2305.14318.
  * Yuan et al. 2023 Lifan Yuan, Yangyi Chen, Xingyao Wang, Yi R Fung, Hao Peng, and Heng Ji.  CRAFT: Customizing LLMs by creating and retrieving from specialized toolsets.  _arXiv [cs.CL]_ , September 2023.  URL http://arxiv.org/abs/2309.17428.
  * 443 Hilmy Abiyyu A.  Flaticon.  https://www.flaticon.com/authors/hilmy-abiyyu-a.  Accessed: 2024-5-1.
  * 444 Laisa Islam Ani.  Flaticon.  https://www.flaticon.com/authors/laisa-islam-ani.  Accessed: 2024-5-1.
  * 445 Freepik.  Flaticon.  https://www.flaticon.com/authors/freepik.  Accessed: 2024-5-1.
  * 446 Kiranshastry.  Flaticon.  https://www.flaticon.com/authors/kiranshastry.  Accessed: 2024-5-1.
  * Chiang et al. 2024 Yuan Chiang, Elvis Hsieh, Chia-Hong Chou, and Janosh Riebesell.  LLaMP: Large language model made powerful for high-fidelity materials knowledge retrieval and distillation.  _arXiv [cs.CL]_ , January 2024.  URL http://arxiv.org/abs/2401.17244.
  * Ma et al. 2024a Pingchuan Ma, Tsun-Hsuan Wang, Minghao Guo, Zhiqing Sun, Joshua B Tenenbaum, Daniela Rus, Chuang Gan, and Wojciech Matusik.  LLM and simulation as bilevel optimizers: A new paradigm to advance physical scientific discovery.  _arXiv [cs.LG]_ , May 2024a.  URL http://arxiv.org/abs/2405.09783.
  * Qu et al. 2024 Yuanhao Qu, Kaixuan Huang, Henry Cousins, William A Johnson, Di Yin, Mihir Shah, Denny Zhou, Russ Altman, Mengdi Wang, and Le Cong.  CRISPR-GPT: An LLM agent for automated design of gene-editing experiments.  _bioRxiv_ , April 2024.  doi:10.1101/2024.04.25.591003.  URL http://dx.doi.org/10.48550/arXiv.2404.18021.
  * Liu et al. 2024b Haoyang Liu, Yijiang Li, Jinglin Jian, Yuxuan Cheng, Jianrong Lu, Shuyi Guo, Jinglei Zhu, Mianchen Zhang, Miantong Zhang, and Haohan Wang.  Toward a team of AI-made scientists for scientific discovery from gene expression data.  _arXiv [q-bio.GN]_ , February 2024b.  URL http://arxiv.org/abs/2402.12391.
  * Sprueill et al. 2024 Henry W Sprueill, Carl Edwards, Khushbu Agarwal, Mariefel V Olarte, Udishnu Sanyal, Conrad Johnston, Hongbin Liu, Heng Ji, and Sutanay Choudhury.  ChemReasoner: Heuristic search over a large language model’s knowledge space using quantum-chemical feedback.  _arXiv [physics.chem-ph]_ , February 2024.  URL http://arxiv.org/abs/2402.10980.
  * Ma et al. 2024b Yubo Ma, Zhibin Gou, Junheng Hao, Ruochen Xu, Shuohang Wang, Liangming Pan, Yujiu Yang, Yixin Cao, and Aixin Sun.  SciAgent: Tool-augmented language models for scientific reasoning.  _arXiv [cs.CL]_ , February 2024b.  URL http://arxiv.org/abs/2402.11451.
  * Shao et al. 2024 Yijia Shao, Yucheng Jiang, Theodore A Kanell, Peter Xu, Omar Khattab, and Monica S Lam.  Assisting in writing wikipedia-like articles from scratch with large language models.  _arXiv [cs.CL]_ , February 2024.  URL http://arxiv.org/abs/2402.14207.
  * Völker et al. 2024 Christoph Völker, Tehseen Rug, Kevin Maik Jablonka, and Sabine Kruschwitz.  LLMs can design sustainable concrete – a systematic benchmark.  February 2024.  URL https://www.researchsquare.com/article/rs-3913272/v1.
  * Ghafarollahi and Buehler 2024 A Ghafarollahi and M J Buehler.  ProtAgents: Protein discovery via large language model multi-agent collaborations combining physics and machine learning.  _arXiv [cond-mat.soft]_ , January 2024.  URL http://arxiv.org/abs/2402.04268.
  * Lála et al. 2023 Jakub Lála, Odhran O’Donoghue, Aleksandar Shtedritski, Sam Cox, Samuel G Rodriques, and Andrew D White.  PaperQA: Retrieval-augmented generative agent for scientific research.  _arXiv [cs.CL]_ , December 2023.  URL http://arxiv.org/abs/2312.07559.
  * Sam Cox, Michael Hammerling, Jakub Lála, Jon Laurent, Sam Rodriques, Matt Rubashkin, Andrew White 2023 Sam Cox, Michael Hammerling, Jakub Lála, Jon Laurent, Sam Rodriques, Matt Rubashkin, Andrew White.  WikiCrow: Automating synthesis of human scientific knowledge.  https://www.futurehouse.org/wikicrow, 2023.  URL https://www.futurehouse.org/wikicrow.  Accessed: 2024-2-15.
  * Ansari and Moosavi 2023 Mehrad Ansari and Seyed Mohamad Moosavi.  Agent-based learning of materials datasets from scientific literature.  _arXiv [cs.AI]_ , December 2023.  URL http://arxiv.org/abs/2312.11690.
  * Prince et al. 2023 Michael H Prince, Henry Chan, Aikaterini Vriza, Tao Zhou, Varuni K Sastry, Matthew T Dearing, Ross J Harder, Rama K Vasudevan, and Mathew J Cherukara.  Opportunities for retrieval and tool augmented large language models in scientific facilities.  _arXiv [cs.CE]_ , December 2023.  URL http://arxiv.org/abs/2312.01291.
  * Liu et al. 2023g Yiren Liu, Si Chen, Haocong Cheng, Mengxia Yu, Xiao Ran, Andrew Mo, Yiliu Tang, and Yun Huang.  CoQuest: Exploring research question co-creation with an LLM-based agent.  _arXiv [cs.HC]_ , October 2023g.  URL http://arxiv.org/abs/2310.06155.
  * O’Donoghue et al. 2023 Odhran O’Donoghue, Aleksandar Shtedritski, John Ginger, Ralph Abboud, Ali Essa Ghareeb, Justin Booth, and Samuel G Rodriques.  BioPlanner: Automatic evaluation of LLMs on protocol planning in biology.  _arXiv [cs.CL]_ , October 2023.  URL http://arxiv.org/abs/2310.10632.
  * Janakarajan et al. 2023 Nikita Janakarajan, Tim Erdmann, Sarath Swaminathan, Teodoro Laino, and Jannis Born.  Language models in molecular discovery.  _arXiv [physics.chem-ph]_ , September 2023.  URL http://arxiv.org/abs/2309.16235.
  * Kang and Kim 2023 Yeonghun Kang and Jihan Kim.  ChatMOF: An autonomous AI system for predicting and generating metal-organic frameworks.  _arXiv [cs.CL]_ , July 2023.  URL http://arxiv.org/abs/2308.01423.
  * Mouriño et al. 2023 Beatriz Mouriño, Elias Moubarak, Joren Van Herck, Sauradeep Majumdar, and Xiaoqi Zhang.  i-digest: v1.0, 2023.  URL https://zenodo.org/record/8080962.
  * Rankovic et al. 2023 Bojana Rankovic, Andres M Bran, and Philippe Schwaller.  BOLLaMa: BOLLaMA interface working with CHAOS, 2023.  URL https://zenodo.org/record/8096827.
  * Kruschwitz et al. 2023 Sabine Kruschwitz, Christoph Völker, and Ghezal Ahmad Zia.  Text2Concrete, 2023.  URL https://zenodo.org/record/8091195.
  * Ramos et al. 2023a Mayk Caldas Ramos, Sam Cox, and Andrew White.  MAPI_LLM: MAPI_LLM first release, 2023a.  URL https://zenodo.org/record/8097336.
  * Ramos et al. 2023b Mayk Caldas Ramos, Shane S Michtavy, Marc D Porosoff, and Andrew D White.  Bayesian optimization of catalysts with in-context learning.  _arXiv [physics.chem-ph]_ , April 2023b.  URL http://arxiv.org/abs/2304.05341.
  * Hocky and White 2022 Glen M Hocky and Andrew D White.  Natural language processing models that automate programming will transform chemistry research and teaching.  _Digit. Discov._ , 1(2):79–83, April 2022.  ISSN 2635-098X.  doi:10.1039/d1dd00009h.  URL https://pubs.rsc.org/en/content/articlelanding/2022/dd/d1dd00009h.
  * White et al. 2023 Andrew D White, Glen M Hocky, Heta A Gandhi, Mehrad Ansari, Sam Cox, Geemi P Wellawatte, Subarna Sasmal, Ziyue Yang, Kangxin Liu, Yuvraj Singh, and Willmor J Peña Ccoa.  Assessment of chemistry knowledge in large language models that generate code.  _Digital Discovery_ , 2(2):368–376, April 2023.  ISSN 2635-098X.  doi:10.1039/D2DD00087C.  URL https://pubs.rsc.org/en/content/articlelanding/2023/dd/d2dd00087c.
  * Kristiadi et al. 2024 Agustinus Kristiadi, Felix Strieth-Kalthoff, Marta Skreta, Pascal Poupart, Alán Aspuru-Guzik, and Geoff Pleiss.  A sober look at LLMs for material discovery: Are they actually good for bayesian optimization over molecules?  _arXiv [cs.LG]_ , February 2024.  URL http://arxiv.org/abs/2402.05015.
  * Ranković and Schwaller 2023 Bojana Ranković and Philippe Schwaller.  BoChemian: Large language model embeddings for bayesian optimization of chemical reactions.  December 2023.  URL https://openreview.net/pdf?id=A1RVn1m3J3.
  * Jablonka et al. 2023 K Jablonka, Qianxiang Ai, Alexander H Al-Feghali, S Badhwar, Joshua D Bocarsly Andres Bran, S Bringuier, L Brinson, K Choudhary, Defne Circi, Sam Cox, W D Jong, Matthew L Evans, Nicolas Gastellu, Jerome Genzling, M Gil, Ankur Gupta, Zhi Hong, A Imran, S Kruschwitz, A Labarre, Jakub L’ala, Tao Liu, Steven Ma, Sauradeep Majumdar, G Merz, N Moitessier, E Moubarak, B Mouriño, Brenden G Pelkie, M Pieler, M C Ramos, Bojana Rankovi’c, Samuel G Rodriques, J N Sanders, P Schwaller, Marcus Schwarting, Jia-Xin Shi, B Smit, Benn Smith, J V Heck, C Volker, Logan T Ward, S Warren, B Weiser, Sylvester Zhang, Xiaoqi Zhang, Ghezal Ahmad Jan Zia, A Scourtas, K Schmidt, Ian T Foster, Andrew D White, and B Blaiszik.  14 examples of how LLMs can transform materials science and chemistry: a reflection on a large language model hackathon.  _Digit. Discov._ , 2(5):1233–1250, June 2023.  ISSN 2635-098X.  doi:10.1039/D3DD00113J.  URL https://pubs.rsc.org/en/content/articlelanding/2023/dd/d3dd00113j.
  * Ranković et al. 2023 Bojana Ranković, Ryan-Rhys Griffiths, Henry B Moss, and Philippe Schwaller.  Bayesian optimisation for additive screening and yield improvements in chemical reactions – beyond one-hot encoding.  _ChemRxiv_ , June 2023.  doi:10.26434/chemrxiv-2022-nll2j-v3.  URL https://chemrxiv.org/engage/chemrxiv/article-details/6489f95c4f8b1884b74b69c8.
  * Weiser et al. 2023 Benjamin Weiser, Jerome Genzling, Nicolas Gastellu, Sylvester Zhang, Tao Liu, Alexander Al-Feghali, Nicolas Moitessier, Anne Labarre, and Steven Ma.  LLM-Guided-GA: LLM-Guided-GA digital discovery release, 2023.  URL https://zenodo.org/record/8125541.
  * Circi and Badhwar 2023 Defne Circi and Shruti Badhwar.  InsightGraph: InsightGraph, 2023.  URL https://zenodo.org/record/8092575.
  * Zaabi et al. 2023 Marwa Zaabi, Walid Hariri, and Nadia Smaoui.  A review study of ChatGPT applications in education.  In _2023 International Conference on Innovations in Intelligent Systems and Applications (INISTA)_ , pages 1–5. IEEE, September 2023.  doi:10.1109/inista59065.2023.10310439.  URL http://dx.doi.org/10.1109/INISTA59065.2023.10310439.
  * Kasneci et al. 2023 Enkelejda Kasneci, Kathrin Sessler, Stefan Küchemann, Maria Bannert, Daryna Dementieva, Frank Fischer, Urs Gasser, Georg Groh, Stephan Günnemann, Eyke Hüllermeier, Stephan Krusche, Gitta Kutyniok, Tilman Michaeli, Claudia Nerdel, Jürgen Pfeffer, Oleksandra Poquet, Michael Sailer, Albrecht Schmidt, Tina Seidel, Matthias Stadler, Jochen Weller, Jochen Kuhn, and Gjergji Kasneci.  ChatGPT for good? on opportunities and challenges of large language models for education.  _Learn. Individ. Differ._ , 103(102274):102274, April 2023.  ISSN 1041-6080, 1873-3425.  doi:10.1016/j.lindif.2023.102274.  URL https://www.sciencedirect.com/science/article/pii/S1041608023000195.
  * Hellas et al. 2023 Arto Hellas, Juho Leinonen, Sami Sarsa, Charles Koutcheme, Lilja Kujanpaa, and Juha Sorva.  Exploring the responses of large language models to beginner programmers’ help requests.  _arXiv [cs.CY]_ , June 2023.  URL http://arxiv.org/abs/2306.05715.
  * Dan et al. 2023 Yuhao Dan, Zhikai Lei, Yiyang Gu, Yong Li, Jianghao Yin, Jiaju Lin, Linhao Ye, Zhiyan Tie, Yougen Zhou, Yilei Wang, Aimin Zhou, Ze Zhou, Qin Chen, Jie Zhou, Liang He, and Xipeng Qiu.  EduChat: A large-scale language model-based chatbot system for intelligent education.  _arXiv [cs.CL]_ , August 2023.  URL http://arxiv.org/abs/2308.02773.
  * Tian et al. 2024 Jie Tian, Jixin Hou, Zihao Wu, Peng Shu, Zhengliang Liu, Yujie Xiang, Beikang Gu, Nicholas Filla, Yiwei Li, Ning Liu, Xianyan Chen, Keke Tang, Tianming Liu, and Xianqiao Wang.  Assessing large language models in mechanical engineering education: A study on mechanics-focused conceptual understanding.  _arXiv [cs.CL]_ , January 2024.  URL http://arxiv.org/abs/2401.12983.
  * Radford et al. 2022 Alec Radford, Jong Wook Kim, Tao Xu, Greg Brockman, Christine McLeavey, and Ilya Sutskever.  Robust speech recognition via large-scale weak supervision.  _arXiv [eess.AS]_ , December 2022.  URL http://arxiv.org/abs/2212.04356.
  * Lewis et al. 2020 Patrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni, Vladimir Karpukhin, Naman Goyal, Heinrich Kuttler, Mike Lewis, Wen-Tau Yih, Tim Rocktaschel, Sebastian Riedel, and Douwe Kiela.  Retrieval-augmented generation for knowledge-intensive NLP tasks.  _arXiv [cs.CL]_ , May 2020.  URL http://arxiv.org/abs/2005.11401.
  * Chen et al. 2023b Kexin Chen, Junyou Li, Kunyi Wang, Yuyang Du, Jiahui Yu, Jiamin Lu, Lanqing Li, Jiezhong Qiu, Jianzhang Pan, Yi Huang, Qun Fang, Pheng Ann Heng, and Guangyong Chen.  Chemist-X: Large language model-empowered agent for reaction condition recommendation in chemical synthesis.  _arXiv [cs.IR]_ , November 2023b.  URL http://arxiv.org/abs/2311.10776.
  * Ingraham et al. 2023 John B Ingraham, Max Baranov, Zak Costello, Karl W Barber, Wujie Wang, Ahmed Ismail, Vincent Frappier, Dana M Lord, Christopher Ng-Thow-Hing, Erik R Van Vlack, Shan Tie, Vincent Xue, Sarah C Cowles, Alan Leung, João V Rodrigues, Claudio L Morales-Perez, Alex M Ayoub, Robin Green, Katherine Puentes, Frank Oplinger, Nishant V Panwar, Fritz Obermeyer, Adam R Root, Andrew L Beam, Frank J Poelwijk, and Gevorg Grigoryan.  Illuminating protein space with a programmable generative model.  _Nature_ , 623(7989):1070–1078, November 2023.  ISSN 0028-0836,1476-4687.  doi:10.1038/s41586-023-06728-8.  URL http://dx.doi.org/10.1038/s41586-023-06728-8.
  * Wu et al. 2024 Kevin E Wu, Kevin K Yang, Rianne van den Berg, Sarah Alamdari, James Y Zou, Alex X Lu, and Ava P Amini.  Protein structure generation via folding diffusion.  _Nat. Commun._ , 15(1):1059, February 2024.  ISSN 2041-1723.  doi:10.1038/s41467-024-45051-2.  URL http://dx.doi.org/10.1038/s41467-024-45051-2.
  * Tang et al. 2024 Xiangru Tang, Qiao Jin, Kunlun Zhu, Tongxin Yuan, Yichi Zhang, Wangchunshu Zhou, Meng Qu, Yilun Zhao, Jian Tang, Zhuosheng Zhang, Arman Cohan, Zhiyong Lu, and Mark Gerstein.  Prioritizing safeguarding over autonomy: Risks of LLM agents for science.  _arXiv [cs.CY]_ , February 2024.  URL http://arxiv.org/abs/2402.04247.
  * Ruan et al. 2024 Yixiang Ruan, Chenyin Lu, Ning Xu, Jian Zhang, Jun Xuan, Jianzhang Pan, Qun Fang, Hanyu Gao, Xiaodong Shen, Ning Ye, Qiang Zhang, and Yiming Mo.  Accelerated end-to-end chemical synthesis development with large language models.  _ChemRxiv_ , May 2024.  doi:10.26434/chemrxiv-2024-6wmg4.  URL https://chemrxiv.org/engage/chemrxiv/article-details/6634f02021291e5d1d58702c.
  * Zheng et al. 2023d Zhiling Zheng, Oufan Zhang, Christian Borgs, Jennifer T Chayes, and Omar M Yaghi.  ChatGPT Chemistry Assistant for Text Mining and the Prediction of MOF Synthesis.  _J. Am. Chem. Soc._ , 145(Copyright © 2024 American Chemical Society (ACS). All Rights Reserved.; Copyright © 2024 U.S. National Library of Medicine.):18048–18062, 2023d.  ISSN 0002-7863,1520-5126.  doi:10.1021/jacs.3c05819.  URL http://dx.doi.org/10.1021/jacs.3c05819.
  * Zhang et al. 2024d Wei Zhang, Qinggong Wang, Xiangtai Kong, Jiacheng Xiong, Shengkun Ni, Duanhua Cao, Buying Niu, Mingan Chen, Runze Zhang, Yitian Wang, Lehan Zhang, Xutong Li, Zhaoping Xiong, Qian Shi, Ziming Huang, Zunyun Fu, and Mingyue Zheng.  Fine-tuning large language models for chemical text mining.  _ChemRxiv_ , February 2024d.  doi:10.26434/chemrxiv-2023-k7ct5-v2.  URL https://chemrxiv.org/engage/chemrxiv/article-details/65baa07b9138d2316124f224.
  * Zheng et al. 2024 Zhiling Zheng, Zhiguo He, Omar Khattab, Nakul Rampal, Matei A Zaharia, Christian Borgs, Jennifer T Chayes, and Omar M Yaghi.  Image and data mining in reticular chemistry powered by GPT-4V.  _Digit. Discov._ , 3(3):491–501, 2024.  ISSN 2635-098X.  doi:10.1039/d3dd00239j.  URL https://pubs.rsc.org/en/content/articlelanding/2024/dd/d3dd00239j.
  * Zheng et al. 2023e Zhiling Zheng, Oufan Zhang, Ha L Nguyen, Nakul Rampal, Ali H Alawadhi, Zichao Rong, Teresa Head-Gordon, Christian Borgs, Jennifer T Chayes, and Omar M Yaghi.  ChatGPT research group for optimizing the crystallinity of MOFs and COFs.  _ACS Cent. Sci._ , 9(11):2161–2170, November 2023e.  ISSN 2374-7943,2374-7951.  doi:10.1021/acscentsci.3c01087.  URL https://pubs.acs.org/doi/full/10.1021/acscentsci.3c01087.
  * Nascimento et al. 2023 Nathalia Nascimento, Paulo Alencar, and Donald Cowan.  Self-adaptive large language model (LLM)-based multiagent systems.  In _2023 IEEE International Conference on Autonomic Computing and Self-Organizing Systems Companion (ACSOS-C)_ , pages 104–109. IEEE, September 2023.  ISBN 9798350337464.  doi:10.1109/ACSOS-C58168.2023.00048.  URL https://ieeexplore.ieee.org/document/10336211.
  * Niazi and Mariam 2023 Sarfaraz K Niazi and Zamara Mariam.  Recent advances in Machine-Learning-Based chemoinformatics: A comprehensive review.  _Int. J. Mol. Sci._ , 24(14), July 2023.  ISSN 1422-0067.  doi:10.3390/ijms241411488.  URL http://dx.doi.org/10.3390/ijms241411488.
  * McNaughton et al. 2024 Andrew D McNaughton, Gautham Ramalaxmi, Agustin Kruel, Carter R Knutson, Rohith A Varikoti, and Neeraj Kumar.  CACTUS: Chemistry agent connecting tool-usage to science.  _arXiv [cs.CL]_ , May 2024.  URL http://arxiv.org/abs/2405.00972.
  * Kang et al. 2023b Yeonghun Kang, Hyunsoo Park, Berend Smit, and Jihan Kim.  A multi-modal pre-training transformer for universal transfer learning in metal–organic frameworks.  _Nature Machine Intelligence_ , 5(3):309–318, March 2023b.  ISSN 2522-5839, 2522-5839.  doi:10.1038/s42256-023-00628-2.  URL https://www.nature.com/articles/s42256-023-00628-2.
  * Manica et al. 2023 Matteo Manica, Jannis Born, Joris Cadow, Dimitrios Christofidellis, Ashish Dave, Dean Clarke, Yves Gaetan Nana Teukam, Giorgio Giannone, Samuel C Hoffman, Matthew Buchan, Vijil Chenthamarakshan, Timothy Donovan, Hsiang Han Hsu, Federico Zipoli, Oliver Schilter, Akihiro Kishimoto, Lisa Hamada, Inkit Padhi, Karl Wehden, Lauren McHugh, Alexy Khrabrov, Payel Das, Seiji Takeda, and John R Smith.  Accelerating material design with the generative toolkit for scientific discovery.  _npj Computational Materials_ , 9(1):1–6, May 2023.  ISSN 2057-3960, 2057-3960.  doi:10.1038/s41524-023-01028-1.  URL https://www.nature.com/articles/s41524-023-01028-1.
  * 498 rxn4chemistry: Python wrapper for the IBM RXN for chemistry API.  URL https://github.com/rxn4chemistry/rxn4chemistry.
  * Gaiński et al. 2022 Piotr Gaiński, Lukasz Maziarka, Tomasz Danel, and Stanislaw Jastrzebski.  HuggingMolecules: An Open-Source library for Transformer-Based molecular property prediction (student abstract).  _AAAI_ , 36(11):12949–12950, June 2022.  ISSN 2374-3468, 2374-3468.  doi:10.1609/aaai.v36i11.21611.  URL https://ojs.aaai.org/index.php/AAAI/article/view/21611.
  * Landrum 2013 Greg Landrum.  Rdkit documentation.  _Release_ , 1(1-79):4, 2013.  ISSN 1047-935X, 1533-3752.  URL https://media.readthedocs.org/pdf/rdkit/latest/rdkit.pdf.
  * Zheng et al. 2023f Yizhen Zheng, Huan Yee Koh, Jiaxin Ju, Anh T N Nguyen, Lauren T May, Geoffrey I Webb, and Shirui Pan.  Large language models for scientific synthesis, inference and explanation.  _arXiv [cs.AI]_ , October 2023f.  URL http://arxiv.org/abs/2310.07984.
  * Wang et al. 2023h Qingyun Wang, Doug Downey, Heng Ji, and Tom Hope.  SciMON: Scientific inspiration machines optimized for novelty.  _arXiv [cs.CL]_ , May 2023h.  URL http://arxiv.org/abs/2305.14259.
  * Gu and Krenn 2024 Xuemei Gu and Mario Krenn.  Generation and human-expert evaluation of interesting research ideas using knowledge graphs and large language models.  _arXiv [cs.AI]_ , May 2024.  URL http://arxiv.org/abs/2405.17044.
  * Sprueill et al. 2023 Henry W Sprueill, Carl Edwards, Mariefel V Olarte, Udishnu Sanyal, Heng Ji, and Sutanay Choudhury.  Monte carlo thought search: Large language model querying for complex scientific reasoning in catalyst design.  _arXiv [cs.AI]_ , October 2023.  URL http://arxiv.org/abs/2310.14420.
  * Zhou et al. 2023 Gengmo Zhou, Zhifeng Gao, Qiankun Ding, Hang Zheng, Hongteng Xu, Zhewei Wei, Linfeng Zhang, and Guolin Ke.  Uni-Mol: A universal 3D molecular representation learning framework.  _ChemRxiv_ , March 2023.  doi:10.26434/chemrxiv-2022-jjm0j-v4.  URL https://chemrxiv.org/engage/chemrxiv/article-details/6402990d37e01856dc1d1581.
  * OpenAI et al. 2023 OpenAI, Josh Achiam, Steven Adler, Sandhini Agarwal, Lama Ahmad, Ilge Akkaya, Florencia Leoni Aleman, Diogo Almeida, Janko Altenschmidt, Sam Altman, Shyamal Anadkat, Red Avila, Igor Babuschkin, Suchir Balaji, Valerie Balcom, Paul Baltescu, Haiming Bao, Mohammad Bavarian, Jeff Belgum, Irwan Bello, Jake Berdine, Gabriel Bernadett-Shapiro, Christopher Berner, Lenny Bogdonoff, Oleg Boiko, Madelaine Boyd, Anna-Luisa Brakman, Greg Brockman, Tim Brooks, Miles Brundage, Kevin Button, Trevor Cai, Rosie Campbell, Andrew Cann, Brittany Carey, Chelsea Carlson, Rory Carmichael, Brooke Chan, Che Chang, Fotis Chantzis, Derek Chen, Sully Chen, Ruby Chen, Jason Chen, Mark Chen, Ben Chess, Chester Cho, Casey Chu, Hyung Won Chung, Dave Cummings, Jeremiah Currier, Yunxing Dai, Cory Decareaux, Thomas Degry, Noah Deutsch, Damien Deville, Arka Dhar, David Dohan, Steve Dowling, Sheila Dunning, Adrien Ecoffet, Atty Eleti, Tyna Eloundou, David Farhi, Liam Fedus, Niko Felix, Simón Posada Fishman, Juston Forte, Isabella Fulford, Leo Gao, Elie Georges, Christian Gibson, Vik Goel, Tarun Gogineni, Gabriel Goh, Rapha Gontijo-Lopes, Jonathan Gordon, Morgan Grafstein, Scott Gray, Ryan Greene, Joshua Gross, Shixiang Shane Gu, Yufei Guo, Chris Hallacy, Jesse Han, Jeff Harris, Yuchen He, Mike Heaton, Johannes Heidecke, Chris Hesse, Alan Hickey, Wade Hickey, Peter Hoeschele, Brandon Houghton, Kenny Hsu, Shengli Hu, Xin Hu, Joost Huizinga, Shantanu Jain, Shawn Jain, Joanne Jang, Angela Jiang, Roger Jiang, Haozhun Jin, Denny Jin, Shino Jomoto, Billie Jonn, Heewoo Jun, Tomer Kaftan, Lukasz Kaiser, Ali Kamali, Ingmar Kanitscheider, Nitish Shirish Keskar, Tabarak Khan, Logan Kilpatrick, Jong Wook Kim, Christina Kim, Yongjik Kim, Jan Hendrik Kirchner, Jamie Kiros, Matt Knight, Daniel Kokotajlo, Lukasz Kondraciuk, Andrew Kondrich, Aris Konstantinidis, Kyle Kosic, Gretchen Krueger, Vishal Kuo, Michael Lampe, Ikai Lan, Teddy Lee, Jan Leike, Jade Leung, Daniel Levy, Chak Ming Li, Rachel Lim, Molly Lin, Stephanie Lin, Mateusz Litwin, Theresa Lopez, Ryan Lowe, Patricia Lue, Anna Makanju, Kim Malfacini, Sam Manning, Todor Markov, Yaniv Markovski, Bianca Martin, Katie Mayer, Andrew Mayne, Bob McGrew, Scott Mayer McKinney, Christine McLeavey, Paul McMillan, Jake McNeil, David Medina, Aalok Mehta, Jacob Menick, Luke Metz, Andrey Mishchenko, Pamela Mishkin, Vinnie Monaco, Evan Morikawa, Daniel Mossing, Tong Mu, Mira Murati, Oleg Murk, David Mély, Ashvin Nair, Reiichiro Nakano, Rajeev Nayak, Arvind Neelakantan, Richard Ngo, Hyeonwoo Noh, Long Ouyang, Cullen O’Keefe, Jakub Pachocki, Alex Paino, Joe Palermo, Ashley Pantuliano, Giambattista Parascandolo, Joel Parish, Emy Parparita, Alex Passos, Mikhail Pavlov, Andrew Peng, Adam Perelman, Filipe de Avila Belbute Peres, Michael Petrov, Henrique Ponde de Oliveira Pinto, Michael, Pokorny, Michelle Pokrass, Vitchyr H Pong, Tolly Powell, Alethea Power, Boris Power, Elizabeth Proehl, Raul Puri, Alec Radford, Jack Rae, Aditya Ramesh, Cameron Raymond, Francis Real, Kendra Rimbach, Carl Ross, Bob Rotsted, Henri Roussez, Nick Ryder, Mario Saltarelli, Ted Sanders, Shibani Santurkar, Girish Sastry, Heather Schmidt, David Schnurr, John Schulman, Daniel Selsam, Kyla Sheppard, Toki Sherbakov, Jessica Shieh, Sarah Shoker, Pranav Shyam, Szymon Sidor, Eric Sigler, Maddie Simens, Jordan Sitkin, Katarina Slama, Ian Sohl, Benjamin Sokolowsky, Yang Song, Natalie Staudacher, Felipe Petroski Such, Natalie Summers, Ilya Sutskever, Jie Tang, Nikolas Tezak, Madeleine B Thompson, Phil Tillet, Amin Tootoonchian, Elizabeth Tseng, Preston Tuggle, Nick Turley, Jerry Tworek, Juan Felipe Cerón Uribe, Andrea Vallone, Arun Vijayvergiya, Chelsea Voss, Carroll Wainwright, Justin Jay Wang, Alvin Wang, Ben Wang, Jonathan Ward, Jason Wei, C J Weinmann, Akila Welihinda, Peter Welinder, Jiayi Weng, Lilian Weng, Matt Wiethoff, Dave Willner, Clemens Winter, Samuel Wolrich, Hannah Wong, Lauren Workman, Sherwin Wu, Jeff Wu, Michael Wu, Kai Xiao, Tao Xu, Sarah Yoo, Kevin Yu, Qiming Yuan, Wojciech Zaremba, Rowan Zellers, Chong Zhang, Marvin Zhang, Shengjia Zhao, Tianhao Zheng, Juntang Zhuang, William Zhuk, and Barret Zoph.  GPT-4 technical report.  March 2023.  URL http://arxiv.org/abs/2303.08774.
  * Gao and Coley 2020 Wenhao Gao and Connor W Coley.  The synthesizability of molecules proposed by generative models.  _J. Chem. Inf. Model._ , (12):5714–5723, February 2020.  ISSN 1549-9596,1549-960X.  doi:10.1021/acs.jcim.0c00174.  URL https://pubs.acs.org/doi/10.1021/acs.jcim.0c00174.
  * Liu et al. 2024c Pengfei Liu, Jun Tao, and Zhixiang Ren.  Scientific language modeling: A quantitative review of large language models in molecular science.  _arXiv [cs.LG]_ , February 2024c.  URL http://arxiv.org/abs/2402.04119.
  * Schwaller et al. 2021c Philippe Schwaller, Benjamin Hoover, Jean-Louis Reymond, Hendrik Strobelt, and Teodoro Laino.  Extraction of organic chemistry grammar from unsupervised learning of chemical reactions.  _Sci. Adv._ , 7(15):eabe4166, April 2021c.  ISSN 2375-2548.  doi:10.1126/sciadv.abe4166.  URL http://dx.doi.org/10.1126/sciadv.abe4166.
  * Schilter et al. 2023 Oliver Schilter, Marvin Alberts, Federico Zipoli, Alain C Vaucher, Philippe Schwaller, and Teodoro Laino.  Unveiling the secrets of 1H-NMR spectroscopy: A novel approach utilizing attention mechanisms.  November 2023.  URL https://openreview.net/pdf?id=4ilKwquW51.
  * Aryal et al. 2024 Shiva Aryal, Tuyen Do, Bisesh Heyojoo, Sandeep Chataut, Bichar Dip Shrestha Gurung, Venkataramana Gadhamshetty, and Etienne Gnimpieba.  Leveraging multi-AI agents for cross-domain knowledge discovery.  _arXiv [cs.AI]_ , April 2024.  URL http://arxiv.org/abs/2404.08511.
  * Bohm et al. 2019 Florian Bohm, Yang Gao, Christian M Meyer, Ori Shapira, Ido Dagan, and Iryna Gurevych.  Better rewards yield better summaries: Learning to summarise without references.  _arXiv [cs.CL]_ , September 2019.  URL http://arxiv.org/abs/1909.01214.
  * Pan et al. 2023 Sarah Pan, Vladislav Lialin, Sherin Muckatira, and Anna Rumshisky.  Let’s reinforce step by step.  _arXiv [cs.CL]_ , November 2023.  URL http://arxiv.org/abs/2311.05821.
  * Hu et al. 2023 Bin Hu, Chenyang Zhao, Pu Zhang, Zihao Zhou, Yuanhang Yang, Zenglin Xu, and Bin Liu.  Enabling intelligent interactions between an agent and an LLM: A reinforcement learning approach.  _arXiv [cs.AI]_ , June 2023.  URL http://arxiv.org/abs/2306.03604.
  * Xu et al. 2023b Zelai Xu, Chao Yu, Fei Fang, Yu Wang, and Yi Wu.  Language agents with reinforcement learning for strategic play in the werewolf game.  _arXiv [cs.AI]_ , October 2023b.  URL http://arxiv.org/abs/2310.18940.
  * Langley et al. 2009 Pat Langley, John E Laird, and Seth Rogers.  Cognitive architectures: Research issues and challenges.  _Cogn. Syst. Res._ , 10(2):141–160, June 2009.  ISSN 1389-0417,2214-4366.  doi:10.1016/j.cogsys.2006.07.004.  URL http://dx.doi.org/10.1016/j.cogsys.2006.07.004.
  * Goertzel 2014 Ben Goertzel.  Artificial general intelligence: Concept, state of the art, and future prospects.  _J. Artif. Gen. Intell._ , 5(1):1–48, December 2014.  ISSN 1946-0163.  doi:10.2478/jagi-2014-0001.  URL https://sciendo.com/pdf/10.2478/jagi-2014-0001.
  * Ruan et al. 2023 Yangjun Ruan, Honghua Dong, Andrew Wang, Silviu Pitis, Yongchao Zhou, Jimmy Ba, Yann Dubois, Chris J Maddison, and Tatsunori Hashimoto.  Identifying the risks of LM agents with an LM-emulated sandbox.  _arXiv [cs.AI]_ , September 2023.  URL http://arxiv.org/abs/2309.15817.
  * Ji et al. 2023 Ziwei Ji, Nayeon Lee, Rita Frieske, Tiezheng Yu, Dan Su, Yan Xu, Etsuko Ishii, Ye Jin Bang, Andrea Madotto, and Pascale Fung.  Survey of hallucination in natural language generation.  _ACM Comput. Surv._ , 55(12):1–38, March 2023.  ISSN 0360-0300.  doi:10.1145/3571730.  URL https://doi.org/10.1145/3571730.
  * Cai et al. 2023b Zefan Cai, Baobao Chang, and Wenjuan Han.  Human-in-the-loop through chain-of-thought.  _arXiv [cs.CL]_ , June 2023b.  URL http://arxiv.org/abs/2306.07932.
  * Xiao and Wang 2023 Hengjia Xiao and Peng Wang.  LLM a*: Human in the loop large language models enabled a* search for robotics.  _arXiv [cs.RO]_ , December 2023.  URL http://arxiv.org/abs/2312.01797.
  * Drori and Te’eni 2024 Iddo Drori and Dov Te’eni.  Human-in-the-Loop AI reviewing: Feasibility, opportunities, and risks.  _Journal of the Association for Information Systems_ , 25(1):98–109, 2024.  ISSN 1536-9323.  doi:10.17705/1jais.00867.  URL https://aisel.aisnet.org/jais/vol25/iss1/7/.
  * Szymanski et al. 2023 Nathan J. Szymanski, Bernardus Rendy, Yuxing Fei, Rishi E. Kumar, Tanjin He, David Milsted, Matthew J. McDermott, Max Gallant, Ekin Dogus Cubuk, Amil Merchant, Haegyeom Kim, Anubhav Jain, Christopher J. Bartel, Kristin Persson, Yan Zeng, and Gerbrand Ceder.  An autonomous laboratory for the accelerated synthesis of novel materials.  _Nature_ , 624(7990):86–91, December 2023.  ISSN 1476-4687.  doi:10.1038/s41586-023-06734-w.  URL https://www.nature.com/articles/s41586-023-06734-w.  Publisher: Nature Publishing Group.
  * Peplow 2023 Mark Peplow.  Robot chemist sparks row with claim it created new materials.  _Nature_ , December 2023.  doi:10.1038/d41586-023-03956-w.  URL https://www.nature.com/articles/d41586-023-03956-w.  Bandiera_abtest: a Cg_type: News Publisher: Nature Publishing Group Subject_term: Scientific community, Materials science, Machine learning, Chemistry.
  * Hong et al. 2024 Sirui Hong, Yizhang Lin, Bang Liu, Bangbang Liu, Binhao Wu, Danyang Li, Jiaqi Chen, Jiayi Zhang, Jinlin Wang, Li Zhang, Lingyao Zhang, Min Yang, Mingchen Zhuge, Taicheng Guo, Tuo Zhou, Wei Tao, Wenyi Wang, Xiangru Tang, Xiangtao Lu, Xiawu Zheng, Xinbing Liang, Yaying Fei, Yuheng Cheng, Zongze Xu, and Chenglin Wu.  Data interpreter: An LLM agent for data science.  _arXiv [cs.AI]_ , February 2024.  URL http://arxiv.org/abs/2402.18679.
  * Qi and Wang 2024 Danrui Qi and Jiannan Wang.  CleanAgent: Automating data standardization with LLM-based agents.  _arXiv [cs.LG]_ , March 2024.  URL http://arxiv.org/abs/2403.08291.