* Ma et al. (2023a) Xiao Ma, Swaroop Mishra, Ariel Liu, Sophie Su, Jilin Chen, Chinmay Kulkarni, Heng-Tze Cheng, Quoc Le, and Ed Chi.  Beyond chatbots: Explorellm for structured thoughts and personalized model responses.  _arXiv preprint arXiv:2312.00763_ , 2023a.
  * Ma et al. (2023b) Xinbei Ma, Yeyun Gong, Pengcheng He, Hai Zhao, and Nan Duan.  Query rewriting in retrieval-augmented large language models.  In Houda Bouamor, Juan Pino, and Kalika Bali (eds.), _Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing_ , pp. 5303–5315, Singapore, December 2023b. Association for Computational Linguistics.  doi: 10.18653/v1/2023.emnlp-main.322.  URL https://aclanthology.org/2023.emnlp-main.322.
  * Maghakian et al. (2023) Jessica Maghakian, Paul Mineiro, Kishan Panaganti, Mark Rucker, Akanksha Saran, and Cheng Tan.  Personalized reward learning with interaction-grounded learning for recommender systems.  In _International Conference on Learning Representations_ , 2023.
  * Mao et al. (2023) Yuanyuan Mao, Shuang Liu, Pengshuai Zhao, Qin Ni, Xin Lin, and Liang He.  A review on machine theory of mind, 2023.
  * Microsoft (2024) Microsoft.  Microsoft copilot, 2024.  URL https://copilot.microsoft.com/.
  * Miotto et al. (2022) Marilù Miotto, Nicola Rossberg, and Bennett Kleinberg.  Who is GPT-3? an exploration of personality, values and demographics.  In David Bamman, Dirk Hovy, David Jurgens, Katherine Keith, Brendan O’Connor, and Svitlana Volkova (eds.), _Proceedings of the Fifth Workshop on Natural Language Processing and Computational Social Science (NLP+CSS)_ , pp. 218–227, Abu Dhabi, UAE, November 2022. Association for Computational Linguistics.  doi: 10.18653/v1/2022.nlpcss-1.24.  URL https://aclanthology.org/2022.nlpcss-1.24.
  * Mnih et al. (2015) Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Andrei A Rusu, Joel Veness, Marc G Bellemare, Alex Graves, Martin Riedmiller, Andreas K Fidjeland, Georg Ostrovski, et al.  Human-level control through deep reinforcement learning.  _nature_ , 518(7540):529–533, 2015.
  * Modarressi et al. (2023) Ali Modarressi, Ayyoob Imani, Mohsen Fayyaz, and Hinrich Schütze.  Ret-llm: Towards a general read-write memory for large language models.  _arXiv preprint arXiv:2305.14322_ , 2023.
  * Mondal et al. (2024) Ishani Mondal, Shwetha Somasundaram, Anandhavelu Natarajan, Aparna Garimella, Sambaran Bandyopadhyay, and Jordan Boyd-Graber.  Presentations by the humans and for the humans: Harnessing llms for generating persona-aware slides from documents.  _Proceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics Volume 1: Long Papers_ , pp. 2664–2684, 2024.
  * Mucha et al. (2024) Wiktor Mucha, Florin Cuconasu, Naome A. Etori, Valia Kalokyri, and Giovanni Trappolini.  Text2taste: A versatile egocentric vision system for intelligent reading assistance using large language model, 2024.
  * Mysore et al. (2023) Sheshera Mysore, Zhuoran Lu, Mengting Wan, Longqi Yang, Steve Menezes, Tina Baghaee, Emmanuel Barajas Gonzalez, Jennifer Neville, and Tara Safavi.  Pearl: Personalizing large language model writing assistants with generation-calibrated retrievers.  _arXiv preprint arXiv:2311.09180v1_ , 2023.
  * Naous et al. (2024) Tarek Naous, Michael J. Ryan, Alan Ritter, and Wei Xu.  Having beer after prayer? measuring cultural bias in large language models, 2024.
  * Neel et al. (2021) Seth Neel, Aaron Roth, and Saeed Sharifi-Malvajerdi.  Descent-to-delete: Gradient-based methods for machine unlearning.  In _Algorithmic Learning Theory_ , pp. 931–962. PMLR, 2021.
  * Ng et al. (2024) Man Tik Ng, Hui Tung Tse, Jen tse Huang, Jingjing Li, Wenxuan Wang, and Michael R. Lyu.  How well can llms echo us? evaluating ai chatbots’ role-play ability with echo, 2024.
  * OpenAI (2022) OpenAI.  Chatgpt, 2022.  URL https://openai.com/blog/chatgpt.
  * OpenAI (2023) OpenAI.  GPT-4 technical report.  _ArXiv_ , abs/2303.08774, 2023.
  * Ouyang et al. (2022) Long Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida, Carroll Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Gray, John Schulman, Jacob Hilton, Fraser Kelton, Luke Miller, Maddie Simens, Amanda Askell, Peter Welinder, Paul Christiano, Jan Leike, and Ryan Lowe.  Training language models to follow instructions with human feedback.  In Alice H. Oh, Alekh Agarwal, Danielle Belgrave, and Kyunghyun Cho (eds.), _Advances in Neural Information Processing Systems_ , 2022.  URL https://openreview.net/forum?id=TG8KACxEON.
  * Packer et al. (2023) Charles Packer, Vivian Fang, Shishir G Patil, Kevin Lin, Sarah Wooders, and Joseph E Gonzalez.  Memgpt: Towards llms as operating systems.  _arXiv preprint arXiv:2310.08560_ , 2023.
  * Pan & Zeng (2023) Keyu Pan and Yawen Zeng.  Do llms possess a personality? making the mbti test an amazing evaluation for large language models.  _arXiv preprint arXiv:2307.16180_ , 2023.
  * Parisi et al. (2022) Aaron Parisi, Yao Zhao, and Noah Fiedel.  Talm: Tool augmented language models.  _arXiv preprint arXiv:2205.12255_ , 2022.
  * Park et al. (2022) Joon Sung Park, Lindsay Popowski, Carrie Cai, Meredith Ringel Morris, Percy Liang, and Michael S Bernstein.  Social simulacra: Creating populated prototypes for social computing systems.  In _Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology_ , pp. 1–18, 2022.
  * Park et al. (2023) Joon Sung Park, Joseph C. O’Brien, Carrie J. Cai, Meredith Ringel Morris, Percy Liang, and Michael S. Bernstein.  Generative agents: Interactive simulacra of human behavior.  In _In the 36th Annual ACM Symposium on User Interface Software and Technology (UIST ’23)_ , UIST ’23, New York, NY, USA, 2023. Association for Computing Machinery.
  * Patil et al. (2023) Shishir G Patil, Tianjun Zhang, Xin Wang, and Joseph E Gonzalez.  Gorilla: Large language model connected with massive apis.  _arXiv preprint arXiv:2305.15334_ , 2023.
  * Pawelczyk et al. (2023) Martin Pawelczyk, Seth Neel, and Himabindu Lakkaraju.  In-context unlearning: Language models as few shot unlearners.  _arXiv preprint arXiv:2310.07579_ , 2023.
  * Perez & Ribeiro (2022) Fábio Perez and Ian Ribeiro.  Ignore previous prompt: Attack techniques for language models.  In _NeurIPS ML Safety Workshop_ , 2022.  URL https://openreview.net/forum?id=qiaRo_7Zmug.
  * Popović (2017) Maja Popović.  chrf++: words helping character n-grams.  In _Proceedings of the second conference on machine translation_ , pp. 612–618, 2017.
  * Post (2018) Matt Post.  A call for clarity in reporting bleu scores.  _arXiv preprint arXiv:1804.08771_ , 2018.
  * Premack & Woodruff (1978) David Premack and Guy Woodruff.  Does the chimpanzee have a theory of mind?  _Behavioral and brain sciences_ , 1(4):515–526, 1978.
  * Qian et al. (2023) Chen Qian, Xin Cong, Wei Liu, Cheng Yang, Weize Chen, Yusheng Su, Yufan Dang, Jiahao Li, Juyuan Xu, Dahai Li, Zhiyuan Liu, and Maosong Sun.  Communicative agents for software development, 2023.
  * Qin et al. (2024) Ruiyang Qin, Jun Xia, Zhenge Jia, Meng Jiang, Ahmed Abbasi, Peipei Zhou, Jingtong Hu, and Yiyu Shi.  Enabling on-device large language model personalization with self-supervised data selection and synthesis.  _arXiv preprint arXiv:2311.12275v3_ , 2024.
  * Qin et al. (2023) Yujia Qin, Shihao Liang, Yining Ye, Kunlun Zhu, Lan Yan, Yaxi Lu, Yankai Lin, Xin Cong, Xiangru Tang, Bill Qian, et al.  Toolllm: Facilitating large language models to master 16000+ real-world apis.  _arXiv preprint arXiv:2307.16789_ , 2023.
  * Rana et al. (2023) Krishan Rana, Jesse Haviland, Sourav Garg, Jad Abou-Chakra, Ian Reid, and Niko Suenderhauf.  Sayplan: Grounding large language models using 3d scene graphs for scalable robot task planning.  In _7th Annual Conference on Robot Learning_ , 2023.  URL https://openreview.net/forum?id=wMpOMO0Ss7a.
  * Rao et al. (2023) Haocong Rao, Cyril Leung, and Chunyan Miao.  Can chatgpt assess human personalities? a general evaluation framework.  _arXiv preprint arXiv:2303.01248_ , 2023.
  * Rescala et al. (2024) Paula Rescala, Manoel Horta Ribeiro, Tiancheng Hu, and Robert West.  Can language models recognize convincing arguments?, 2024.
  * Ruan et al. (2023) Jingqing Ruan, Yihong Chen, Bin Zhang, Zhiwei Xu, Tianpeng Bao, Guoqing Du, Shiwei Shi, Hangyu Mao, Xingyu Zeng, and Rui Zhao.  Tptu: Task planning and tool usage of large language model-based ai agents.  _arXiv preprint arXiv:2308.03427_ , 2023.
  * Rutinowski et al. (2023) Jérôme Rutinowski, Sven Franke, Jan Endendyk, Ina Dormuth, and Markus Pauly.  The self-perception and political biases of chatgpt.  _arXiv preprint arXiv:2304.07333_ , 2023.
  * Safdari et al. (2023) Mustafa Safdari, Greg Serapio-García, Clément Crepy, Stephen Fitz, Peter Romero, Luning Sun, Marwa Abdulhai, Aleksandra Faust, and Maja Matarić.  Personality traits in large language models.  _arXiv preprint arXiv:2307.00184_ , 2023.
  * Salemi et al. (2024) Alireza Salemi, Sheshera Mysore, Michael Bendersky, and Hamed Zamani.  Lamp: When large language models meet personalization, 2024.
  * Sallam (2023) Malik Sallam.  Chatgpt utility in health care education, research, and practice: Systematic review on the promising perspectives and valid concerns.  _Healthcare_ , 11:887, 03 2023.  doi: 10.3390/healthcare11060887.
  * Santurkar et al. (2023) Shibani Santurkar, Esin Durmus, Faisal Ladhak, Cinoo Lee, Percy Liang, and Tatsunori Hashimoto.  Whose opinions do language models reflect?  _arXiv preprint arXiv:2303.17548_ , 2023.
  * Sap et al. (2023) Maarten Sap, Ronan LeBras, Daniel Fried, and Yejin Choi.  Neural theory-of-mind? on the limits of social intelligence in large lms, 2023.
  * Scherrer et al. (2023) Nino Scherrer, Claudia Shi, Amir Feder, and David Blei.  Evaluating the moral beliefs encoded in llms.  In A. Oh, T. Neumann, A. Globerson, K. Saenko, M. Hardt, and S. Levine (eds.), _Advances in Neural Information Processing Systems_ , volume 36, pp. 51778–51809. Curran Associates, Inc., 2023.  URL https://proceedings.neurips.cc/paper_files/paper/2023/file/a2cf225ba392627529efef14dc857e22-Paper-Conference.pdf.
  * Schick et al. (2023) Timo Schick, Jane Dwivedi-Yu, Roberto Dessì, Roberta Raileanu, Maria Lomeli, Luke Zettlemoyer, Nicola Cancedda, and Thomas Scialom.  Toolformer: Language models can teach themselves to use tools.  _arXiv preprint arXiv:2302.04761_ , 2023.
  * Schulman et al. (2017) John Schulman, Filip Wolski, Prafulla Dhariwal, Alec Radford, and Oleg Klimov.  Proximal policy optimization algorithms.  _arXiv preprint arXiv:1707.06347_ , 2017.
  * Sclar et al. (2023) Melanie Sclar, Sachin Kumar, Peter West, Alane Suhr, Yejin Choi, and Yulia Tsvetkov.  Minding language models’ (lack of) theory of mind: A plug-and-play multi-character belief tracker.  In _Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)_ , pp. 13960–13980, Toronto, Canada, July 2023. Association for Computational Linguistics.  doi: 10.18653/v1/2023.acl-long.780.  URL https://aclanthology.org/2023.acl-long.780.
  * Serapio-García et al. (2023) Greg Serapio-García, Mustafa Safdari, Clément Crepy, Luning Sun, Stephen Fitz, Peter Romero, Marwa Abdulhai, Aleksandra Faust, and Maja Matarić.  Personality traits in large language models, 2023.
  * Shanahan et al. (2023) Murray Shanahan, Kyle McDonell, and Laria Reynolds.  Role play with large language models.  _Nature_ , 623(7987):493–498, 2023.
  * Shao et al. (2023) Yunfan Shao, Linyang Li, Junqi Dai, and Xipeng Qiu.  Character-llm: A trainable agent for role-playing.  _arXiv preprint arXiv:2310.10158_ , 2023.
  * Shapira et al. (2023) Natalie Shapira, Mosh Levy, Seyed Hossein Alavi, Xuhui Zhou, Yejin Choi, Yoav Goldberg, Maarten Sap, and Vered Shwartz.  Clever hans or neural theory of mind? stress testing social reasoning in large language models.  _arXiv preprint arXiv:2305.14763_ , 2023.
  * Shea & Yu (2023) Ryan Shea and Zhou Yu.  Building persona consistent dialogue agents with offline reinforcement learning.  _arXiv preprint arXiv:2310.10735_ , 2023.
  * Shen et al. (2023a) Tianhao Shen, Sun Li, and Deyi Xiong.  Roleeval: A bilingual role evaluation benchmark for large language models.  _arXiv preprint arXiv:2312.16132_ , 2023a.
  * Shen et al. (2023b) Yongliang Shen, Kaitao Song, Xu Tan, Dongsheng Li, Weiming Lu, and Yueting Zhuang.  HuggingGPT: Solving AI tasks with chatGPT and its friends in hugging face.  In _Thirty-seventh Conference on Neural Information Processing Systems_ , 2023b.  URL https://openreview.net/forum?id=yHdTscY6Ci.
  * Shen et al. (2023c) Yongliang Shen, Kaitao Song, Xu Tan, Wenqi Zhang, Kan Ren, Siyu Yuan, Weiming Lu, Dongsheng Li, and Yueting Zhuang.  Taskbench: Benchmarking large language models for task automation.  _arXiv preprint arXiv:2311.18760_ , 2023c.
  * Shinn et al. (2023) Noah Shinn, Federico Cassano, Beck Labash, Ashwin Gopinath, Karthik Narasimhan, and Shunyu Yao.  Reflexion: Language agents with verbal reinforcement learning.  _arXiv preprint arXiv:2303.11366_ , 2023.
  * Significant-Gravitas (2023) Significant-Gravitas.  Autogpt.  https://github.com/Significant-Gravitas/Auto-GPT, 2023.
  * Song et al. (2023) Chan Hee Song, Jiaman Wu, Clayton Washington, Brian M Sadler, Wei-Lun Chao, and Yu Su.  Llm-planner: Few-shot grounded planning for embodied agents with large language models.  In _Proceedings of the IEEE/CVF International Conference on Computer Vision_ , pp. 2998–3009, 2023.
  * Sorin et al. (2023) Vera Sorin, Danna Brin, Yiftach Barash, Eli Konen, Alexander Charney, Girish Nadkarni, and Eyal Klang.  Large language models (llms) and empathy-a systematic review.  _medRxiv_ , pp. 2023–08, 2023.
  * Staab et al. (2023) Robin Staab, Mark Vero, Mislav Balunović, and Martin Vechev.  Beyond memorization: Violating privacy via inference with large language models.  _arXiv preprint arXiv:2310.07298_ , 2023.
  * Su et al. (2024) Jianlin Su, Murtadha Ahmed, Yu Lu, Shengfeng Pan, Wen Bo, and Yunfeng Liu.  Roformer: Enhanced transformer with rotary position embedding.  _Neurocomputing_ , 568:127063, 2024.  ISSN 0925-2312.  doi: https://doi.org/10.1016/j.neucom.2023.127063.  URL https://www.sciencedirect.com/science/article/pii/S0925231223011864.
  * Su & Bao (2024) Megan Su and Yuwei Bao.  User modeling challenges in interactive ai assistant systems, 2024.
  * Sun et al. (2024) Chenkai Sun, Ke Yang, Revanth Gangi Reddy, Yi R. Fung, Hou Pong Chan, ChengXiang Zhai, and Heng Ji.  Persona-db: Efficient large language model personalization for response prediction with collaborative data refinement, 2024.
  * Sun et al. (2019) Tony Sun, Andrew Gaut, Shirlyn Tang, Yuxin Huang, Mai ElSherief, Jieyu Zhao, Diba Mirza, Elizabeth Belding, Kai-Wei Chang, and William Yang Wang.  Mitigating gender bias in natural language processing: Literature review.  In _Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics_ , pp. 1630–1640, 2019.
  * Sweeney (2002) Latanya Sweeney.  k-anonymity: A model for protecting privacy.  _International journal of uncertainty, fuzziness and knowledge-based systems_ , 10(05):557–570, 2002.
  * Tan et al. (2024) Fiona Anting Tan, Gerard Christopher Yeo, Fanyou Wu, Weijie Xu, Vinija Jain, Aman Chadha, Kokil Jaidka, Yang Liu, and See-Kiong Ng.  Phantom: Personality has an effect on theory-of-mind reasoning in large language models, 2024.
  * Tang et al. (2024) Yihong Tang, Jiao Ou, Che Liu, Fuzheng Zhang, Di Zhang, and Kun Gai.  Enhancing role-playing systems through aggressive queries: Evaluation and improvement.  _arXiv preprint arXiv:2402.10618_ , 2024.
  * Tu et al. (2024) Quan Tu, Shilong Fan, Zihang Tian, and Rui Yan.  Charactereval: A chinese benchmark for role-playing conversational agent evaluation.  _arXiv preprint arXiv:2401.01275_ , 2024.
  * Valmeekam et al. (2024) Karthik Valmeekam, Matthew Marquez, Alberto Olmo, Sarath Sreedharan, and Subbarao Kambhampati.  Planbench: An extensible benchmark for evaluating large language models on planning and reasoning about change.  _Advances in Neural Information Processing Systems_ , 36, 2024.
  * Wang et al. (2023a) Guanzhi Wang, Yuqi Xie, Yunfan Jiang, Ajay Mandlekar, Chaowei Xiao, Yuke Zhu, Linxi Fan, and Anima Anandkumar.  Voyager: An open-ended embodied agent with large language models.  _arXiv preprint arXiv: Arxiv-2305.16291_ , 2023a.
  * (209) Hong Wang, Weizhi Wang, Rajan Saini, Marina Zhukova, and Xifeng Yan.  Gauchochat: Towards proactive, controllable, and personalized social conversation.  _Alexa Prize SocialBot Grand Challenge_ , 5.
  * Wang et al. (2023b) Hongru Wang, Minda Hu, Yang Deng, Rui Wang, Fei Mi, Weichao Wang, Yasheng Wang, Wai-Chung Kwan, Irwin King, and Kam-Fai Wong.  Large language models as source planner for personalized knowledge-grounded dialogues.  In Houda Bouamor, Juan Pino, and Kalika Bali (eds.), _Findings of the Association for Computational Linguistics: EMNLP 2023_ , pp. 9556–9569, Singapore, December 2023b. Association for Computational Linguistics.  doi: 10.18653/v1/2023.findings-emnlp.641.  URL https://aclanthology.org/2023.findings-emnlp.641.
  * Wang & Lim (2023) Lei Wang and Ee-Peng Lim.  Zero-shot next-item recommendation using large pretrained language models, 2023.
  * Wang et al. (2023c) Lei Wang, Jingsen Zhang, Hao Yang, Zhiyuan Chen, Jiakai Tang, Zeyu Zhang, Xu Chen, Yankai Lin, Ruihua Song, Wayne Xin Zhao, Jun Xu, Zhicheng Dou, Jun Wang, and Ji-Rong Wen.  When large language model based agent meets user behavior analysis: A novel user simulation paradigm, 2023c.
  * Wang et al. (2024a) Ruiyi Wang, Haofei Yu, Wenxin Zhang, Zhengyang Qi, Maarten Sap, Graham Neubig, Yonatan Bisk, and Hao Zhu.  Sotopia-$\pi$: Interactive learning of socially intelligent language agents, 2024a.
  * Wang et al. (2023d) Shenzhi Wang, Chang Liu, Zilong Zheng, Siyuan Qi, Shuo Chen, Qisen Yang, Andrew Zhao, Chaofei Wang, Shiji Song, and Gao Huang.  Avalon’s game of thoughts: Battle against deception through recursive contemplation.  _arXiv preprint arXiv:2310.01320_ , 2023d.
  * Wang et al. (2020) Sinong Wang, Belinda Z Li, Madian Khabsa, Han Fang, and Hao Ma.  Linformer: Self-attention with linear complexity.  _arXiv preprint arXiv:2006.04768_ , 2020.
  * Wang et al. (2023e) Wenxuan Wang, Wenxiang Jiao, Jingyuan Huang, Ruyi Dai, Jen-tse Huang, Zhaopeng Tu, and Michael R Lyu.  Not all countries celebrate thanksgiving: On the cultural dominance in large language models.  _arXiv preprint arXiv:2310.12481_ , 2023e.
  * Wang et al. (2023f) Xingyao Wang, Zihan Wang, Jiateng Liu, Yangyi Chen, Lifan Yuan, Hao Peng, and Heng Ji.  Mint: Evaluating llms in multi-turn interaction with tools and language feedback.  _arXiv preprint arXiv:2309.10691_ , 2023f.
  * Wang et al. (2024b) Xintao Wang, Jiangjie Chen, Nianqi Li, Lida Chen, Xinfeng Yuan, Wei Shi, Xuyang Ge, Rui Xu, and Yanghua Xiao.  Surveyagent: A conversational system for personalized and efficient research survey, 2024b.
  * Wang et al. (2024c) Xintao Wang, Yunze Xiao, Jen-tse Huang, Siyu Yuan, Rui Xu, Haoran Guo, Quan Tu, Yaying Fei, Ziang Leng, Wei Wang, Jiangjie Chen, Cheng Li, and Yanghua Xiao.  Incharacter: Evaluating personality fidelity in role-playing agents through psychological interviews.  2024c.
  * Wang et al. (2023g) Zekun Moore Wang, Zhongyuan Peng, Haoran Que, Jiaheng Liu, Wangchunshu Zhou, Yuhan Wu, Hongcheng Guo, Ruitong Gan, Zehao Ni, Man Zhang, et al.  Rolellm: Benchmarking, eliciting, and enhancing role-playing abilities of large language models.  _arXiv preprint arXiv:2310.00746_ , 2023g.
  * Wang et al. (2023h) Zhenhailong Wang, Shaoguang Mao, Wenshan Wu, Tao Ge, Furu Wei, and Heng Ji.  Unleashing the emergent cognitive synergy in large language models: A task-solving agent through multi-persona self-collaboration.  _arXiv preprint arXiv:2307.05300_ , 2023h.
  * Wang et al. (2023i) Zhilin Wang, Yu Ying Chiu, and Yu Cheung Chiu.  Humanoid agents: Platform for simulating human-like generative agents.  _arXiv preprint arXiv:2310.05418_ , 2023i.
  * Wang et al. (2023j) Zihao Wang, Shaofei Cai, Anji Liu, Xiaojian Ma, and Yitao Liang.  Describe, explain, plan and select: Interactive planning with large language models enables open-world multi-task agents.  _arXiv preprint arXiv:2302.01560_ , 2023j.
  * Wei et al. (2022a) Jason Wei, Yi Tay, Rishi Bommasani, Colin Raffel, Barret Zoph, Sebastian Borgeaud, Dani Yogatama, Maarten Bosma, Denny Zhou, Donald Metzler, Ed H. Chi, Tatsunori Hashimoto, Oriol Vinyals, Percy Liang, Jeff Dean, and William Fedus.  Emergent abilities of large language models.  _Transactions on Machine Learning Research_ , 2022a.  URL https://openreview.net/forum?id=yzkSU5zdwD.  Survey Certification.
  * Wei et al. (2022b) Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, brian ichter, Fei Xia, Ed H. Chi, Quoc V Le, and Denny Zhou.  Chain of thought prompting elicits reasoning in large language models.  In Alice H. Oh, Alekh Agarwal, Danielle Belgrave, and Kyunghyun Cho (eds.), _Advances in Neural Information Processing Systems_ , 2022b.  URL https://openreview.net/forum?id=_VjQlMeSB_J.
  * Wen et al. (2023a) Hao Wen, Yuanchun Li, Guohong Liu, Shanhui Zhao, Tao Yu, Toby Jia-Jun Li, Shiqi Jiang, Yunhao Liu, Yaqin Zhang, and Yunxin Liu.  Empowering llm to use smartphone for intelligent task automation.  _arXiv preprint arXiv:2308.15272_ , 2023a.
  * Wen et al. (2023b) Jiaxin Wen, Pei Ke, Hao Sun, Zhexin Zhang, Chengfei Li, Jinfeng Bai, and Minlie Huang.  Unveiling the implicit toxicity in large language models.  In _Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing_ , pp. 1322–1338, 2023b.
  * Weng (2023) Lilian Weng.  Llm-powered autonomous agents.  _lilianweng.github.io_ , Jun 2023.  URL https://lilianweng.github.io/posts/2023-06-23-agent/.
  * Weng et al. (2024) Yixuan Weng, Shizhu He, Kang Liu, Shengping Liu, and Jun Zhao.  Controllm: Crafting diverse personalities for language models.  _arXiv preprint arXiv:2402.10151_ , 2024.
  * Woźniak et al. (2024) Stanisław Woźniak, Bartłomiej Koptyra, Arkadiusz Janz, Przemysław Kazienko, and Jan Kocoń.  Personalized large language models, 2024.
  * Wu et al. (2024a) Fangzhou Wu, Ning Zhang, Somesh Jha, Patrick McDaniel, and Chaowei Xiao.  A new era in llm security: Exploring security concerns in real-world llm-based systems, 2024a.
  * Wu et al. (2023) Likang Wu, Zhi Zheng, Zhaopeng Qiu, Hao Wang, Hongchao Gu, Tingjia Shen, Chuan Qin, Chen Zhu, Hengshu Zhu, Qi Liu, Hui Xiong, and Enhong Chen.  A survey on large language models for recommendation, 2023.
  * Wu et al. (2024b) Siye Wu, Jian Xie, Jiangjie Chen, Tinghui Zhu, Kai Zhang, and Yanghua Xiao.  How easily do irrelevant inputs skew the responses of large language models?  _arXiv preprint arXiv:2404.03302_ , 2024b.
  * Wu et al. (2024c) Yuhao Wu, Franziska Roesner, Tadayoshi Kohno, Ning Zhang, and Umar Iqbal.  Secgpt: An execution isolation architecture for llm-based systems.  _arXiv preprint arXiv:2403.04960_ , 2024c.
  * Xie et al. (2023) Jian Xie, Kai Zhang, Jiangjie Chen, Renze Lou, and Yu Su.  Adaptive chameleon or stubborn sloth: Revealing the behavior of large language models in knowledge conflicts.  In _The Twelfth International Conference on Learning Representations_ , 2023.
  * Xie et al. (2024a) Jian Xie, Kai Zhang, Jiangjie Chen, Tinghui Zhu, Renze Lou, Yuandong Tian, Yanghua Xiao, and Yu Su.  Travelplanner: A benchmark for real-world planning with language agents.  2024a.
  * Xie et al. (2024b) Tianbao Xie, Danyang Zhang, Jixuan Chen, Xiaochuan Li, Siheng Zhao, Ruisheng Cao, Toh Jing Hua, Zhoujun Cheng, Dongchan Shin, Fangyu Lei, Yitao Liu, Yiheng Xu, Shuyan Zhou, Silvio Savarese, Caiming Xiong, Victor Zhong, and Tao Yu.  Osworld: Benchmarking multimodal agents for open-ended tasks in real computer environments, 2024b.
  * Xu et al. (2023a) Benfeng Xu, An Yang, Junyang Lin, Quan Wang, Chang Zhou, Yongdong Zhang, and Zhendong Mao.  Expertprompting: Instructing large language models to be distinguished experts, 2023a.
  * Xu et al. (2022) Chen Xu, Piji Li, Wei Wang, Haoran Yang, Siyun Wang, and Chuangbai Xiao.  Cosplay: Concept set guided personalized dialogue generation across both party personas.  In _Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval_ , pp. 201–211, 2022.
  * Xu et al. (2024a) Hainiu Xu, Runcong Zhao, Lixing Zhu, Jinhua Du, and Yulan He.  Opentom: A comprehensive benchmark for evaluating theory-of-mind reasoning capabilities of large language models, 2024a.
  * Xu et al. (2023b) Qiantong Xu, Fenglu Hong, Bo Li, Changran Hu, Zhengyu Chen, and Jian Zhang.  On the tool manipulation capability of open-source large language models, 2023b.
  * Xu et al. (2024b) Rui Xu, Xintao Wang, Jiangjie Chen, Siyu Yuan, Xinfeng Yuan, Jiaqing Liang, Zulong Chen, Xiaoqing Dong, and Yanghua Xiao.  Character is destiny: Can large language models simulate persona-driven decisions in role-playing?, 2024b.
  * Xu et al. (2023c) Yuzhuang Xu, Shuo Wang, Peng Li, Fuwen Luo, Xiaolong Wang, Weidong Liu, and Yang Liu.  Exploring large language models for communication games: An empirical study on werewolf.  _arXiv preprint arXiv:2309.04658_ , 2023c.
  * Xue et al. (2023) Jintang Xue, Yun-Cheng Wang, Chengwei Wei, Xiaofeng Liu, Jonghye Woo, and C-C Jay Kuo.  Bias and fairness in chatbots: An overview.  _arXiv preprint arXiv:2309.08836_ , 2023.
  * Yamashita et al. (2023) Sanae Yamashita, Koji Inoue, Ao Guo, Shota Mochizuki, Tatsuya Kawahara, and Ryuichiro Higashinaka.  Realpersonachat: A realistic persona chat corpus with interlocutors’ own personalities.  In _Proceedings of the 37th Pacific Asia Conference on Language, Information and Computation_ , pp. 852–861, 2023.
  * Yang et al. (2023a) Fan Yang, Zheng Chen, Ziyan Jiang, Eunah Cho, Xiaojiang Huang, and Yanbin Lu.  Palr: Personalization aware llms for recommendation, 2023a.
  * Yang et al. (2023b) Rui Yang, Lin Song, Yanwei Li, Sijie Zhao, Yixiao Ge, Xiu Li, and Ying Shan.  Gpt4tools: Teaching large language model to use tools via self-instruction.  _arXiv preprint arXiv:2305.18752_ , 2023b.
  * Yang et al. (2024) Shenghao Yang, Weizhi Ma, Peijie Sun, Qingyao Ai, Yiqun Liu, Mingchen Cai, and Min Zhang.  Sequential recommendation with latent relations based on large language model, 2024.
  * Yao et al. (2023a) Shunyu Yao, Dian Yu, Jeffrey Zhao, Izhak Shafran, Thomas L Griffiths, Yuan Cao, and Karthik Narasimhan.  Tree of thoughts: Deliberate problem solving with large language models.  _arXiv preprint arXiv:2305.10601_ , 2023a.
  * Yao et al. (2023b) Shunyu Yao, Jeffrey Zhao, Dian Yu, Nan Du, Izhak Shafran, Karthik R Narasimhan, and Yuan Cao.  React: Synergizing reasoning and acting in language models.  In _The Eleventh International Conference on Learning Representations_ , 2023b.  URL https://openreview.net/forum?id=WE_vluYUL-X.
  * Yim (2023) Keun Soo Yim.  Privacy-friendly personalization of llm responses using hashed entity injection.  2023\.
  * Yin et al. (2024) Wangsong Yin, Mengwei Xu, Yuanchun Li, and Xuanzhe Liu.  Llm as a system service on mobile devices, 2024.
  * Yu et al. (2022) Mo Yu, Yisi Sang, Kangsheng Pu, Zekai Wei, Han Wang, Jing Li, Yue Yu, and Jie Zhou.  Few-shot character understanding in movies as an assessment to meta-learning of theory-of-mind.  _arXiv preprint arXiv:2211.04684_ , 2022.
  * Yu et al. (2023) Mo Yu, Jiangnan Li, Shunyu Yao, Wenjie Pang, Xiaochen Zhou, Zhou Xiao, Fandong Meng, and Jie Zhou.  Personality understanding of fictional characters during book reading.  _arXiv preprint arXiv:2305.10156_ , 2023.
  * Yu et al. (2024) Xiaoyan Yu, Tongxu Luo, Yifan Wei, Fangyu Lei, Yiming Huang, Peng Hao, and Liehuang Zhu.  Neeko: Leveraging dynamic lora for efficient multi-character role-playing agent.  _arXiv preprint arXiv:2402.13717_ , 2024.
  * Yuan et al. (2023) Siyu Yuan, Jiangjie Chen, Ziquan Fu, Xuyang Ge, Soham Shah, Charles Jankowski, Yanghua Xiao, and Deqing Yang.  Distilling script knowledge from large language models for constrained language planning.  In _Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)_ , pp. 4303–4325, Toronto, Canada, July 2023. Association for Computational Linguistics.  URL https://aclanthology.org/2023.acl-long.236.
  * Yuan et al. (2024a) Siyu Yuan, Kaitao Song, Jiangjie Chen, Xu Tan, Yongliang Shen, Ren Kan, Dongsheng Li, and Deqing Yang.  Easytool: Enhancing llm-based agents with concise tool instruction.  _arXiv preprint arXiv:2401.06201_ , 2024a.
  * Yuan et al. (2024b) Xinfeng Yuan, Siyu Yuan, Yuhan Cui, Tianhe Lin, Xintao Wang, Rui Xu, Jiangjie Chen, and Deqing Yang.  Evaluating character understanding of large language models via character profiling from fictional works, 2024b.
  * Zafar et al. (2017) Muhammad Bilal Zafar, Isabel Valera, Manuel Gomez Rogriguez, and Krishna P Gummadi.  Fairness constraints: Mechanisms for fair classification.  In _Artificial intelligence and statistics_ , pp. 962–970. PMLR, 2017.
  * Zhang et al. (2023a) Hongxin Zhang, Weihua Du, Jiaming Shan, Qinhong Zhou, Yilun Du, Joshua Tenenbaum, Tianmin Shu, and Chuang Gan.  Building cooperative embodied agents modularly with large language models.  In _NeurIPS 2023 Foundation Models for Decision Making Workshop_ , 2023a.  URL https://openreview.net/forum?id=oBQVCTpKXW.
  * Zhang et al. (2023b) Jintian Zhang, Xin Xu, and Shumin Deng.  Exploring collaboration mechanisms for llm agents: A social psychology view.  _arXiv preprint arXiv:2310.02124_ , 2023b.
  * Zhang et al. (2018) Saizheng Zhang, Emily Dinan, Jack Urbanek, Arthur Szlam, Douwe Kiela, and Jason Weston.  Personalizing dialogue agents: I have a dog, do you have pets too?  In Iryna Gurevych and Yusuke Miyao (eds.), _Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)_ , pp. 2204–2213, Melbourne, Australia, July 2018. Association for Computational Linguistics.  doi: 10.18653/v1/P18-1205.  URL https://aclanthology.org/P18-1205.
  * Zhang et al. (2024a) Wenlin Zhang, Chuhan Wu, Xiangyang Li, Yuhao Wang, Kuicai Dong, Yichao Wang, Xinyi Dai, Xiangyu Zhao, Huifeng Guo, and Ruiming Tang.  Tired of plugins? large language models can be end-to-end recommenders, 2024a.
  * Zhang et al. (2023c) Wenxuan Zhang, Hongzhi Liu, Yingpeng Du, Chen Zhu, Yang Song, Hengshu Zhu, and Zhonghai Wu.  Bridging the information gap between domain-specific model and general llm for personalized recommendation, 2023c.
  * Zhang & Wan (2023) Xu Zhang and Xiaojun Wan.  Automatically eliciting toxic outputs from pre-trained language models.  2023\.
  * Zhang et al. (2024b) Yikai Zhang, Siyu Yuan, Caiyu Hu, Kyle Richardson, Yanghua Xiao, and Jiangjie Chen.  Timearena: Shaping efficient multitasking language agents in a time-aware simulation.  _arXiv preprint arXiv:2402.05733_ , 2024b.
  * Zhao et al. (2023a) Runcong Zhao, Wenjia Zhang, Jiazheng Li, Lixing Zhu, Yanran Li, Yulan He, and Lin Gui.  Narrativeplay: Interactive narrative understanding.  _arXiv preprint arXiv:2310.01459_ , 2023a.
  * Zhao et al. (2024) Runcong Zhao, Qinglin Zhu, Hainiu Xu, Jiazheng Li, Yuxiang Zhou, Yulan He, and Lin Gui.  Large language models fall short: Understanding complex relationships in detective narratives.  _arXiv preprint arXiv:2402.11051_ , 2024.
  * Zhao et al. (2023b) Yilin Zhao, Xinbin Yuan, Shanghua Gao, Zhijie Lin, Qibin Hou, Jiashi Feng, and Daquan Zhou.  Chatanything: A framework for generating anthropomorphized personas for llm-based characters.  _arXiv preprint arXiv:2311.06772v1_ , 2023b.
  * Zheng et al. (2023a) Mingqian Zheng, Jiaxin Pei, and David Jurgens.  Is" a helpful assistant" the best role for large language models? a systematic evaluation of social roles in system prompts.  _arXiv preprint arXiv:2311.10054_ , 2023a.
  * Zheng et al. (2023b) Yi Zheng, Haibin Huang, Chongyang Ma, and Kanle Shi.  Okr-agent: An object and key results driven agent system with hierarchical self-collaboration and self-evaluation.  2023b.
  * Zheng et al. (2021) Yinhe Zheng, Zikai Chen, Rongsheng Zhang, Shilei Huang, Xiaoxi Mao, and Minlie Huang.  Stylized dialogue response generation using stylized unpaired texts.  _Proceedings of the AAAI Conference on Artificial Intelligence_ , 35(16):14558–14567, May 2021.  doi: 10.1609/aaai.v35i16.17711.  URL https://ojs.aaai.org/index.php/AAAI/article/view/17711.
  * Zheng et al. (2023c) Zhi Zheng, Zhaopeng Qiu, Xiao Hu, Likang Wu, Hengshu Zhu, and Hui Xiong.  Generative job recommendations with large language models.  _arXiv preprint arXiv:2307.02157_ , 2023c.
  * Zhong et al. (2023) Wanjun Zhong, Lianghong Guo, Qiqi Gao, and Yanlin Wang.  Memorybank: Enhancing large language models with long-term memory.  _arXiv preprint arXiv:2305.10250_ , 2023.
  * Zhou et al. (2023a) Jinfeng Zhou, Zhuang Chen, Dazhen Wan, Bosi Wen, Yi Song, Jifan Yu, Yongkang Huang, Libiao Peng, Jiaming Yang, Xiyao Xiao, et al.  Characterglm: Customizing chinese conversational ai characters with large language models.  _arXiv preprint arXiv:2311.16832_ , 2023a.
  * Zhou et al. (2023b) Pei Zhou, Andrew Zhu, Jennifer Hu, Jay Pujara, Xiang Ren, Chris Callison-Burch, Yejin Choi, and Prithviraj Ammanabrolu.  I cast detect thoughts: Learning to converse and guide with intents and theory-of-mind in dungeons and dragons, 2023b.
  * Zhou et al. (2023c) Wangchunshu Zhou, Qifei Li, and Chenle Li.  Learning to predict persona information for dialogue personalization without explicit persona description.  In Anna Rogers, Jordan Boyd-Graber, and Naoaki Okazaki (eds.), _Findings of the Association for Computational Linguistics: ACL 2023_ , pp. 2979–2991, Toronto, Canada, July 2023c. Association for Computational Linguistics.  doi: 10.18653/v1/2023.findings-acl.186.  URL https://aclanthology.org/2023.findings-acl.186.
  * Zhou et al. (2024a) Xuhui Zhou, Zhe Su, Tiwalayo Eisape, Hyunwoo Kim, and Maarten Sap.  Is this the real life? is this just fantasy? the misleading success of simulating social interactions with llms.  _arXiv preprint arXiv:2403.05020_ , 2024a.
  * Zhou et al. (2024b) Xuhui Zhou, Hao Zhu, Leena Mathur, Ruohong Zhang, Haofei Yu, Zhengyang Qi, Louis-Philippe Morency, Yonatan Bisk, Daniel Fried, Graham Neubig, and Maarten Sap.  SOTOPIA: Interactive evaluation for social intelligence in language agents.  In _The Twelfth International Conference on Learning Representations_ , 2024b.  URL https://openreview.net/forum?id=mM7VurbA4r.
  * Zhou et al. (2024c) Yujia Zhou, Qiannan Zhu, Jiajie Jin, and Zhicheng Dou.  Cognitive personalized search integrating large language models with an efficient memory mechanism, 2024c.
  * Zhu et al. (2023a) Andrew Zhu, Lara Martin, Andrew Head, and Chris Callison-Burch.  Calypso: Llms as dungeon masters’ assistants.  In _Proceedings of the Nineteenth AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment_ , AIIDE ’23. AAAI Press, 2023a.  ISBN 1-57735-883-X.  doi: 10.1609/aiide.v19i1.27534.  URL https://doi.org/10.1609/aiide.v19i1.27534.
  * Zhu et al. (2023b) Xizhou Zhu, Yuntao Chen, Hao Tian, Chenxin Tao, Weijie Su, Chenyu Yang, Gao Huang, Bin Li, Lewei Lu, Xiaogang Wang, Yu Qiao, Zhaoxiang Zhang, and Jifeng Dai.  Ghost in the minecraft: Generally capable agents for open-world environments via large language models with text-based knowledge and memory.  _arXiv preprint arXiv:2305.17144_ , 2023b.
  * Zhuang et al. (2024) Yuchen Zhuang, Yue Yu, Kuan Wang, Haotian Sun, and Chao Zhang.  Toolqa: A dataset for llm question answering with external tools.  _Advances in Neural Information Processing Systems_ , 36, 2024.

##  Appendix A Products

The recent remarkable advancements in LLMs have sparked a myriad of AI
applications. Persona and personalization are central to these applications,
with their demands shaping and propelling research in RPLAs. In this section,
we provide a brief overview of recent trends in RPLA applications.
Specifically, we distinguish RPLAs in existing products into two categories,
namely persona-oriented RPLAs and task-oriented RPLAs, as listed in Table 3.

###  A.1 Persona-oriented RPLA Products

Persona-oriented RPLAs typically role-play as specific characters, which has
been popular in various entertainment applications, such as chatbots and game
NPCs. These RPLAs are generally sourced from fictional characters, historical
figures or celebrities, aligning with the research trends on character persona
as introduced in $\mathsection$5. They are further forked for individual use
cases to meet their preference. We categorize existing persona-oriented RPLA
products based on their primary interaction focus, either human-RPLA
interactions or RPLA-RPLA interactions.

#### Interactions between Humans and RPLAs

Persona-oriented RPLAs, such as those in Character.ai, are initially applied
for human-RPLA interactions. These RPLAs can be both initiated from
established characters and shaped through ongoing user interactions.

Having conversations with widely-recognized established characters attracts
extensive interest among users. Consequently, numerous products have been
developed to provide RPLAs representing these established characters,
including celebrities (e.g., Meta AI), historical figures (e.g., Hello
History) and fictional characters (e.g., ChatFAI), or general individuals with
specific professions or personalities (e.g., Character.ai). In a more
personalized manner, users can also create RPLAs with user-defined personas
(e.g., Character.ai, Replika). Technically, these RPLAs are typically built
based on LLMs with strong role-playing capacity, with character settings
briefly described in prompts. While several open-source projects and research
efforts such as ChatHaruhi (Li et al., 2023a) and RoleLLM (Wang et al., 2023g)
curate detailed and comprehensive character data for specific well-known
characters, such practice is rarely adopted by commercial applications for
generality and cost efficiency.

In many products, RPLA personas evolve dynamically throughout the course of
interaction with users (e.g., Replika, Rosebud, Rewind.ai). These RPLAs learn
from and adjust to user prompts and preferences, typically with long-term
memory modules. Several products aim to reproduce a “digital self” (e.g.,
Personal.ai, Bhuman.ai). They build RPLAs to represent user personas,
replicating their languages and even their physical characteristics, such as
voice or visual appearance. Hence, these RPLAs support not only text chats but
also video presentations and conferences, which have been adopted for sales,
digital marketing, customer service, etc.

#### Interactions among RPLAs

Products featuring interactions among multiple RPLAs often target interactive
gaming or simulations. In these scenarios, users can either act as an
orchestrator of the storyline or role-play as one of the pivotal characters
within the story. In Ememe.ai and AI Dungeon, users design the settings and
characters of a simulation, with or without participating directly as a
player, which resembles sandbox games. The characters and storylines are
either generated directly by one story model or based on multiple RPLAs and
their interactions. In the latter case, users play as a character in the story
and interact with other RPLA characters (e.g., SageRPG) Furthermore, numerous
products transform films, novels, and various franchises into immersive RPGs
(role-playing games) with interactive RPLAs (e.g., Hidden Door). Integrating
RPLAs and LLMs into these games expands the possibilities for user actions and
brings characters to life beyond the limitations of predefined storylines,
thereby enriching the overall user experience.

###  A.2 Task-oriented RPLAs

The remarkable advancements in LLMs have propelled significant development in
AI applications for specialized tasks. In these applications, LLMs typically
communicate in a human-like manner to foster user acceptance, and serve as
domain experts providing personalized services for users, such as AI doctors
and coaches. These applications are closely related to research work in the
personalization of RPLAs introduced in $\mathsection$6. We refer to
personalized agents in these products as task-oriented RPLAs. In this section,
we offer a concise overview of task-oriented RPLAs in AI products, spanning
various domains, including education, healthcare, human resources, customer
service, content creation, real estate, shopping, fitness, travel, and
finance.

#### Education

For education, personalized agents are adopted for personalized
recommendations and adaptive learning, serving both educators and learners.
For learners, RPLAs can personalize the learning journey by tailoring content
and recommendations to individual learning styles and paces for optimal
engagement (e.g., Jagoda.AI, Khan Academy’s Khanmigo, Duolingo Max). For
educators, RPLAs can alleviate administrative tasks by recommending
personalized teaching materials and assessments, as well as creating
multilingual instructional content (e.g., Eduaide.Ai).

#### Human Resource

In human resources, RPLAs can provide tailored assistance for job seekers
based on their profiles and interests to aid their career navigation. They
offer personalized support in answering interview questions, offering career
advice, and even customizing interview preparation materials (e.g., Autonomous
HR Chatbot, AI Interview Coach, Careers AI, Huru AI).

#### Real Estate

In the real estate industry, LLMs have been widely adopted for content
generation and recommendation. They can generate blog articles and attractive
descriptions and recommend a list of potential interests for users based on
their needs. By analyzing user preferences and needs, these products can
generate tailored property recommendations to enhance user experience (e.g.,
Epique, Listingcopy). Moreover, LLMs enable these platforms to create
compelling and informative content, such as property descriptions and
neighborhood guides, attracting potential buyers and renters. These
personalized AI products could also analyze vast amounts of market data to
provide users with actionable insights and data-driven strategies about real
estate.

#### Content Generation

AI products for content generation aim to assist in or even automate the
production of creative and personalized content via simply natural language
interactions. These products support a wide array of content types, including
text, images, audio, and videos, tailored to various styles, themes, scenes
and objectives. With state-of-the-art AI models, these products push the
boundaries of human creativity. HyperWrite and AI Story Generator specialize
in creative textual writing, whereas DALL·E 3 and Sora are developed to create
image and video content. Several products specialize in social media posts,
such as EZAi AI and AI Majic. These products provide services for social media
bloggers by analyzing user interactions and offering insights into audience
preferences by providing keywords and detailed analysis. This analysis helps
optimize content impact and strengthen the connection between bloggers and
their audiences. Besides, LLMs could also role-play as assistants to aid users
in grasping online content via summarization and interactive question-
answering, thus fostering enhanced understanding and engagement (e.g., X’s
Grok, Bibigpt).

#### Health

In the healthcare domain, personalized agents provide tailored medical
services for patients, including general health guides, scheduling logistics,
prescription information, patient care guidelines, and assistance in medical
software operations for the aged. These agents are typically personalized
based on patients’ personal data, supported by LLMs and knowledge graphs in
medical domains (e.g., IBM Watson Health and Babylon Health). They could
interact with patients in natural language and continuously adapt to their
personalized contexts. Hence, these agents could well comprehend patients’
intent, generate appropriate responses and recommendations, and continuously
optimize their performance and effectiveness based on patient feedback and
data. (e.g., Ada Health and K Health)

#### Travel

For the tourism industry, personalized agents provide various services,
including information provision, consultation, booking, cancellation, and
complaint handling on social apps. On one hand, many products offer digital
concierge services (e.g., HiJiffy), delivering automated services customized
to suit diverse user needs, including customers’ queries, accents, emotions,
preferences, and other characteristics. This reflects the brand’s commitment
to superior service. On the other hand, travel agents are popular in many
products (e.g., AI Adventures, Trava). These travel agents can pinpoint the
travel needs of users and provide personalized services, including identifying
popular destinations, grasping the underlying intentions behind user queries,
and meet the emotional needs of customers. Through the analysis of collected
user data, these products could refine their services and anticipate market
shifts in tourism.

#### Customer Service

In customer service, personalized agents provide assistance to enhance
problem-solving efficacy and user engagement. They offer 24/7 support across
diverse domains and boost first-contact resolution rates. RPLAs leverage user
feedback and implicit actions to continuously optimize their personalization
and elevate the user experience (e.g., Ebi.Ai, boost.ai, Jason AI, Ada).
Comprehensive AI assistants deliver and analyze user inquiries, preferences,
and context to provide tailored responses. They also extract actionable
insights from conversational data. For example, Viable targets businesses by
empowering them with valuable understanding gleaned from large volumes of user
feedback. This enables companies to make data-driven improvements to their
products and services based on real customer needs and pain points.

#### Shopping

In the shopping industry, personalized agents simulate in-store conversations
to provide tailored product recommendations, match items, and discover trends
based on user preferences. Products such as Shopping Muse (e.g., Dynamic Yield
by Mastercard) offer relevant product suggestions and help users find items
that match their style and interests based on user preferences and needs
through human-agent conversations.

#### Fitness

For fitness, personalized agents enhance the fitness training experience, both
at home and in the gym. RPLA aims to play the role of coaches in setting
realistic goals, adapting exercises based on progress and abilities, and
providing multimodal feedback. Platforms such as WHOOP Coach and Humango
collect users’ biometric information, physical characteristics, and fitness
levels. Through natural language conversations, these agents offer
personalized training plans tailored to individual preferences and needs. By
making personalized health coaching more accessible, these AI-powered RPLAs
democratize access to expert guidance and support for a wider audience.

#### Office

For office productivity, task-oriented RPLAs can role-play as the copilot for
individual workers based on their office data, such as document files and code
repositories. Hence, they deliver context-aware assistance for user requests,
such as generating content and providing insights. For example, Microsoft 365
Copilot integrates various user data, to deliver intelligent service to
respond to user queries and enable more convenient interaction with
applications. It integrates with Microsoft Graph and utilizes user data from
various sources, including documents, email threads and others, with
continuous learning mechanisms to improve its performance over time.
Similarly, GitHub Copilot integrates code repositories of individuals, and
serves as the copilot to boost the productivity of programmers. These
personalized RPLAs empower users to streamline their workflows and enhance
productivity within the office environment.

Table 3: Overview of RPLA applications and products based on LLMs. For personalized data, “Personal Profile” refers to data about one’s identity, including age, appearance, voice, and biographical information. “Behavior History” denotes data derived from interactions between users and applications, representing user bahavior patterns. “File” pertains to documents and computer files, which contain private knowledge regardless of personal identity, such as code and manuals. The three types of personalized data roughly correspond to profile, interactions, and domain knowledge in $\mathsection$6 respectively.  Product |  Domain |  Description |  Target Audience |  Generation Modality |  Personalized Data
---|---|---|---|---|---
Persona-oriented RPLA Products
Character.ai |  Chatbots |  A general AI chat app with a wide range of characters based on individuals with specific professions or personalities |  ToC |  Text |  -
Meta AI Familiar Faces |  Chatbots |  AI characters role-playing celebrities |  ToC |  Text |  -
Hello History |  Chatbots |  Conversation with historical figures |  ToC |  Text |  -
Chatfai |  Chatbots |  A general AI chat app with a wide range of characters based on individuals with specific professions or personalities |  ToC |  Text |  -
Replika |  Chatbots |  An AI companion that serves as an empathetic friend to the user |  ToC |  Text |  Behavior History
Rosebud |  Chatbots |  An AI friend that allows users to journal their thoughts for mental health and personal growth |  ToC |  Text |  Behavior History File
Rewind |  Chatbots |  A personalized agent that has context of what users have seen, heard, or said on their device |  ToC/ToB |  Text Audio |  Personal Profile Behavior History File
BHuman |  Chatbots |  AI digital clone of oneself with added modalities of face cloning and voice cloning |  ToC/ToB |  Text Audio Video |  Personal Profile Behavior History File
personal.ai |  Chatbots |  Train one’s own AI with knowledge of oneself and their own memories |  ToC/ToB |  Text |  Personal Profile Behavior History File
Ememe |  Games |  An AI NPC sandbox that allows users to create characters and observe their life and interactions |  ToC |  Text |  -
AI Dungeon |  Games |  A text-based adventure game where users define the characters and the setting and also participate in the game as a character |  ToC |  Text |  -
Saga |  Games |  An interactive fiction game where one can play as an character from pre-existing Worlds and Characters from popular franchises and media |  ToC |  Text |  -
Hidden Door |  Games |  An interactive game that allows users to play as a character in a world that is converted from existing movie, novel or other types of franchise |  ToC |  Text |  -
Product |  Domain |  Description |  Target Audience |  Generation Modality |  Personalized Data
---|---|---|---|---|---
Task-oriented RPLAs
GPTs |  All |  GPTs from GPT Store are tailored version of ChatGPT for specific tasks developed by the ChatGPT community, with categories like image generation, writing, research, programming, education. |  ToC |  Text Image |  -
Duolingo Max |  Education |  AI Agent that helps users to learn English better |  ToC |  Text |  Personal Profile Behavior History
Jagoda.AI |  Education |  Personalized educational experience |  ToC |  Text |  Personal Profile File
Squirrel AI |  Education |  Uses LLMs and AI for adaptive learning |  ToC |  Text |  -
Eduaide.Ai |  Education |  Eduaide.ai uses AI to generate custom teaching resources and assessments from educator inputs, simplifying lesson planning in multiple languages. |  ToC |  Text |  -
Squirrel AI |  Education |  SquirrelAI employs AI to personalize learning by analyzing student performance, adjusting content, and offering tailored resources and feedback. |  ToC |  Text |  -
Autonomous HR Chatbot |  Human Resource |  An HR chatbot that automates interviews and uses Pinecone’s semantic search, powered by ChatGPT and GPT-3.5-turbo. |  ToC |  Text |  -
Huru |  Human Resource |  Huru AI delivers personalized interview prep, featuring a Chrome Extension for real job listing practice and a mobile app for users on the move. |  ToC |  Text Video |  Personal Profile Behavior History
Careers AI |  Human Resource |  A platform that provides career advice and planning, helping users to identify and achieve their career goals. |  ToC |  Text |  Personal Profile Behavior History
Epique |  Real Estate |  Create a blog post, write a real estate property description, draft an account activation email, and develop Instagram content about legal service pricing. |  ToB |  Text |  -
PropertyPen |  Real Estate |  Generates property listings, provides market analysis, and automates responses |  ToB |  Text |  -
Listingcopy |  Real Estate |  AI tool for creating property listings and attractive content for real estate agents |  ToB |  Text |  Behavior data
Ada |  Customer Service |  Ada.cx delivers personalized customer experiences across various industries, analyzing customer data like past interactions and purchases to anticipate needs and streamline interactions. |  ToB |  Text |  Behavior History File
Ebi.Ai |  Customer Service |  AI assistant platform for business offering customer service and support |  ToB |  Text |  -
Product |  Domain |  Description |  Target Audience |  Generation Modality |  Personalized Data
---|---|---|---|---|---
Task-oriented RPLAs
Jason AI |  Customer Service |  AI assistant for B2B sales, enhancing lead generation and sales strategies. |  ToB |  Text |  Behavior History File
Aide |  Customer Service |  Aide enhances customer experiences by analyzing conversations for insights, automating workflows, and boosting agent efficiency with AI. |  ToB |  Text |  -
Zendesk AI |  Customer Service |  AI customer support agents |  ToB |  Text |  Personal Profile Behavior History File
Air.ai |  Customer Service |  An AI sales and customer service agent that can perform a real phone call and take actions across applications |  ToB |  Audio |  Personal Profile Behavior History File
boost.ai |  Customer Service |  Conversational AI platform for automating customer service and internal support using chat and voice chatbots. |  ToB |  Text Voice |  Personal Profile Behavior History
Viable |  Customer Service |  Viable offers automated user feedback analysis for actionable business insights, customizing data processing to target improvements and inform strategic decisions. |  ToB |  Text |  -
HyperWrite |  Content Generation |  An AI writing assistant that helps users in composing essays and other texts more confidently |  ToC |  Text |  Behavior History
AI Story Generator |  Content Generation |  A tool for generating story ideas, helping writers overcome creative blocks. |  ToC |  Text |  Behavior History
EZAi AI |  Content Generation |  An AI app for Android and IOS that helps users on generating high quality content for social media and Blogs |  ToC/ToB |  Text |  Behavior History
AI Majic |  Content Generation |  AI that specializes in creating and managing social media content and Blogs |  ToC/ToB |  Text |  Behavior History
Jasper |  Content Generation |  Personalized writing suggestions |  ToB |  Text |  Personal Profile Behavior History
ShortlyAI |  Content Generation |  Personalized content generation |  ToC |  Text |  Behavior History
IBM Watson Health |  Health |  AI Agent that provides hidden health problems with personalized plan |  ToC |  Text |  -
Babylon Health |  Health |  LLMs process de-identified medical data with consent, personalizing healthcare through triage, diagnosis, and health predictions. |  ToC |  Text |  -
Product |  Domain |  Description |  Target Audience |  Generation Modality |  Personalized Data
---|---|---|---|---|---
Task-oriented RPLAs
AI Adventures |  Travel |  Use LLM and external tools (API calls) to give personalized plan on travel plans |  ToC |  Text |  Behavior History
Trava |  Travel |  AI travel assistant that facilitates travel bookings and itinerary management. |  ToC |  Text |  Personal Profile
Shopping Muse |  Shopping |  Shopping Muse by Mastercard offers a tailored online shopping experience, simulating in-store conversations to recommend products, match items, and discover trends based on user preferences. |  ToC |  Text |  Personal Profile Behavior History File
WHOOP Coach |  Fitness |  Give advice and responses for fitness goals/plans uniquely tailored to users’ biometric data |  ToC |  Text |  Personal Profile Behavior History File
Humango |  Fitness |  Give customized workout plans and engaging in conversational interactions |  ToC |  Text |  Personal Profile Behavior History File
Microsoft Copilot |  Office |  Integration into Microsoft 365 apps like Word, Excel, PowerPoint, Outlook, Teams for enhanced creativity and productivity. |  ToC |  Text |  Personal Profile Behavior History File
Github Copilot |  Office |  Personalized AI coding copilot developed by GitHub, featuring code completion. |  ToC |  Text |  Personal Profile Behavior History File
NexusGPT |  Office |  Autonomous AI employee for productivity tasks |  ToB |  Text |  Personal Profile Behavior History File