Application and Analysis of Large Language Models in Game NPCs
DOI:
https://doi.org/10.54097/q5k9a015Keywords:
Large Model; Non-player characters; Framework; Game Agent.Abstract
In recent years, the breakthroughs of large language models (LLMs) in capabilities such as natural language understanding and multi-turn dialogue generation have not only promoted the technical implementation in fields like natural language processing (NLP) and computer vision (CV), but also provided core support for the integrated exploration of "LLMs + intelligent agents". However, most tests rely on simple and static virtual scenarios, which are difficult to simulate the complex environments with "multi-variable interaction and dynamic target changes" in real situations. Games, however, can exactly fill this gap: they can not only construct interactive scenarios requiring advanced cognitive abilities (e.g., task decision-making in open worlds, emotional dialogue of non-player characters (NPCs)), but also achieve low-cost data acquisition and controllable variables through procedural generation. Therefore, games have become an ideal carrier for evaluating the comprehensive capabilities of intelligent agents. With the steady growth of the game market share in recent years, various game manufacturers have introduced LLMs into in-game NPCs and achieved positive results. Research on the application of LLMs in game NPCs is of great significance for the intelligent advancement of NPCs. This review mainly summarizes and analyzes the model frameworks of LLM applications in NPCs, which can provide assistance for the construction of more reasonable and in-depth frameworks. It is conducive to the cross-optimization of models and provides reference significance for model development. In the future, the research applied to game NPCs is also expected to be extended to other fields.
Downloads
References
[1] Kopel M, Hajas T. Implementing AI for Non-player Characters in 3D Video Games. In: Nguyen NT, Trawiński B, Fujita H, et al. (eds) Asian Conference on Intelligent Information and Database Systems (ACIIDS 2018). Lecture Notes in Artificial Intelligence, vol 10751. Springer, Cham. 2018: 610-619. https://doi.org/10.1007/978-3-319-75417-8_57 DOI: https://doi.org/10.1007/978-3-319-75417-8_57
[2] Muhtar C U and Kaya O. Non‑player character decision‑making in computer games. Artificial Intelligence Review 56, 2023, 14159–14191. https://doi.org/10.1007/s10462-023-10491-7 DOI: https://doi.org/10.1007/s10462-023-10491-7
[3] Tan W, Zhang W, et al. True knowledge comes from practice: Aligning large language models with embodied environments via reinforcement learning. In Proceedings of the International Conference on Learning Representations (ICLR 2024). 2024.
[4] Klissarov M, Hjelm D, Toshev A, & Mazoure B. On the modeling capabilities of large language models for sequential decision making. arXiv:2410.05656v1 [cs.AI]. 8 Oct. 2024.
[5] Marincioni A, Miltiadous M, Zacharia K, Heemskerk R, Doukeris G, Preuss M, & Barbero G. The Effect of LLM-Based NPC Emotional States on Player Emotions: An Analysis of Interactive Game Play. In 2024 IEEE Conference on Games (CoG), Leiden, Netherlands, 2024. IEEE. DOI:10.1109/CoG60054.2024.10645631 DOI: https://doi.org/10.1109/CoG60054.2024.10645631
[6] Volum R, Rao S, Xu M, DesGarennes G, Brockett C, Van Durme B, Deng O, Malhotra A, Dolan B. Craft an Iron Sword: Dynamically Generating Interactive Game Characters by Prompting Large Language Models Tuned on Code. In Proceedings of the 3rd Wordplay: When Language Meets Games Workshop (Wordplay 2022), July 14, 2022, Dublin, Ireland. Association for Computational Linguistics, 2022, pp. 25–43. https://github.com/microsoft/interactive-minecraft-npcs. DOI: https://doi.org/10.18653/v1/2022.wordplay-1.3
[7] Park J S, O’Brien J C, Cai C J, Morris M R, Liang P, & Bernstein M S. Generative agents: Interactive simulacra of human behavior. In *Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology. 2023 (UIST ’23) * (pp. 1–22). San Francisco, CA, USA: ACM. https://doi.org/10.1145/3586183.3606763 DOI: https://doi.org/10.1145/3586183.3606763
[8] Li D F. Digital Labyrinths and Waxy Wings: Prospects and Challenges of Generative AI NPCs in Video Games. Journal of Beijing Film Academy, 2024, No. 216 (12), 39-48.
[9] Hong M, Zhang K, Zhang S, & He Z. FedNPC: A Federated Learning Framework for Large Language Models in Game NPCs. In 2023 IEEE 21st Student Conference on Research and Development (SCOReD). 2023. https://doi.org/10.1109/SCOReD60679.2023.10563705 DOI: https://doi.org/10.1109/SCOReD60679.2023.10563705
[10] Xu X, Wang Y, Xu C, Ding Z, Jiang J, Ding Z, & Karlsson B F. A Survey on Game Playing Agents and Large Models: Methods, Applications, and Challenges arXiv preprint arXiv:2403.10249, 2024. https://arxiv.org/abs/2403.10249
Downloads
Published
Issue
Section
License
Copyright (c) 2025 Highlights in Science, Engineering and Technology

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.







