Academy of Interdisciplinary Studies Division of Integrative Systems and Design 247 Generative AI in Interactive Multimedia Applications Supervisor: Tristan Camille BRAUD / ISD Student: LEE Eunseo / COMP Course: UROP 1100, Spring This paper describes the design, development, and evaluation of a Unity-based 2D topdown game featuring AI-driven Non-Player Characters (NPCs). I implemented a dynamic dialogue system utilising a Flask server and large language models (LLM) through Open-Router. Each NPC possesses distinct personalities, memories, and speech styles, dynamically stored and retrieved via JSON prompts. An advanced scheduler manages NPC interactions, movements, and conversations, allowing immersive gameplay. Key challenges addressed include parsing dialogue responses from LLMs, integrating LLM-generated tasks, and ensuring responsive UI elements. The implemented system demonstrates successful NPC interaction, offering improved immersion and narrative depth. This work provides insights for integrating generative Artificial Intelligence (AI) into interactive game environments. Generative AI in Interactive Multimedia Applications Supervisor: Tristan Camille BRAUD / ISD Student: NG Yat Fei / COMP Course: UROP 1100, Summer This progress report outlines my ongoing contribution to a project that applies rich visual effects in JavaScript using the three.js library. The primary objective is to enrich how emotions are expressed and foster reflection among users. So far, significant progress has been made, including three types of visual applications on flower models: point-cloud style, multi-color point reconstruction and shader pipeline. Challenges encountered include vertex extraction, adjustment of shader parameters and coloring methods, which have been partly addressed by online research and seeking advice from generative AI. This project has deepened my understanding of computer graphics and AI applications in multimedia contexts. Sea, Sense, and Melody - 3D design for Generative Art Supervisor: Tristan Camille BRAUD / ISD Student: CHAU Wing Yan Vivien / ISD Course: UROP 1000, Summer Student mental health is an increasingly vital concern in university settings, particularly at the Hong Kong University of Science and Technology (HKUST). Sea, Senses and Melody is a campus-based initiative designed to foster emotional expression through an immersive, therapeutic experience that blends art, technology, and interactivity. Central to the project is a large LED screen installed on campus, where individuals can scan a QR code using their mobile devices to anonymously share their feelings. These textual inputs are interpreted by a large language model (LLM) and transformed into descriptive representations of flowers, which are then visualized and displayed on the screen. As participation grows, the screen blossoms with a dynamic array of floral imagery, symbolizing collective emotional presence. A key aspect of the project involves identifying suitable flower visualizations to effectively convey emotional nuance and offer a sense of comfort to participants engaging with the installation. It requires careful consideration of aesthetics, psychology, and technology.
RkJQdWJsaXNoZXIy NDk5Njg=