School of Engineering Department of Computer Science and Engineering 82 Generative AI in Interactive Multimedia Applications Supervisor: BRAUD Tristan Camille / CSE Student: WONG Shing Yin / MATH-CS Course: UROP 1100, Spring UROP 2100, Summer Generating a story with more than 10,000 words is always a struggle for LLMs because they don’t have that much context length and aren’t trained to generate novel-like text. To address the issues, we come up with a story generation system with structured input and agentic workflow to solve the issues. Inherent from the story plot UI design in the last report, which proposed a design for organizing the user’s plot about the story with a structured graph. This report introduces an agent LLM inference system to enable LLM to analyze the story generated and all the input settings from users when they use the story plot UI design. Haptic Feedback for Mid-air 3D Drawing Supervisor: BRAUD Tristan Camille / CSE Co-supervisor: LAU Brian Hui Wang / ISD Student: WU Chun Ming / ISD Course: UROP 1100, Fall Virtual Reality (VR) has revolutionized 3D drawing but lacks the tactile feedback crucial for artistic expression. This project addresses this gap by developing a novel controller to provide realistic haptic feedback in midair VR painting. Traditional 2D painting leverages tactile sensations from the brush on canvas, absent in current VR setups. Our aim is to bridge this gap by creating intuitive force feedback, enabling artists to unleash their creativity seamlessly in the VR space. The proposed controller, designed as an attachment to a Quest 3 controller, utilizes gyroscopic precession and IMU feedback to modulate the rection wheel's speed. This innovation allows artists to sense resistance and texture while painting in the virtual realm. The culmination of this project was showcased as a performance art piece at Heath Hong Kong, emphasizing the symbiotic relationship between technology and artistic expression. VR Metaverse for Education Supervisor: BRAUD Tristan Camille / CSE Student: LI Liwei / CPEG ZHOU Siyu / COMP Course: UROP 1000, Summer UROP 1000, Summer The concept of the metaverse has emerged in recent years, seen as a potential future direction for the development of the internet, which presents new opportunities for the education sector. Students can engage in experiential learning within virtual reality, which can enhance their enjoyment and participation in learning. By constructing an immersive, three-dimensional virtual environment using Unity, we seek to enhance student engagement and motivation, enable remote and collaborative learning, facilitate personalized learning paths, and promote experiential hands-on experiences. Through the successful execution of this project, we aspire to build an interactive VR world from scratch and learn the basic operations of Unity.
RkJQdWJsaXNoZXIy NDk5Njg=