| Beschreibung |
Advances in Mixed Reality (MR) and conversational AI offer new opportunities for creating interactive and engaging museum experiences. Virtual replicas allow visitors to explore artifacts from new perspectives, while conversational agents can provide contextual information and respond to individual questions and interests. Combining these technologies with traditional exhibition spaces opens up new possibilities for hybrid museum experiences that connect physical and virtual content.
In our semester project “Agents in Mixed Reality Museums”, we will collaborate with the Klassik Stiftung Weimar to develop a Mixed Reality prototype for an exhibition room at the Bauhaus Museum Weimar. The room is equipped with a large display, which we aim to combine with MR headsets to create a hybrid, immersive exhibition space. Visitors will be able to explore virtual replicas of selected artifacts and interact with a conversational agent that provides information about their historical and artistic context.
A central challenge is to design intuitive interactions that integrate virtual artifacts, conversational agents, and the physical exhibition space into a coherent experience. We will investigate how visitors can interact with virtual objects, initiate conversations with agents, and receive information through different modalities, such as speech, gaze, and pointing. Further questions concern how agents can guide visitors' attention toward relevant details and how the large display and individual MR experiences can complement each other to support shared exploration.
During this project, you will design and implement an interactive MR prototype using Unity and C#. You will explore multimodal interaction concepts, gain practical experience with conversational AI and language model APIs, and deepen your knowledge of immersive application development. It is required that students have passed the Virtual Reality course. Prior experience with Unity, C#, or XR development is strongly recommended. Familiarity with 3D modeling, character animation, or conversational AI will be beneficial. Equipment for MR development will be provided. |
