AR Smart Docent Service

2017 - 2018
Ministry of Culture, Sports & Tourism (MCST) R&D Project
Interaction Research & Prototyping (PI: Kyubin Lee, GIST), KCT R&D

2019 Final prototype demonstration. Source: Virnect

The Intelligent AI Docent project utilized AR technologies to transform the museum experience by providing a personalized docent service that adapts dynamically to each visitor's needs. Leveraging real-time emotion recognition, the system analyzed visitor profiles to create tailored exploration journeys and pathways. With gesture and voice interactions, visitors could engage with augmented information and interact with historical figures, enriching the storytelling experience. The project also examined the technical requirements for an AR content authoring tool to empower curators.

Contributions:

• Designed personalized museum interaction scenarios, drawing insights from comprehensive case studies on digital storytelling in museum environments.

• Investigated creative storytelling possibilities and assessed technical feasibility for a content authoring system, enabling curators to create custom, interactive AR experiences for cultural artifacts.

• Developed and tested the initial voice recognition module, integrating Korean speech recognition using Google Cloud Speech API to enable voice interactions with the AI Docent.

• Initiated contact and worked closely with external development team (Virnect) to build the AR Docent prototype, effectively bridging design requirements with practical implementation needs.

Source: GIST