Augmented Reality and Voice Interaction for New Fruition Paradigms in Museum Visits

The candidate will design and develop an application for Indoor Localization, Artwork Recognition, and Vocal Interaction inside museums and exhibitions, to implement new fruition paradigms and visiting experiences. To achieve this goal, various technologies and techniques need consideration, such as Simultaneous Localization and Mapping (SLAM), Augmented Reality, Speech to Text, Text to Speech, Dialog Management, etc.

The thesis will be developed at the Information Engineering Deparment of the “Università Politecnica delle Marche”.

Involed tools and technologies: Unity, ARCore/ARKit, Web Speech API, DialogFlow, and similar.

Related Works:

  • Sernani, P., Vagni, S., Falcionelli, N., Mekuria, D. N., Tomassini, S., & Dragoni, A. F. (2020). Voice Interaction with Artworks via Indoor Localization: A Vocal Museum. In International Conference on Augmented Reality, Virtual Reality and Computer Graphics (pp. 66-78). Springer, Cham.
  • Sernani, P., Angeloni, R., Dragoni, A. F., Quattrini, R., & Clini, P. (2019). Combining Image Targets and SLAM for AR-Based Cultural Heritage Fruition. In International Conference on Augmented Reality, Virtual Reality and Computer Graphics (pp. 199-207). Springer, Cham.