Timeline
12.2023 - Current
Team
UIUX Design - Ninna
DEV - Roy, Mike
Tools
Figma + AE +
Nomad + Unity
About the Project

Revolutionizing Museum Experiences with AR Technology
This project marks a significant advancement in educational technology by providing an AR-based solution designed specifically for museum visitors. It utilizes cutting-edge virtual technologies to transform how we engage with art and history. This innovative approach aims to enhance cultural experiences, making them more interactive and accessible for audiences globally.

The nature of the project is rooted in augmented reality experience design, with a focus on innovation driven by a partnership between educational institutions and industry stakeholders. This venture serves as a bridge between formal academic research and practical, real-world application in the museum sector.

Currently, the project is in the development phase and is actively being pitched to potential clients, including prominent museums and IMDA in Singapore. The design process is characterized by an iterative approach, where user feedback is instrumental in evolving the product. The next steps will involve comprehensive evaluation metrics to assess user satisfaction, engagement, adoption, retention, and task success following the implementation by partnering museums.

Sample Experience of Final Design
High - Fidelity Exhibit Interact View Page on InnoGlas AR Glasses
High - Fidelity My Collections Page on InnoGlas AR Glasses
IMPACT

Users reported a heightened sense of immersion and connection with exhibits, with 9/10 of user expressing increased interest in returning to the museum for future AR-enhanced visits.

9/10 of participants found the AR interface intuitive and user-friendly, significantly reducing the time it typically takes to locate and learn about different exhibits within the museum.

The gamification aspect of the AR experience was appreciated, with all users reported their interest in completing the scavenger hunt game after user testing.

*Constructing a high-fidelity demo, we invited 10 target users to participate in usability testing, aiming to meticulously evaluate and enhance the user experience.

Objective
Business Goal

Revolutionize the museum experience by incorporating AR technology to make it more interactive, educational, and engaging. This innovation aims to attract more local and international visitors, enhance learning outcomes, and open new revenue streams through enriched experiences.

Design Objectives
Interactive Educational Content
Multilingual Accessibility
Design Strategies
Implement interactive elements such as AR overlays to make learning more engaging and memorable.
Produce AR content in multiple languages, using both voice and text, to cater to international visitors.
Design Matrics
  • UX Metrics: Visitor engagement time with AR features, usability feedback, ease of navigating the AR experience
  • Business Metrics: Increase in overall visitor numbers, improvement in educational outcomes as measured by visitor surveys, positive feedback, and potentially, new revenue streams identified through enhanced experiences
RESEARCH
Secondary Research

Global Trends and Local Insights on AR in Museums
I've conducted extensive research on how museums are using AR and VR. I studied global examples, read reports like the one from SenseTime, and looked at Singapore's museum trends. It's clear that AR is widely used and well-received by visitors. The SenseTime report shows that people enjoy interaction, stories, 3D models, games, and options for different languages. Our museum project will use these insights to build an AR experience that truly changes how people see our exhibits.

Field Study

Exploring AR Technology in Museums: A Global Insight
I visited notable museums including Guangdong Museum, Sanxingdui Museum in China, and Singapore's National Museum and National Art Gallery to evaluate existing AR solutions and their alignment with business goals. These explorations were key in understanding user needs and the potential of AR technology to enhance museum experiences globally.

Technology Gaps in Singapore's National Museum
At Singapore's National Museum, I noted the reliance on outdated barcode systems for audio explanations, which often disengages visitors due to the need for constant mobile device use and app switching, creating a disjointed experience. The museum also depends on human-guided tours with rigid schedules, restricting visitor flexibility and impacting the overall engagement negatively.

Innovative AR Experiences in Guangdong and Sanxingdui Museums
In stark contrast to Singapore, the Guangdong and Sanxingdui Museums in China showcased advanced AR technology. AR glasses there provided automated, seamless interactions, where scanning artifacts triggered immersive videos that vividly brought history to life. Additionally, these museums enhanced visitor engagement with gamified scavenger hunts, culminating in rewards that added a tangible sense of achievement to the exploration experience.

Enhancing Singapore's Museums with AR Technology
Based on insights from Guangdong and Sanxingdui, I propose adopting AR technology to revolutionize the visitor experience in Singapore. By implementing automated, engaging, and interactive AR solutions, we can transform exhibit interactions, making cultural exploration more intuitive and rewarding.

A video of AR glasses solution, implemented at the Guangzhou Museum.
Competitor Analysis

Field Research Discoveries in Guangzhou
During my field research in Guangzhou, I identified Rokid and Xrany as AR technology leaders. Inspired by their innovative approach, I established connections with suppliers and arranged for three sets of AR glasses to be sent for testing. My goal is to conduct a detailed comparison of their functionalities, optimizing their strengths and addressing any weaknesses in my design. This analysis will enhance the AR museum experience and help select the best hardware partner. Through meticulous evaluation, I aim to develop an AR solution that profoundly enriches the visitor experience.

The competitor analysis of Rokid Corporation Ltd. reveals opportunities to surpass their AR solutions by:
  • Deepening Educational Content: Elevate the learning experience with richer narratives and comprehensive historical insights for each exhibit.
  • Optimizing Artifact Recognition: Implement a more reliable and intuitive 'scan-to-obtain' method, ensuring seamless interaction with exhibits.
  • Expanding Language Options: Introduce extensive multilingual support, catering to a diverse global audience and enhancing accessibility.
  • Creating Immersive Visuals: Utilize a transparent background UI to seamlessly blend AR content with the real world, enriching the user's immersive experience.
Key Takeaways
  • Integrate rich narratives with immersive storytelling and interactive games, deepening educational content.
  • Implement reliable 'scan-to-obtain' methods and intuitive controls like hand gestures and voice commands for seamless exhibit interactions.
  • Expand multilingual support to cater to a diverse audience, enhancing accessibility and personalization.
  • Use transparent background UIs for AR content to blend digital elements with the real world, enriching the immersive experience.
  • Leverage AI and AR technologies for personalized, accessible experiences, appealing to a broad range of visitors with different needs.
User Analysis
Quantitative User Analysis

Exploring AR Acceptance in Singapore Museums
My firsthand research revealed that Singaporean museums rely heavily on traditional mobile technologies for visitor engagement. To assess the potential reception of AR technology, I conducted a quantitative analysis through local surveys. The results highlighted a strong interest in AR, particularly for features like interactive exhibits, multilingual support, and gamified scavenger hunts with rewards. The most enthusiastic demographic was tech-savvy individuals aged 18 to 45. This feedback is crucial, steering the development of an AR museum experience tailored to the interests and expectations of Singapore's visitors, promising a more engaging and dynamic engagement with cultural content.

Qualitative User Analysis

User Insights from In-Depth Interviews on AR in Museums
Interviews with potential AR glasses users, including Jane, a teacher, and Jay, an engineer, revealed a collective enthusiasm for AR's potential to enrich museum learning. Both appreciated how AR meets diverse educational needs. However, Jane raised concerns about its usability for children and international visitors, highlighting the importance of creating user-friendly, intuitive AR experiences. This feedback underscores the necessity for AR designs that are accessible to all ages and backgrounds, enhancing the museum experience without complicating it.

User Experience Map

Revamping the National Museum of Singapore's User Experience with AR
The National Museum of Singapore's visitor experience is hindered by long wait times, unengaging robotic audio guides, limited exhibit information, and forgettable content. To tackle these challenges, I plan to deploy AR technology to revitalize visitor interactions. Key improvements will include interactive virtual guides offering both online and offline content, enhanced storytelling with vivid, interactive explanations, and the integration of AR glasses to simplify artifact photography and enrich the overall museum experience, ensuring visits are not only more engaging but also more memorable.

Key Takeaways

In addition to the previous takeaways obtained from secondary research and fieldwork, there are additional insights gathered from user qualitative and quantitive analysis.

  • Social and Collaborative Features: Integrate social interaction and collaborative learning opportunities within the AR experience to enhance engagement and encourage group participation.
  • Focus on providing personalized content and souvenirs to help visitors preserve memories and form a deeper connection with the exhibits.
Ideation/Brainstorm
DESIGN CHALLENGE

How might we design an intuitive and immersive AR museum experience that not only alleviates current user pain points but also significantly enriches their learning and engagement with the exhibits?

Brainstorming

Streamlining Ideation with Creative Techniques
Using brainstorming, mindmapping, SCAMPER, and word clouds, I efficiently organized research findings and explored extensive design functionalities. This thorough ideation process uncovered a broad spectrum of creative possibilities, ensuring comprehensive exploration of potential features.

User Need & KANO Analysis

Prioritizing AR Features from Brainstorming Insights
Post-brainstorming, I organized the identified needs by priority: high, medium, low, and those excluded due to constraints. The top priorities were interactive exhibit information and storytelling, language selection, and AR scavenger hunt games. These features are crucial for boosting visitor engagement, enhancing accessibility, and promoting interactive learning in museums.


Using KANO analysis to prioritize Phase 1 AR features, we discovered that interactive exhibit information and storytelling are essential "Must-have" features for our audience. Meanwhile, language selection and scavenger hunt games, categorized as "One-dimensional," greatly enhance user satisfaction. These insights guide our launch strategy, ensuring our AR offerings closely meet visitor expectations.

User Flow - Using the AR Glasses

Streamlined AR User Flow from KANO Insights
Using insights from the KANO analysis, I crafted a seamless user flow for the AR museum experience, focusing on each step from renting to returning the glasses. Each phase was designed for clarity and ease, ensuring a straightforward journey for all users.

Information Architecture

This information architecture diagram outlines the structured layout of content and features within the AR museum app, serving as a roadmap for its design and navigation.

Low - Fidelity
Low - Fidelity

low-fidelity prototypes lay the groundwork for the AR museum experience, sketching out the basic user interface, navigation paths, and interaction designs.

High - Fidelity
High - Fidelity

The high-fidelity prototype of our AR museum project incorporates UX research findings to offer interactive learning journeys, immersive storytelling, and engaging games. It features intuitive 'scan-to-obtain' interactions, global accessibility through multilingual support, and seamless visuals that integrate digital and physical environments. Enhanced with AI-driven Q&A, the prototype ensures a personalized, inclusive experience for all visitors.

Welcome Page
To foster a more immersive experience right from the start, we've employed a transparent background UI. This design choice not only minimizes visual clutter but also seamlessly integrates digital content with the physical environment, enhancing the user's sense of presence and engagement with the AR museum experience.

Language Choices
Catering to the diverse tapestry of international visitors, language options are thoughtfully curated based on the most commonly spoken languages in Singapore. This inclusive approach ensures that a wider audience can fully engage with the AR museum experience in their preferred language, fostering a welcoming and accessible environment for all.

Scavenger Hunt Game
Designed to enrich the museum journey, scavenger hunt games are automatically initiated, inviting users to discover and scan artifacts as part of an engaging quest. This interactive adventure not only deepens the exploration experience but also rewards users' curiosity and learning. Upon completing the scavenger hunt and returning the AR glasses, participants are delighted with a prize, creating a memorable end to their museum visit and enhancing user satisfaction.

Scavenger Hunt Game pages in English and Malay:

Scanning Artifacts
Upon scanning an artifact with the AR glasses, users are immediately greeted with immersive storytelling and an interactive 3D model. This feature transforms the viewing experience, allowing visitors to engage with the exhibits in a hands-on manner. By simply pinching their fingers in front of the AR glasses, users can manipulate the 3D model, exploring it from various angles and depths.

I crafted the sample model using Nomad for sculpting, followed by rendering process in Keyshot, ensuring the piece is presented with the utmost detail and realism. This innovative approach not only makes the museum experience more dynamic but also significantly enhances educational engagement.

Scanning artifact & interactive storytelling page in English and Chinese:

Rich Educational Content
Our AR experience offers in-depth content for curious visitors, enriching their learning journey with detailed insights.
AI Q&A Integration: ChatGPT enhances the visit with personalized, instant responses to user queries, making museum exploration interactive and informative.

Learn more page in English and Japanese:

My Collections Page
This feature guides users in tracking collected artifacts, highlighting any missed ones. Completing the collection rewards users with a special gift upon returning the glasses, adding a tangible incentive to the discovery process.

My collections page in English and French:

Users can revisit their collections at any time, exploring detailed information and interacting with 3D models. This continual access aids in reinforcing knowledge, making the museum experience both memorable and educational.

Scavenger Game Completion
Upon completing the scavenger hunt, users receive a completion screen encouraging them to collect their gift, seamlessly guiding them towards their well-earned reward.

Innovative AR Rewards for Museum Visitors
To enhance the scavenger hunt reward, I designed an AR-enhanced keychain inspired by the Singapore Stone, crafted with Nomad and paired with an app. Scanning the keychain with a phone unlocks a wealth of historical details and a 3D model, transforming it into a portal to the past. Future updates will introduce historical videos, enriching this memento with an immersive, educational twist that elevates the traditional museum souvenir experience.

A video of AR Souvenir created using Nomad & Kivicube AR Platform
Iterations
USER TESTING

Developing an Interactive AR Prototype with Unity
Using my Unity skills, I developed an interactive AR prototype for user testing, gathering critical feedback to refine the museum experience. This practical approach guarantees that the design aligns with real-world usability and engagement expectations from actual users.

Enhancing Museum Experiences through User Testing
During our user testing sessions, we engaged 10 participants in a structured evaluation to deeply understand the impacts of our AR glasses. The process included an initial orientation, real-time feedback via the "think-aloud" method, specific tasks to test the functionalities of the AR glasses, and detailed post-interaction interviews to gather insights. The results were highly positive:

1. Increased Engagement: Most participants 9 out of 10 reported a heightened sense of immersion and connection with the exhibits, expressing increased interest in returning for more AR-enhanced visits.

2. Improved Usability: Similarly, 9 out of 10 users found the AR interface intuitive and user-friendly, significantly reducing the time it typically takes to locate and learn about different exhibits.

3. Encouraged Exploration: The gamification elements of the AR experience, the scavenger hunt, were universally appreciated, with all participants showing enthusiasm for completing the game.

Iteration in progress, final  delivery is coming soon...

Back to Top