“MemoWave” is an app that combines AR technology and facial emotion detection to alleviate the psychological stress experienced by individuals with forgetfulness. It focuses on improving memory and reducing stress, helping users better manage their emotions and cognitive health.
HMW Statement：
“How might we develop an AR-integrated app to help individuals with forgetfulness manage stress through emotion detection and immersive interactions?”
Aim and Objective：
Through this app, this study strives to create immersive AR interactions and auditory feedback to alleviate psychological stress and enhance memory for individuals with forgetfulness. The project aims to fill the gaps in traditional interventions by providing creative methods for memory rehabilitation and emotional health, offering new support for those affected by memory loss.
One of MemoWave’s core features is the mood card system. The app analyses the user’s emotional state through Facial Expression Recognition technology, after which the user can scan the corresponding emotion card to enter an AR experience. These AR mood avatars visually interact with the user and are accompanied by soothing background music and personalised suggestions, helping users record emotional changes through multisensory interactions.
What are the functions of the APP?
- Home: The Home page allows the user to see a history of mood cards recorded on a memory Journey timeline. Every mood the user scans with AR is recorded in Memory Journey, and when the user clicks on a particular day, the APP will show the mood card they recorded on that day.
- Memo/Alarm Clock: The user can record everything that needs to be reminded in the memo, and the alarm clock will remind the user in time.
- AR Function: In the middle is the AR function. After the mobile phone camera scans the user's emotional state, the APP will know whether the user is happy or anxious and suggest a suitable physical emotional card, which can be bought through the APP.
- Forum:
—Psychologist's section: Psychologists will provide knowledge and advice through forum postings.
—It provides a space where users can share experiences, offer support, and discuss challenges related to memory and stress.
—Peer Interaction: Allows users to connect with others facing similar challenges.
- Mood data recording: Based on the mood data recorded by the user for this period (memory journey), the APP will provide analyses and suggestions on memory performance and stress levels, helping the user to understand their emotional state promptly and take suitable actions.
The app provides appropriate interventions based on emotional fluctuations, enhancing emotional awareness and memory management skills. Through this immersive interaction, MemoWave helps users identify and manage their emotions and guides them in gradually cultivating a positive mental state, improving memory and cognitive function, and offering comprehensive emotional health.
Video Explaining User Interaction and App Functions
