Yifan Shi

Iʼm a UX designer who is eager to listen usersʼ heart sound to provide the best user experience. I design, prototype and develop digital outcomes to improve user experience. This faith drives me to think creatively and deliver fresh solutions.

Final Project

AR to assist home-based exercise

This research investigates the utilisation of augmented technology (AR) to facilitate home-based exercise effectiveness and improve users’ home-based exercise experience. Research has shown that companies and users predominantly target professional sports, neglecting the potential of home-based exercise. The user that exercises at home unlike professional athletes who have coaches, home-based users lack this guidance..

Main features setting

The determination of functions comes from meticulous user analysis, and finally, three main functions are identified.

  1. AR recognises human posture and arrow to guide correct posture.
  2. AR recognition provides correct pose guidelines for body movements
  3. Provide information next to the pose while coaching guidance.

The identification of the three main functions enables users to get practical help and improve their experience when doing home-based exercises.

User-centred design thinking

In order to achieve better UX design for users, the project uses design thinking to aid the design process. During the testing phase, in order to provide a holistic exercise experience, the project measured cognitive loads to design interfaces with moderate cognitive loads. Situational awareness, to ensure smooth and enjoyable use. The user intention is to confirm the positive impacts of the design on the user’s future behaviours.

User-centred storyboard

Bob is in the habit of exercising at home, but he encounters a lot of problems during his workouts that stop him from sticking to his passion for exercising.

1. Injuries or poor results due to lack of proper guidance.

2. Wanting information about posture

3. Not knowing if his posture is correct.

Use AR to assist with home-based exercise and improve exercise experience. After using AR-assisted home exercise, the mobile phone camera recognises Bob’s movements and gives real-time corrections and instructions. In addition to this, detailed information about the movement can be obtained while exercising, making Bob’s understanding of the movement clearer.

User-testing decoding

The tests operated as a “Concierge MVP” Minimum Viable Product (MVP). This means that the design does not have to be realised, but rather the tests are achieved through interpretation.
Firstly, the required test video is recorded, using yoga as an example for this project. Pre-record a video of the effects of AR-assisted home exercise.
Then using the software, FlipaClip, the video was split frame by frame and the AR-guided movement was added to recognise the effect of the body movements.
Finally, the video is imported into Figma software and the final page design is completed and delivered to the user for user testing.

This testing method helped refine the design output and validate the design concept.

AR to assist home-based exercise


  • G-CROSS awards in 2022

Visionary Thinkers

Visionary Creators

Visionary Makers