Grow With Me

A High-Fidelity prototype that integrates Augmented Reality with Personal Health Informatics

A High-Fidelity prototype that integrates Augmented Reality with Personal Health Informatics

A High-Fidelity prototype that integrates Augmented Reality with Personal Health Informatics

Jump To

Heuristic Eval - Web Service . Heuristic Eval - ReefAI . Visual Analytics Guide . Usability Survey . Challenges and Takeaways

MY ROLE


UX Researcher: I used p5.js to incorporate the speech input and map the volume and frequency to the color and thickness of the generated art to introduce emotion-based variance.


Platform Analyst: Through ideation, I helped find the value proposition for our idea - personalized postcards - by leveraging the Hackathon theme and the technical and design skills of the team.


Visual Designer: I played a pivotal role in synthesizing the front-end and back-end code through Python to ensure real-time generation of postcards based on speech input.

INTERNSHIP SCOPE

June - December '23 (7 months)

Direct report to -
Atul Prakash, Global Head - Platform Deployments

Sandeep Roy, Co-founder and Chief Digital Officer

TOOLS/SKILLS


UX Design, Heuristic Evaluation, Data Visualization, Branding, Platform Testing, Usability Survey Design, Figma

MY ROLE
Creative Coding: I formulated a comprehensive user survey for preliminary research and conducted in-depth analyses of the collected results.


Design and Strategy: Following the requirements phase, I employed Figma to meticulously craft an interactive prototype and produced a detailed walkthrough video to enhance the effectiveness of the presentation.


Synthesis: I played a pivotal role in executing a thorough competitive analysis, conducting extensive market research, delineating investment requirements, and formulating a projected roadmap for Buzzin's scalable production.

INTERNSHIP SCOPE
June - December '23 (7 months)

Direct report to -
Atul Prakash, Global Head - Platform Deployments

Sandeep Roy, Co-founder and Chief Digital Officer

TOOLS/SKILLS

UX Design, Heuristic Evaluation, Data Visualization, Branding, Platform Testing, Usability Survey Design, Figma

Jump To

Heuristic Eval - Web Service . Heuristic Eval - ReefAI . Visual Analytics Guide . Usability Survey . Challenges and Takeaways

MY ROLE


User Research: I used p5.js to incorporate the speech input and map the volume and frequency to the color and thickness of the generated art to introduce emotion-based variance.


UX Design: Through ideation, I helped find the value proposition for our idea - personalized postcards - by leveraging the Hackathon theme and the technical and design skills of the team.


User Studies:
Through ideation, I helped find the value proposition for our idea - personalized postcards - by leveraging the Hackathon theme and the technical and design skills of the team.



PROJECT SCOPE

Aug - Dec '22 (4 months)
Advisor - Dr. Jennifer Kim

Tulika Banerjee, MS
Yuchen Zhao, PhD

TOOLS/SKILLS


User-centered design, Usability Survey Design, Card sorting, Mixed Methods Research, Wireframing, Prototyping, Figma

KEYWORDS


Human-centered computing, Mixed/augmented reality, Personal Health Informatics, Augmented Reality, Emotional Design

Jump To

Heuristic Eval - Web Service . Heuristic Eval - ReefAI . Visual Analytics Guide . Usability Survey . Challenges and Takeaways


Abstract


Abstract


Maintaining a healthy lifestyle requires continuous ongoing efforts. A range of technologies such as wearable devices, ubiquitous computing, mobile devices, and social media, have been investigated to motivate individuals to keep healthy.


We present Grow with Me, an application that uses Augmented Reality (AR)'s immersion and interaction affordance with personal health informatics to stimulate emotion and increase user engagement.

In this application, the user has a pet AR dog and the user’s health data is directly correlated with their pet’s health. The user’s progress towards their goals determines their dog’s health and mood. As a user uncovers new milestones, their dog can learn new tricks.


In a mixed methods experiment design with 10 participants who were asked to use both a 2D version of our app and an AR version, we found that the AR pet elicited stronger emotions and participants showed a greater intention to use AR as a motivation tool.

In this paper, we discuss our study and findings along with the design opportunities of AR as a tool for motivation.

Maintaining a healthy lifestyle requires continuous ongoing efforts. A range of technologies such as wearable devices, ubiquitous computing, mobile devices, and social media, have been investigated to motivate individuals to keep healthy.


We present Grow with Me, an application that uses Augmented Reality (AR)'s immersion and interaction affordance with personal health informatics to stimulate emotion and increase user engagement.

In this application, the user has a pet AR dog and the user’s health data is directly correlated with their pet’s health. The user’s progress towards their goals determines their dog’s health and mood. As a user uncovers new milestones, their dog can learn new tricks.


In a mixed methods experiment design with 10 participants who were asked to use both a 2D version of our app and an AR version, we found that the AR pet elicited stronger emotions and participants showed a greater intention to use AR as a motivation tool.

In this paper, we discuss our study and findings along with the design opportunities of AR as a tool for motivation.

Check out the Final Presentation!

Check out the Final Presentation!

Check out the Final Presentation!

Heuristic Evaluation and Design Recommendations - Web Service

Heuristic Evaluation and Design Recommendations - Web Service

01


01


01


Students have limited time available to them. With so many events happening around campus, it is impossible for them to keep track of them all and hence, students miss out on events of importance to them and lose out on a holistic campus experience.


Students have limited time available to them. With so many events happening around campus, it is impossible for them to keep track of them all and hence, students miss out on events of importance to them and lose out on a holistic campus experience.


02


02


02


It is crucial that alerts and campus-wide notifications reach students on time, especially in emergencies. Other times, receiving notifications on time can save valuable time and energy.


It is crucial that alerts and campus-wide notifications reach students on time, especially in emergencies. Other times, receiving notifications on time can save valuable time and energy.


Heuristic Evaluation and Design Recommendations - ReefAI (Proprietary LLM-based tool)


Opportunities and Ideation


01


01


01


Students have limited time available to them. With so many events happening around campus, it is impossible for them to keep track of them all and hence, students miss out on events of importance to them and lose out on a holistic campus experience.


Students have limited time available to them. With so many events happening around campus, it is impossible for them to keep track of them all and hence, students miss out on events of importance to them and lose out on a holistic campus experience.


02


02


02


It is crucial that alerts and campus-wide notifications reach students on time, especially in emergencies. Other times, receiving notifications on time can save valuable time and energy.


It is crucial that alerts and campus-wide notifications reach students on time, especially in emergencies. Other times, receiving notifications on time can save valuable time and energy.


Visual Analytics Guide

Visual Analytics Guide

01


01


01


Students have limited time available to them. With so many events happening around campus, it is impossible for them to keep track of them all and hence, students miss out on events of importance to them and lose out on a holistic campus experience.


Students have limited time available to them. With so many events happening around campus, it is impossible for them to keep track of them all and hence, students miss out on events of importance to them and lose out on a holistic campus experience.


02


02


02


It is crucial that alerts and campus-wide notifications reach students on time, especially in emergencies. Other times, receiving notifications on time can save valuable time and energy.


It is crucial that alerts and campus-wide notifications reach students on time, especially in emergencies. Other times, receiving notifications on time can save valuable time and energy.


Putting it all together

Putting it all together

We proposed to launch the entire feature set of the app over four iterative phases with the product specifications for each phase outlined below.

We proposed to launch the entire feature set of the app over four iterative phases with the product specifications for each phase outlined below.

Challenges & Takeaways

Challenges & Takeaways

Wearing many hats

Unlike most hackathons, we did not have the ability to choose our own teams and were assigned to a team of four based on a business chemistry test. We were effectively strangers with a common goal.


Given the short timeframe of the challenge, this implied instantly assessing our diverse skillsets and interests for efficient work distribution and tuning ourselves to be on the same wavelength. Moreover, our schedules made it difficult for us to meet in person, reinforcing strong active communication.

Wearing many hats

Unlike most hackathons, we did not have the ability to choose our own teams and were assigned to a team of four based on a business chemistry test. We were effectively strangers with a common goal.


Given the short timeframe of the challenge, this implied instantly assessing our diverse skillsets and interests for efficient work distribution and tuning ourselves to be on the same wavelength. Moreover, our schedules made it difficult for us to meet in person, reinforcing strong active communication.

Wearing many hats

Unlike most hackathons, we did not have the ability to choose our own teams and were assigned to a team of four based on a business chemistry test. We were effectively strangers with a common goal.


Given the short timeframe of the challenge, this implied instantly assessing our diverse skillsets and interests for efficient work distribution and tuning ourselves to be on the same wavelength. Moreover, our schedules made it difficult for us to meet in person, reinforcing strong active communication.

Stakeholders, stakeholders, stakeholders

The Innovation challenge took place in the middle of finals week, and we found ourselves juggling this along with classes and exams. As such, one of our teammates dropped out of the challenge, leaving us with a team of three.

I took the initiative to coordinate our schedules and fill in for work if one of my teammates was held up. This truly challenged and honed my time management skills.

Stakeholders, stakeholders, stakeholders

The Innovation challenge took place in the middle of finals week, and we found ourselves juggling this along with classes and exams. As such, one of our teammates dropped out of the challenge, leaving us with a team of three.

I took the initiative to coordinate our schedules and fill in for work if one of my teammates was held up. This truly challenged and honed my time management skills.

Stakeholders, stakeholders, stakeholders

The Innovation challenge took place in the middle of finals week, and we found ourselves juggling this along with classes and exams. As such, one of our teammates dropped out of the challenge, leaving us with a team of three.

I took the initiative to coordinate our schedules and fill in for work if one of my teammates was held up. This truly challenged and honed my time management skills.

©2024 Tulika Banerjee

©2024 Tulika Banerjee

©2024 Tulika Banerjee