

Grow With Me
A High-Fidelity prototype that integrates Augmented Reality with Personal Health Informatics
A High-Fidelity prototype that integrates Augmented Reality with Personal Health Informatics
A High-Fidelity prototype that integrates Augmented Reality with Personal Health Informatics


Jump To
Heuristic Eval - Web Service . Heuristic Eval - ReefAI . Visual Analytics Guide . Usability Survey . Challenges and Takeaways
MY ROLE
UX Researcher: I used p5.js to incorporate the speech input and map the volume and frequency to the color and thickness of the generated art to introduce emotion-based variance.
Platform Analyst: Through ideation, I helped find the value proposition for our idea - personalized postcards - by leveraging the Hackathon theme and the technical and design skills of the team.
Visual Designer: I played a pivotal role in synthesizing the front-end and back-end code through Python to ensure real-time generation of postcards based on speech input.
INTERNSHIP SCOPE
June - December '23 (7 months)
Direct report to -
Atul Prakash, Global Head - Platform Deployments
Sandeep Roy, Co-founder and Chief Digital Officer
TOOLS/SKILLS
UX Design, Heuristic Evaluation, Data Visualization, Branding, Platform Testing, Usability Survey Design, Figma
MY ROLE
Creative Coding: I formulated a comprehensive user survey for preliminary research and conducted in-depth analyses of the collected results.
Design and Strategy: Following the requirements phase, I employed Figma to meticulously craft an interactive prototype and produced a detailed walkthrough video to enhance the effectiveness of the presentation.
Synthesis: I played a pivotal role in executing a thorough competitive analysis, conducting extensive market research, delineating investment requirements, and formulating a projected roadmap for Buzzin's scalable production.
INTERNSHIP SCOPE
June - December '23 (7 months)
Direct report to -
Atul Prakash, Global Head - Platform Deployments
Sandeep Roy, Co-founder and Chief Digital Officer
TOOLS/SKILLS
UX Design, Heuristic Evaluation, Data Visualization, Branding, Platform Testing, Usability Survey Design, Figma
Jump To
Heuristic Eval - Web Service . Heuristic Eval - ReefAI . Visual Analytics Guide . Usability Survey . Challenges and Takeaways
MY ROLE
User Research: I used p5.js to incorporate the speech input and map the volume and frequency to the color and thickness of the generated art to introduce emotion-based variance.
UX Design: Through ideation, I helped find the value proposition for our idea - personalized postcards - by leveraging the Hackathon theme and the technical and design skills of the team.
User Studies: Through ideation, I helped find the value proposition for our idea - personalized postcards - by leveraging the Hackathon theme and the technical and design skills of the team.
PROJECT SCOPE
Aug - Dec '22 (4 months)
Advisor - Dr. Jennifer Kim
Tulika Banerjee, MS
Yuchen Zhao, PhD
TOOLS/SKILLS
User-centered design, Usability Survey Design, Card sorting, Mixed Methods Research, Wireframing, Prototyping, Figma
KEYWORDS
Human-centered computing, Mixed/augmented reality, Personal Health Informatics, Augmented Reality, Emotional Design
Jump To
Heuristic Eval - Web Service . Heuristic Eval - ReefAI . Visual Analytics Guide . Usability Survey . Challenges and Takeaways
Abstract
Abstract
Maintaining a healthy lifestyle requires continuous ongoing efforts. A range of technologies such as wearable devices, ubiquitous computing, mobile devices, and social media, have been investigated to motivate individuals to keep healthy.
We present Grow with Me, an application that uses Augmented Reality (AR)'s immersion and interaction affordance with personal health informatics to stimulate emotion and increase user engagement.
In this application, the user has a pet AR dog and the user’s health data is directly correlated with their pet’s health. The user’s progress towards their goals determines their dog’s health and mood. As a user uncovers new milestones, their dog can learn new tricks.
In a mixed methods experiment design with 10 participants who were asked to use both a 2D version of our app and an AR version, we found that the AR pet elicited stronger emotions and participants showed a greater intention to use AR as a motivation tool.
In this paper, we discuss our study and findings along with the design opportunities of AR as a tool for motivation.
Maintaining a healthy lifestyle requires continuous ongoing efforts. A range of technologies such as wearable devices, ubiquitous computing, mobile devices, and social media, have been investigated to motivate individuals to keep healthy.
We present Grow with Me, an application that uses Augmented Reality (AR)'s immersion and interaction affordance with personal health informatics to stimulate emotion and increase user engagement.
In this application, the user has a pet AR dog and the user’s health data is directly correlated with their pet’s health. The user’s progress towards their goals determines their dog’s health and mood. As a user uncovers new milestones, their dog can learn new tricks.
In a mixed methods experiment design with 10 participants who were asked to use both a 2D version of our app and an AR version, we found that the AR pet elicited stronger emotions and participants showed a greater intention to use AR as a motivation tool.
In this paper, we discuss our study and findings along with the design opportunities of AR as a tool for motivation.
Check out the Final Presentation!
Check out the Final Presentation!
Check out the Final Presentation!
Heuristic Evaluation and Design Recommendations - Web Service
Heuristic Evaluation and Design Recommendations - Web Service
01
01
01
Students have limited time available to them. With so many events happening around campus, it is impossible for them to keep track of them all and hence, students miss out on events of importance to them and lose out on a holistic campus experience.
Students have limited time available to them. With so many events happening around campus, it is impossible for them to keep track of them all and hence, students miss out on events of importance to them and lose out on a holistic campus experience.
02
02
02
It is crucial that alerts and campus-wide notifications reach students on time, especially in emergencies. Other times, receiving notifications on time can save valuable time and energy.
It is crucial that alerts and campus-wide notifications reach students on time, especially in emergencies. Other times, receiving notifications on time can save valuable time and energy.
Heuristic Evaluation and Design Recommendations - ReefAI (Proprietary LLM-based tool)
Opportunities and Ideation
01
01
01
Students have limited time available to them. With so many events happening around campus, it is impossible for them to keep track of them all and hence, students miss out on events of importance to them and lose out on a holistic campus experience.
Students have limited time available to them. With so many events happening around campus, it is impossible for them to keep track of them all and hence, students miss out on events of importance to them and lose out on a holistic campus experience.
02
02
02
It is crucial that alerts and campus-wide notifications reach students on time, especially in emergencies. Other times, receiving notifications on time can save valuable time and energy.
It is crucial that alerts and campus-wide notifications reach students on time, especially in emergencies. Other times, receiving notifications on time can save valuable time and energy.
Visual Analytics Guide
Visual Analytics Guide
01
01
01
Students have limited time available to them. With so many events happening around campus, it is impossible for them to keep track of them all and hence, students miss out on events of importance to them and lose out on a holistic campus experience.
Students have limited time available to them. With so many events happening around campus, it is impossible for them to keep track of them all and hence, students miss out on events of importance to them and lose out on a holistic campus experience.
02
02
02
It is crucial that alerts and campus-wide notifications reach students on time, especially in emergencies. Other times, receiving notifications on time can save valuable time and energy.
It is crucial that alerts and campus-wide notifications reach students on time, especially in emergencies. Other times, receiving notifications on time can save valuable time and energy.
Putting it all together
Putting it all together
We proposed to launch the entire feature set of the app over four iterative phases with the product specifications for each phase outlined below.
We proposed to launch the entire feature set of the app over four iterative phases with the product specifications for each phase outlined below.


Challenges & Takeaways
Challenges & Takeaways
Wearing many hats
Unlike most hackathons, we did not have the ability to choose our own teams and were assigned to a team of four based on a business chemistry test. We were effectively strangers with a common goal.
Given the short timeframe of the challenge, this implied instantly assessing our diverse skillsets and interests for efficient work distribution and tuning ourselves to be on the same wavelength. Moreover, our schedules made it difficult for us to meet in person, reinforcing strong active communication.
Wearing many hats
Unlike most hackathons, we did not have the ability to choose our own teams and were assigned to a team of four based on a business chemistry test. We were effectively strangers with a common goal.
Given the short timeframe of the challenge, this implied instantly assessing our diverse skillsets and interests for efficient work distribution and tuning ourselves to be on the same wavelength. Moreover, our schedules made it difficult for us to meet in person, reinforcing strong active communication.
Wearing many hats
Unlike most hackathons, we did not have the ability to choose our own teams and were assigned to a team of four based on a business chemistry test. We were effectively strangers with a common goal.
Given the short timeframe of the challenge, this implied instantly assessing our diverse skillsets and interests for efficient work distribution and tuning ourselves to be on the same wavelength. Moreover, our schedules made it difficult for us to meet in person, reinforcing strong active communication.

Stakeholders, stakeholders, stakeholders
The Innovation challenge took place in the middle of finals week, and we found ourselves juggling this along with classes and exams. As such, one of our teammates dropped out of the challenge, leaving us with a team of three.
I took the initiative to coordinate our schedules and fill in for work if one of my teammates was held up. This truly challenged and honed my time management skills.
Stakeholders, stakeholders, stakeholders
The Innovation challenge took place in the middle of finals week, and we found ourselves juggling this along with classes and exams. As such, one of our teammates dropped out of the challenge, leaving us with a team of three.
I took the initiative to coordinate our schedules and fill in for work if one of my teammates was held up. This truly challenged and honed my time management skills.
Stakeholders, stakeholders, stakeholders
The Innovation challenge took place in the middle of finals week, and we found ourselves juggling this along with classes and exams. As such, one of our teammates dropped out of the challenge, leaving us with a team of three.
I took the initiative to coordinate our schedules and fill in for work if one of my teammates was held up. This truly challenged and honed my time management skills.
©2024 Tulika Banerjee
©2024 Tulika Banerjee
©2024 Tulika Banerjee