Guided Cooking with AR – Cooking assistant for AR glasses

Proof of concept of a gaze controlled cooking assistant for Augmented Reality glasses. For this purpose, a prototypical iOS application was developed as part of a user-centered design process, which accompanies the user throughout the cooking process.

The virtual cooking instructions appear in the user’s field of view at the appropriate location when they are needed.

Further, this thesis deals with the question of whether the developed application can counteract the estrangement from the real world caused by
technical developments, such as computers, smartphones, virtual reality or even modern kitchen appliances.

Special Focus

The emphasis of this work was placed on the conception and development of the prototype using user-oriented methods and thereby focusing on two
important issues:

The first question deals with the adaption of recipes for an Augmented Reality cooking assistant. For this purpose, a system has been developed
which can be used to adapt any arbitrary recipe.

The second question investigates whether gaze control is suitable for the intuitive use of a cooking assistance application with Augmented Reality
glasses. To answer this question, the gaze control implementation in the prototype was evaluated with the help of user testing.

Since the application may contain important instructions outside of the field of view, a visual signal has been added to direct the user's attention.

Presented at Bayern Design Exhibition 2019 (München)