A complete documentation and presentation of this project can be found in the doc
folder.
The idea of project "Perry" is to reduce food waste by suggesting recipes on the basis of food pictures. The user can take pictures of all available ingredients (or ingredients which are about to expire) upload them and get recipe suggestions based on dietary preferences. The project also includes a how-to bot which offers information on different ingredients and their ways of preparation and storage.
This application uses webscrapers to provide data for the chatbot (QnA-Maker) and to store recipes in the database. Azure Functions are used as an API for communication between the web application and the features. The backend was implemented in .NET Core 3, since Azure Functions do not yet support .NET 5 and otherwise there would have been compatibility problems between the different versions.
First the user needs to upload images of their ingredients. All identified ingredients are listed and the user can choose which should be included in the recipe. In case no images are availabe, there is also an overview to select the ingredients from.
In the next step, the user can state preferences regarding the food stil, dietary preferences, and the difficulty of the recipe.
The suggestions show the title and a short description of the recipe and is directly linked to the original recipe.
The chatbot uses scraped information of a recipe website in addition to a basic knowledge database with ChitChat function provided by the Microsoft QnA-Maker