You can find more details about the models for classification, volume estimation, and segmentation here
You can find the server-side here
A web application for food nutrition analysis based on images. Built with React and uses React Bootstrap for styling. The application interacts with a server to fetch image data and nutrition labels.
This application has been deployed to Vercel. The server-side has also been deployed. But to fully use this application one will need to contact me to activate the containers in GCP (they're deactivated from running idly).
The application has three main screens:
In the home screen, users can upload an image of the food they want to analyze. Once the image is uploaded, the app will send the image to the server for processing.
Once the processing is done, users will be navigated to the SegmentsAndLabel screen. In this screen, the processed image will be displayed. The image will be segmented and each segment will be associated with a label indicating the food item in that segment. The users can navigate through different segmented images, delete any incorrect segmentation, and edit the labels if necessary.
Finally, once all segments are verified, the application will navigate to the DisplayResults screen where the total nutrition information is displayed. The result includes the sum of Calories, Fat, Cholesterol, Sodium, Carbohydrates, Sugars, and Protein for all segments in the image.