Uploading the files for a video cation generator based on cooking

[nehavish006]

Related Issue

• Info about the related issue

• GSSOC Participant

• Contributor

Closes: #6

Describe the changes you've made

It is Deep learning based Video caption generator especially for cooking videos. The algorithms used here are CNN-RNN model where LSTM(encoder-decoder) is used to predict the captions. Also a Nutrition API is included to get the nutritional information of the ingredients used.

Type of change

What sort of change have you made:
This project is done with specialization on cooking videos by taking only the videos based on cooking of the 1400 plus videos and trained to find the ingredients used, what the person is doing.

Steps Done

Feature Extraction
Preprocessing of Captions
LSTM for sequence generation
Model Building
Generating Caption using Greedy search

Libraries Used

opencv
pillow
keras
fpdf
py_edamam
joblif
anaconda

• Bug fix (non-breaking change which fixes an issue)
• New feature (non-breaking change which adds functionality)
• Code style update (formatting, local variables)
• Breaking change (fix or feature that would cause existing functionality to not work as expected)
• This change requires a documentation update

How Has This Been Tested?

Different algorithms has been tested over the training dataset and validated the prediction over the testing dataset. The most accurate algorithms among CNN,-RNN model with Greedy search for prediction instead of beam search as it has slow processing time. This gives an accuracy of 0.87 as BLEU score.

Checklist:

• My code follows the guidelines of this project.
• I have performed a self-review of my own code.
• I have commented my code, particularly wherever it was hard to understand.
• I have made corresponding changes to the documentation.
• My changes generate no new warnings.
• I have added tests that prove my fix is effective or that my feature works.
• Any dependent changes have been merged and published in downstream modules.

Screenshots

Updated Screenshot

README file is added