VQA-CV Final Project

Table of Contents

• VQA-CV Final Project
  • Table of Contents
• About the Project:
  • Problem : Visual Question Answering for the Medical Images
  • Setup:
    • Download
    • Important Links
  • Pre Processing
  • Model Description
  • Training and Testing

About the Project:

Problem : Visual Question Answering for the Medical Images

• Data
• Stacked Attention Network
• Slides for Stacked Attention Network

Setup:

Download

    1. trainset.json
    2. testset.json
    3. VQA Image Folder
    4. Cache Folder 

Upload these to your google drive, and then follow the instructions that are present in the radiology_vqa_notebook.ipynb.

Important Links

• Google Colab: radiology_vqa_notebook.ipynb

• Google News Vector

• Demo Video 1

• Demo Video 2

Pre Processing

All the pre-processing steps are highlighted in the following PDF:

• Pre Processing.pdf

Model Description

Training and Testing

Preparing the train test split and model

Accuracy on the test set

Accuracy vs Epoch Plot