Structure-Aware Network for Recipe Generation

Codes of SGN (PyTorch)

Structure-Aware Generation Network for Recipe Generation from Images
Hao Wang, Guosheng Lin, Steven C. H. Hoi, and Chunyan Miao
ECCV 2020

Requirements

• pytorch 1.2 or higher
• python 3.6 or higher

Dataset

The dataset is from Recipe1M.

We filter out some food items without any images from the original dataset. You may download the processed dataset train and test to the data folder.

Produce the Sentence-Level Tree Structures

Tokenize the recipes

cd hierarchical_on_lstm
python tokenize_sentence.py

Unsupervisedly train the model

python train.py

Output the parsing trees

python test_phrase_grammar.py

Pretrained Model

The pretrained Model is available at here.

Reference

This code is modified based on ON-LSTM. If you find this repo useful, please cite:

@inproceedings{wang2020structure,
  title={Structure-Aware Generation Network for Recipe Generation from Images},
  author={Wang, Hao and Lin, Guosheng and Hoi, Steven CH and Miao, Chunyan},
  booktitle={European Conference on Computer Vision},
  pages={359--374},
  year={2020},
  organization={Springer}
}