Image Transformer

Introduction

This TensorFlow implementation is designed with these goals:

• Image Transformer Tensorflow implementatin of Image Transformer
• Implementing New Ideas.
  • Local Sliding Self-Attension
  • Apply Universal Transformers concept

How to Use

• cifar10

python3 bin/train_estimator_cifar10.py --model-dir models/test

Prerequisite

Should install below libraries.

• Tensorflow >= 1.11
• opencv >= 3.0

And install below dependencies.

apt install -y libsm6 libxext-dev libxrender-dev libcap-dev
pip install -r requirements.txt