Skip to content

Generation of top view map form front camera view using Generative Adversial Networks.

Notifications You must be signed in to change notification settings

VictorEscribano/IPM_GAN

Repository files navigation

IPM_GAN

Generation of top view map (Inverse Perspecive Mapping) from front camera view using Generative Adversial Networks. video_results

Dataset extration

The raw images from front view of the car have been extracted from the Kitty Dataset. In order to obtain the corresponding Homography top view transformation from the image a self developed calibration tool has been implemented in order to extract the homography matrix. To execute the calibration run:

python calibrator.py

This tool consist of 2 main windows:

  1. The source image window
  2. The template target image window

To complete the calibration you have to select 4 points on the source image and the corresponding 4 top viwe points from the target image. Finally make a 9th click on the target window and the homography matrix will be computed and a sample generated image will appear. In caso of missclick, click the right mouse buton to erease the last selection.

Look at the following tutorial video if you have some doubts:

calibration_tutorial.mp4

(YT video can be found on: https://img.youtube.com/vi/FLBrwnHSxnk/0.jpg.)

Before obtaining the target images of the dataset the raw images need to be filtered, for that consecutive frame images are removed to avoid repeated images on the dataset. To filter the images run:

python rmv_repeated.py

Now that the raw images are filtered and the calibration matrix is obtained we can complete the dataset by computing the corresponding target images running:

python obtain_targets.py

Train the model

Now that the dataset is selected it can be called from the colab notebook. generator_loss_plot discriminator_loss_plot

discriminator_accuracies

Results

test_5 test_4 test_7 test_9 test_0 test_1 test_2

About

Generation of top view map form front camera view using Generative Adversial Networks.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published