Skip to content


Switch branches/tags

Name already in use

A tag already exists with the provided branch name. Many Git commands accept both tag and branch names, so creating this branch may cause unexpected behavior. Are you sure you want to create this branch?

Latest commit


Git stats


Failed to load latest commit information.
Latest commit message
Commit time


This repository is about the project during DEEP LEARNING CAMP JEJU ( 2018. 7. 1 ~ 30 )

Motivation of Project

Jeju Island POI(point-of-interst) Dataset

Sometime it really hard to find proper place to go.

What if, the Model can understand where do i want to go and understand location of the place in the map ?

The Model will be able to recommend a suitable place according to the Location you are currently in and Keyword you want to go.

Model Architecture

We using Relation Networks basically contains CNN for Image processing, and RN for Relational reasoning between two object(Image, Text).

And also using Wild Relation Network for improve the recommendation accuracy.


The data contains the following information

  • User Location
  • Image Location (Center, Boundary)
  • Place Information (type [Restaurant, Cafe, ...], Location [Latitude, Longitude])

At the beginning of the project, I decided to only consider the POI for restaurant and cafe in Jeju Island. Each Image has a number of POIs which marked with red(restaurant), green(cafe) marker.

Also, the center(user position) location of the image, boundary location information and the location information of restaurant and cafe in Jeju Island are required for input.

Among the various Keyword, I will focus on the following Keyword first.

  • Restaurant ?
  • Cafe ?
  • Beachfront ?
  • Near ?
  • Cafe nearby restaurant ?
  • Restaurant nearby cafe ?

The possible Answer is a softmax vector whose with probability for POIs

[probability of POI 1, probability of POI 2, probability of POI 3,...,probability of POI n]


2 - Class Dataset

At the begining of the Project, to make sure the Relation Network working well for our Project we tried very simple problem that have only 2 class.

Result (Training)

Result (Testing)

RN model Baseline model
Accuracy 82% 74%

10 - Class Dataset

First task of the Project, we take only 10 places that located in the map and recommend the places to the user which are highly related with user's keyword.

Result (Training)

Result (Testing)

WReN model RN model Baseline model
Top - 1 Accuracy 33% 20% 0%
Top - 3 Accuracy 76% 70% 70%

Related works


This was supported by Deep Learning Camp Jeju 2018 which was organized by TensorFlow Korea User Group. Thank you to my mentor SOURABH BAJAJ who gave me the best mentoring and thank you everyone, that I met during the camp.


Sein Jang


© [Sein Jang], 2018. Licensed under the MIT License.


Location Aware Recommendation System using Relation Network







No releases published


No packages published