CSS Python Processing Ruby Shell
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
images
README.md
dataframe_2012-05.pickle
ex.html
ex.pde
foveal_explorer.jpg
foveal_explorer.py
process_dataset.py
processing.min.js
screen.css
upload_to_s3.sh
where_people_look.txt
where_people_look_small.txt

README.md

Foveal Explorer

See a short blog post for more info.

NOTE: this code was used in an abandoned research project, and is released only to demonstrate the Foveal Explorer JavaScript applet, and host the gathered AMT fixation data, without any support.


Viewing the task page locally.

python -m SimpleHTTPServer
open http://0.0.0.0:8000

Loading data gathered on AMT

Before abandoning the project, I gathered 10K HITs (human intelligence tasks) on Amazon Mechanical Turk, equally distributed between three tasks (describe scene, count people, find all text), on the MIT Attention dataset.

In [1]: import pandas

In [2]: df = pandas.read_pickle('dataframe_2012-05.pickle')

In [3]: df.head()
Out[3]:
        worker_id                                           img img_height  \
0  A2J2P9JE374XCM       istatic_hotel_room_indoor_IMG_0999.jpeg        818
1  A323WW03VM8089       istatic_hotel_room_indoor_IMG_0999.jpeg        818
2   AP5CXT3G9EIBH       istatic_hotel_room_indoor_IMG_0999.jpeg        818
3  A2WZJC3N97GJ9Z  i05june05_static_street_boston_p1010764.jpeg        614
4  A1E3WL1MAZS6KC  i05june05_static_street_boston_p1010800.jpeg        614

  img_width          task                                       user_content  \
0       614      describe                                           a toilet
1       614  count_people                                                  0
2       614  count_people                                                  0
3       819      describe  A large number of cars are parked on the left ...
4       819          text                                               none

  comment                                            history
0          [{u'y': 408, u'x': 305, u'frameCount': 94, u't...
1          [{u'y': 415, u'x': 306, u'frameCount': 42, u't...
2          [{u'y': 411, u'x': 314, u'frameCount': 59, u't...
3          [{u'y': 308, u'x': 409, u'frameCount': 59, u't...
4          [{u'y': 309, u'x': 409, u'frameCount': 33, u't...

[5 rows x 8 columns]

Dataset

We use the Where humans look dataset.

Creating blurred images

find ^*blur*.jpeg -exec convert -gaussian-blur 0x1.414 {} {}_blur2.jpeg \;
find *blur2.jpeg -exec convert -gaussian-blur 0x1.414 {} {}_blur4.jpeg \;
find *blur4.jpeg -exec convert -gaussian-blur 0x1.414 {} {}_blur8.jpeg \;