5toryline is an exploration into human-machine relationships. With the rapid development of artificial intelligence and machine learning, we have never been closer to being able to co-create with the machines around us. 5toryline explores human-machine creativity by creating a platform in which you can collaboratively generate stories with your machine.
You can find more information about this project here. (add CIID link)
How it Works
When the openFrameworks app is opened you will see a large set of images laid out. With your mouse, click and drag through the images according to the story you want to make. Once you have selected your images you must wait while your machine creates the story for you.
How to Run It
Follow the instructions included in NeuralTalk2 and Char-RNN to install all the necessary dependencies.
Go to the
/story-creator directory and run the command
python storycreator.py from terminal.
The models used for this project were created by Ross Goodwin and can be found at NeuralSnap. Follow his instructions on how to download his models and place the files in the included models folder.
Download the dataset of images at https://drive.google.com/drive/folders/0BwJRQX2ryWZ_bGpnVmZiZFkyUTg?usp=sharing
Place the images in
Move the entirety of the openFrameworks folder to your desired openFrameworks app destination, then use the project generator to update the project.
You will need to install some dependencies including: ofxBox2d, ofxGui, ofxJSON, ofxKDTree, ofxOsc
If you want to use your own dataset to generate stories — the json file is generated using Gene Kogan's ofxTSNE app. Using this app you can upload your own images and output a json file. Replace the json file
dataset500.json found in
bin/data with your newly created on. Also in the openFrameworks code find line 24,
string inputFile = "dataset500.json"; and replace
dataset500.json with your file.
The models included in this repository are also courtesy of Ross Goodwin.