Visual MPC implementation running on Rethink Sawyer Robot
Clone or download
Latest commit 357ba4d Sep 22, 2017
Failed to load latest commit information.
experiments sc Sep 22, 2017
mjc_models mpc without net running errorfree Aug 17, 2017
pushing_data added READMEs fixed small bugs Sep 19, 2017
python_visual_mpc Merge branch 'master' of Sep 22, 2017
tensorflow_data sc Aug 22, 2017
.catkin_workspace finised bar graphs Jul 4, 2017
.gitignore Revert "merge after prediction disable input output" Jul 22, 2017 added READMEs fixed small bugs Sep 19, 2017 added all Oct 10, 2016
installation added READMEs fixed small bugs Sep 19, 2017
installation~ correct data collection setup 10000 Feb 10, 2017
req.txt running experiments Jun 26, 2017

Information for Simulation Setup:

1st. Step: generate training data:

cd /python_visual_mpc/visual_mpc_core/infrastructure/utility python <name_of_datafolder>

Note: <name_of_datafolder> is the folder-name inside lsdc/pushing_data Each of the folders in pushing_data must have a "/train" and "/test" subdirectory. The file to specifies how the data-collection is done.

2nd. Step: Train video prediction Model:

See in python_visual_mpc/video_prediction

3rd Step: Run a benchmark on the pushing task:

cd /python_visual_mpc/visual_mpc_core

python <benchmark_folder_name>


In order to run rendering remotely on a different machine it is necessary to give remote users access to the x server: Log into graphical session on remote computer and give access by typing: xhost +

Also set the DISPLAY variable export DISPLAY=:0

Setup for using Rethink Sawyer:

start kinect-bridge node:

cd visual_mpc/python_visual_mpc/sawyer/visual_mpc_rospkg/launch/bridgeonly.launch ./

start PD-Controller:

rosrun visual_mpc_rospkg

start visual-mpc-client:

rosrun visual_mpc_rospkg <name_of_folder_inside:visual_mpc/experiments/cem_exp/benchmarks_sawyer>

start visual-mpc-server (can be launched on newton4 or newton1):

rosrun visual_mpc_rospkg <name_of_folder_inside:visual_mpc/experiments/cem_exp/benchmarks_sawyer> --ngpu <number_of_gpus>