Skip to content
Derek Groen edited this page Nov 14, 2019 · 5 revisions

This is a quick reference page for those who work with FabFlee.

The main tutorial for FabFlee is here: https://github.com/djgroen/FabFlee/blob/master/doc/Tutorial.md

Doing a quick validation test

You can update your Flee code remotely (assuming you're using the machine "eagle_hidalgo") using:

fabsim eagle_hidalgo sync_flee

Next, you can perform a quick validation study using:

fabsim eagle_hidalgo validate_flee:mode=Parallel,cores=4

This will run for a while, and validate your code against UNHCR data from the Mali, CAR, Burundi and South Sudan conflicts.

FabSim3 will let you wait until execution completes. Upon completion, it will then return something like:

[derek@eagle.man.poznan.pl] Executing task 'validate_flee_output'
/home/derek/FabSim3/results/validation_eagle_hidalgo_4/RUNS/ssudan_ccamp
[localhost] local: python3 ~/flee/extract-validation-results.py /home/derek/FabSim3/results/validation_eagle_hidalgo_4/RUNS/ssudan_ccamp > /home/derek/FabSim3/results/validation_eagle_hidalgo_4/RUNS/ssudan_ccamp/validation_results.yml
Validation ssudan_ccamp: 0.5237744468966515
/home/derek/FabSim3/results/validation_eagle_hidalgo_4/RUNS/oldstyle_burundi
[localhost] local: python3 ~/flee/extract-validation-results.py /home/derek/FabSim3/results/validation_eagle_hidalgo_4/RUNS/oldstyle_burundi > /home/derek/FabSim3/results/validation_eagle_hidalgo_4/RUNS/oldstyle_burundi/validation_results.yml
Validation oldstyle_burundi: 0.25806589968830146
/home/derek/FabSim3/results/validation_eagle_hidalgo_4/RUNS/car
[localhost] local: python3 ~/flee/extract-validation-results.py /home/derek/FabSim3/results/validation_eagle_hidalgo_4/RUNS/car > /home/derek/FabSim3/results/validation_eagle_hidalgo_4/RUNS/car/validation_results.yml
Validation car: 0.25386184917946525
/home/derek/FabSim3/results/validation_eagle_hidalgo_4/RUNS/mali
[localhost] local: python3 ~/flee/extract-validation-results.py /home/derek/FabSim3/results/validation_eagle_hidalgo_4/RUNS/mali > /home/derek/FabSim3/results/validation_eagle_hidalgo_4/RUNS/mali/validation_results.yml
Validation mali: 0.4625701608931273
Mean score: 0.37456808916438644

Done.
Clone this wiki locally