Permalink
Browse files

[Automated tests] Removed redundant tests.cfg and associated document…

…ation
  • Loading branch information...
1 parent 55ae4f1 commit d7faf9ce14ccc4837a794241c680fb55db6fc35b George Kurian committed Nov 25, 2012
@@ -1,16 +0,0 @@
-[apps]
-
-tests/apps/cannon/cannon -m 4 -s 4
-
-[/apps]
-
-[pintool]
-
-[general]
-total_cores = 5
-num_processes = [1:3:+1]
-
-[perf_model/l2_cache]
-data_access_time = 2
-
-[/pintool]
@@ -1,3 +0,0 @@
-./tools/carbon_sim_spawner.py 1 /afs/csail/group/carbon/tools/pin/current/ia32/bin/pinbin -mt -t ./lib/pin_sim -c carbon_sim.cfg --general/total_cores=5 --perf_model/l2_cache/data_access_time=2 --general/num_processes=1 -- ./tests/apps/cannon/cannon -m 4 -s 4
-./tools/carbon_sim_spawner.py 2 /afs/csail/group/carbon/tools/pin/current/ia32/bin/pinbin -mt -t ./lib/pin_sim -c carbon_sim.cfg --general/total_cores=5 --perf_model/l2_cache/data_access_time=2 --general/num_processes=2 -- ./tests/apps/cannon/cannon -m 4 -s 4
-./tools/carbon_sim_spawner.py 3 /afs/csail/group/carbon/tools/pin/current/ia32/bin/pinbin -mt -t ./lib/pin_sim -c carbon_sim.cfg --general/total_cores=5 --perf_model/l2_cache/data_access_time=2 --general/num_processes=3 -- ./tests/apps/cannon/cannon -m 4 -s 4
@@ -1,17 +0,0 @@
-[apps]
-
-tests/apps/cannon/cannon -m 4 -s 4
-tests/apps/1d_jacobi/jacobi 4 16
-
-[/apps]
-
-[pintool]
-
-[general]
-total_cores = 5
-num_processes = [1:3:+1]
-
-[perf_model/l2_cache]
-data_access_time = 2
-
-[/pintool]
@@ -1,6 +0,0 @@
-./tools/carbon_sim_spawner.py 1 /afs/csail/group/carbon/tools/pin/current/ia32/bin/pinbin -mt -t ./lib/pin_sim -c carbon_sim.cfg --general/total_cores=5 --perf_model/l2_cache/data_access_time=2 --general/num_processes=1 -- ./tests/apps/cannon/cannon -m 4 -s 4
-./tools/carbon_sim_spawner.py 1 /afs/csail/group/carbon/tools/pin/current/ia32/bin/pinbin -mt -t ./lib/pin_sim -c carbon_sim.cfg --general/total_cores=5 --perf_model/l2_cache/data_access_time=2 --general/num_processes=1 -- ./tests/apps/1d_jacobi/jacobi 4 16
-./tools/carbon_sim_spawner.py 2 /afs/csail/group/carbon/tools/pin/current/ia32/bin/pinbin -mt -t ./lib/pin_sim -c carbon_sim.cfg --general/total_cores=5 --perf_model/l2_cache/data_access_time=2 --general/num_processes=2 -- ./tests/apps/cannon/cannon -m 4 -s 4
-./tools/carbon_sim_spawner.py 2 /afs/csail/group/carbon/tools/pin/current/ia32/bin/pinbin -mt -t ./lib/pin_sim -c carbon_sim.cfg --general/total_cores=5 --perf_model/l2_cache/data_access_time=2 --general/num_processes=2 -- ./tests/apps/1d_jacobi/jacobi 4 16
-./tools/carbon_sim_spawner.py 3 /afs/csail/group/carbon/tools/pin/current/ia32/bin/pinbin -mt -t ./lib/pin_sim -c carbon_sim.cfg --general/total_cores=5 --perf_model/l2_cache/data_access_time=2 --general/num_processes=3 -- ./tests/apps/cannon/cannon -m 4 -s 4
-./tools/carbon_sim_spawner.py 3 /afs/csail/group/carbon/tools/pin/current/ia32/bin/pinbin -mt -t ./lib/pin_sim -c carbon_sim.cfg --general/total_cores=5 --perf_model/l2_cache/data_access_time=2 --general/num_processes=3 -- ./tests/apps/1d_jacobi/jacobi 4 16
@@ -1,16 +0,0 @@
-[apps]
-
-tests/apps/cannon/cannon -m [4:8:+2] -s 4
-
-[/apps]
-
-[pintool]
-
-[general]
-total_cores = 5
-num_processes = [1:3:+1]
-
-[perf_model/l2_cache]
-data_access_time = 2
-
-[/pintool]
@@ -1,9 +0,0 @@
-./tools/carbon_sim_spawner.py 1 /afs/csail/group/carbon/tools/pin/current/ia32/bin/pinbin -mt -t ./lib/pin_sim -c carbon_sim.cfg --general/total_cores=5 --perf_model/l2_cache/data_access_time=2 --general/num_processes=1 -- ./tests/apps/cannon/cannon -m 4 -s 4
-./tools/carbon_sim_spawner.py 1 /afs/csail/group/carbon/tools/pin/current/ia32/bin/pinbin -mt -t ./lib/pin_sim -c carbon_sim.cfg --general/total_cores=5 --perf_model/l2_cache/data_access_time=2 --general/num_processes=1 -- ./tests/apps/cannon/cannon -m 6 -s 4
-./tools/carbon_sim_spawner.py 1 /afs/csail/group/carbon/tools/pin/current/ia32/bin/pinbin -mt -t ./lib/pin_sim -c carbon_sim.cfg --general/total_cores=5 --perf_model/l2_cache/data_access_time=2 --general/num_processes=1 -- ./tests/apps/cannon/cannon -m 8 -s 4
-./tools/carbon_sim_spawner.py 2 /afs/csail/group/carbon/tools/pin/current/ia32/bin/pinbin -mt -t ./lib/pin_sim -c carbon_sim.cfg --general/total_cores=5 --perf_model/l2_cache/data_access_time=2 --general/num_processes=2 -- ./tests/apps/cannon/cannon -m 4 -s 4
-./tools/carbon_sim_spawner.py 2 /afs/csail/group/carbon/tools/pin/current/ia32/bin/pinbin -mt -t ./lib/pin_sim -c carbon_sim.cfg --general/total_cores=5 --perf_model/l2_cache/data_access_time=2 --general/num_processes=2 -- ./tests/apps/cannon/cannon -m 6 -s 4
-./tools/carbon_sim_spawner.py 2 /afs/csail/group/carbon/tools/pin/current/ia32/bin/pinbin -mt -t ./lib/pin_sim -c carbon_sim.cfg --general/total_cores=5 --perf_model/l2_cache/data_access_time=2 --general/num_processes=2 -- ./tests/apps/cannon/cannon -m 8 -s 4
-./tools/carbon_sim_spawner.py 3 /afs/csail/group/carbon/tools/pin/current/ia32/bin/pinbin -mt -t ./lib/pin_sim -c carbon_sim.cfg --general/total_cores=5 --perf_model/l2_cache/data_access_time=2 --general/num_processes=3 -- ./tests/apps/cannon/cannon -m 4 -s 4
-./tools/carbon_sim_spawner.py 3 /afs/csail/group/carbon/tools/pin/current/ia32/bin/pinbin -mt -t ./lib/pin_sim -c carbon_sim.cfg --general/total_cores=5 --perf_model/l2_cache/data_access_time=2 --general/num_processes=3 -- ./tests/apps/cannon/cannon -m 6 -s 4
-./tools/carbon_sim_spawner.py 3 /afs/csail/group/carbon/tools/pin/current/ia32/bin/pinbin -mt -t ./lib/pin_sim -c carbon_sim.cfg --general/total_cores=5 --perf_model/l2_cache/data_access_time=2 --general/num_processes=3 -- ./tests/apps/cannon/cannon -m 8 -s 4
@@ -1,16 +0,0 @@
-[apps]
-
-tests/apps/cannon/cannon -m 4 -s [$ 4,5,6]
-
-[/apps]
-
-[pintool]
-
-[general]
-total_cores = [5,6,7]
-num_processes = [1:3:+1]
-
-[perf_model/l2_cache]
-data_access_time = 2
-
-[/pintool]
@@ -1,9 +0,0 @@
-./tools/carbon_sim_spawner.py 1 /afs/csail/group/carbon/tools/pin/current/ia32/bin/pinbin -mt -t ./lib/pin_sim -c carbon_sim.cfg --perf_model/l2_cache/data_access_time=2 --general/total_cores=5 --general/num_processes=1 -- ./tests/apps/cannon/cannon -m 4 -s 4
-./tools/carbon_sim_spawner.py 2 /afs/csail/group/carbon/tools/pin/current/ia32/bin/pinbin -mt -t ./lib/pin_sim -c carbon_sim.cfg --perf_model/l2_cache/data_access_time=2 --general/total_cores=5 --general/num_processes=2 -- ./tests/apps/cannon/cannon -m 4 -s 4
-./tools/carbon_sim_spawner.py 3 /afs/csail/group/carbon/tools/pin/current/ia32/bin/pinbin -mt -t ./lib/pin_sim -c carbon_sim.cfg --perf_model/l2_cache/data_access_time=2 --general/total_cores=5 --general/num_processes=3 -- ./tests/apps/cannon/cannon -m 4 -s 4
-./tools/carbon_sim_spawner.py 1 /afs/csail/group/carbon/tools/pin/current/ia32/bin/pinbin -mt -t ./lib/pin_sim -c carbon_sim.cfg --perf_model/l2_cache/data_access_time=2 --general/total_cores=6 --general/num_processes=1 -- ./tests/apps/cannon/cannon -m 4 -s 5
-./tools/carbon_sim_spawner.py 2 /afs/csail/group/carbon/tools/pin/current/ia32/bin/pinbin -mt -t ./lib/pin_sim -c carbon_sim.cfg --perf_model/l2_cache/data_access_time=2 --general/total_cores=6 --general/num_processes=2 -- ./tests/apps/cannon/cannon -m 4 -s 5
-./tools/carbon_sim_spawner.py 3 /afs/csail/group/carbon/tools/pin/current/ia32/bin/pinbin -mt -t ./lib/pin_sim -c carbon_sim.cfg --perf_model/l2_cache/data_access_time=2 --general/total_cores=6 --general/num_processes=3 -- ./tests/apps/cannon/cannon -m 4 -s 5
-./tools/carbon_sim_spawner.py 1 /afs/csail/group/carbon/tools/pin/current/ia32/bin/pinbin -mt -t ./lib/pin_sim -c carbon_sim.cfg --perf_model/l2_cache/data_access_time=2 --general/total_cores=7 --general/num_processes=1 -- ./tests/apps/cannon/cannon -m 4 -s 6
-./tools/carbon_sim_spawner.py 2 /afs/csail/group/carbon/tools/pin/current/ia32/bin/pinbin -mt -t ./lib/pin_sim -c carbon_sim.cfg --perf_model/l2_cache/data_access_time=2 --general/total_cores=7 --general/num_processes=2 -- ./tests/apps/cannon/cannon -m 4 -s 6
-./tools/carbon_sim_spawner.py 3 /afs/csail/group/carbon/tools/pin/current/ia32/bin/pinbin -mt -t ./lib/pin_sim -c carbon_sim.cfg --perf_model/l2_cache/data_access_time=2 --general/total_cores=7 --general/num_processes=3 -- ./tests/apps/cannon/cannon -m 4 -s 6
@@ -1,17 +0,0 @@
-[apps]
-
-tests/apps/cannon/cannon -m 4 -s [$ 4,5,6]
-tests/apps/1d_jacobi/jacobi [$ 4,5,6] 16
-
-[/apps]
-
-[pintool]
-
-[general]
-total_cores = [5,6,7]
-num_processes = 1
-
-[perf_model/l2_cache]
-data_access_time = 2
-
-[/pintool]
@@ -1,6 +0,0 @@
-./tools/carbon_sim_spawner.py 1 /afs/csail/group/carbon/tools/pin/current/ia32/bin/pinbin -mt -t ./lib/pin_sim -c carbon_sim.cfg --general/num_processes=1 --perf_model/l2_cache/data_access_time=2 --general/total_cores=5 -- ./tests/apps/cannon/cannon -m 4 -s 4
-./tools/carbon_sim_spawner.py 1 /afs/csail/group/carbon/tools/pin/current/ia32/bin/pinbin -mt -t ./lib/pin_sim -c carbon_sim.cfg --general/num_processes=1 --perf_model/l2_cache/data_access_time=2 --general/total_cores=5 -- ./tests/apps/1d_jacobi/jacobi 4 16
-./tools/carbon_sim_spawner.py 1 /afs/csail/group/carbon/tools/pin/current/ia32/bin/pinbin -mt -t ./lib/pin_sim -c carbon_sim.cfg --general/num_processes=1 --perf_model/l2_cache/data_access_time=2 --general/total_cores=6 -- ./tests/apps/cannon/cannon -m 4 -s 5
-./tools/carbon_sim_spawner.py 1 /afs/csail/group/carbon/tools/pin/current/ia32/bin/pinbin -mt -t ./lib/pin_sim -c carbon_sim.cfg --general/num_processes=1 --perf_model/l2_cache/data_access_time=2 --general/total_cores=6 -- ./tests/apps/1d_jacobi/jacobi 5 16
-./tools/carbon_sim_spawner.py 1 /afs/csail/group/carbon/tools/pin/current/ia32/bin/pinbin -mt -t ./lib/pin_sim -c carbon_sim.cfg --general/num_processes=1 --perf_model/l2_cache/data_access_time=2 --general/total_cores=7 -- ./tests/apps/cannon/cannon -m 4 -s 6
-./tools/carbon_sim_spawner.py 1 /afs/csail/group/carbon/tools/pin/current/ia32/bin/pinbin -mt -t ./lib/pin_sim -c carbon_sim.cfg --general/num_processes=1 --perf_model/l2_cache/data_access_time=2 --general/total_cores=7 -- ./tests/apps/1d_jacobi/jacobi 6 16
@@ -1,17 +0,0 @@
-[apps]
-
-tests/apps/cannon/cannon -m 4 -s [$ 4,5,6]
-tests/apps/1d_jacobi/jacobi 4 [16:64:*2]
-
-[/apps]
-
-[pintool]
-
-[general]
-total_cores = [5,6,7]
-num_processes = 1
-
-[perf_model/l2_cache]
-data_access_time = 2
-
-[/pintool]
@@ -1,12 +0,0 @@
-./tools/carbon_sim_spawner.py 1 /afs/csail/group/carbon/tools/pin/current/ia32/bin/pinbin -mt -t ./lib/pin_sim -c carbon_sim.cfg --general/num_processes=1 --perf_model/l2_cache/data_access_time=2 --general/total_cores=5 -- ./tests/apps/cannon/cannon -m 4 -s 4
-./tools/carbon_sim_spawner.py 1 /afs/csail/group/carbon/tools/pin/current/ia32/bin/pinbin -mt -t ./lib/pin_sim -c carbon_sim.cfg --general/num_processes=1 --perf_model/l2_cache/data_access_time=2 --general/total_cores=5 -- ./tests/apps/1d_jacobi/jacobi 4 16
-./tools/carbon_sim_spawner.py 1 /afs/csail/group/carbon/tools/pin/current/ia32/bin/pinbin -mt -t ./lib/pin_sim -c carbon_sim.cfg --general/num_processes=1 --perf_model/l2_cache/data_access_time=2 --general/total_cores=5 -- ./tests/apps/1d_jacobi/jacobi 4 32
-./tools/carbon_sim_spawner.py 1 /afs/csail/group/carbon/tools/pin/current/ia32/bin/pinbin -mt -t ./lib/pin_sim -c carbon_sim.cfg --general/num_processes=1 --perf_model/l2_cache/data_access_time=2 --general/total_cores=5 -- ./tests/apps/1d_jacobi/jacobi 4 64
-./tools/carbon_sim_spawner.py 1 /afs/csail/group/carbon/tools/pin/current/ia32/bin/pinbin -mt -t ./lib/pin_sim -c carbon_sim.cfg --general/num_processes=1 --perf_model/l2_cache/data_access_time=2 --general/total_cores=6 -- ./tests/apps/cannon/cannon -m 4 -s 5
-./tools/carbon_sim_spawner.py 1 /afs/csail/group/carbon/tools/pin/current/ia32/bin/pinbin -mt -t ./lib/pin_sim -c carbon_sim.cfg --general/num_processes=1 --perf_model/l2_cache/data_access_time=2 --general/total_cores=6 -- ./tests/apps/1d_jacobi/jacobi 4 16
-./tools/carbon_sim_spawner.py 1 /afs/csail/group/carbon/tools/pin/current/ia32/bin/pinbin -mt -t ./lib/pin_sim -c carbon_sim.cfg --general/num_processes=1 --perf_model/l2_cache/data_access_time=2 --general/total_cores=6 -- ./tests/apps/1d_jacobi/jacobi 4 32
-./tools/carbon_sim_spawner.py 1 /afs/csail/group/carbon/tools/pin/current/ia32/bin/pinbin -mt -t ./lib/pin_sim -c carbon_sim.cfg --general/num_processes=1 --perf_model/l2_cache/data_access_time=2 --general/total_cores=6 -- ./tests/apps/1d_jacobi/jacobi 4 64
-./tools/carbon_sim_spawner.py 1 /afs/csail/group/carbon/tools/pin/current/ia32/bin/pinbin -mt -t ./lib/pin_sim -c carbon_sim.cfg --general/num_processes=1 --perf_model/l2_cache/data_access_time=2 --general/total_cores=7 -- ./tests/apps/cannon/cannon -m 4 -s 6
-./tools/carbon_sim_spawner.py 1 /afs/csail/group/carbon/tools/pin/current/ia32/bin/pinbin -mt -t ./lib/pin_sim -c carbon_sim.cfg --general/num_processes=1 --perf_model/l2_cache/data_access_time=2 --general/total_cores=7 -- ./tests/apps/1d_jacobi/jacobi 4 16
-./tools/carbon_sim_spawner.py 1 /afs/csail/group/carbon/tools/pin/current/ia32/bin/pinbin -mt -t ./lib/pin_sim -c carbon_sim.cfg --general/num_processes=1 --perf_model/l2_cache/data_access_time=2 --general/total_cores=7 -- ./tests/apps/1d_jacobi/jacobi 4 32
-./tools/carbon_sim_spawner.py 1 /afs/csail/group/carbon/tools/pin/current/ia32/bin/pinbin -mt -t ./lib/pin_sim -c carbon_sim.cfg --general/num_processes=1 --perf_model/l2_cache/data_access_time=2 --general/total_cores=7 -- ./tests/apps/1d_jacobi/jacobi 4 64
View
@@ -1,43 +0,0 @@
-This document explains how to use 'tools/run_tests.py' to automatically run tests and gather results
-
-Running the script
-------------------
-
-Command:
-./tools/run_tests.py [--dry-run] [-f config_file] [-n num_runs]
-./tools/run_tests.py -h
-
-Remarks:
-config_file : Name of the configuration file used to run the tests (Defaults to 'tests.cfg')
-num_runs: Number of times the experiment is run using the same config file (Defaults to '1')
--dryrun : Only prints out the commands that will be run for the given 'config_file' and does not actually run any of the commands. This can be used to check if the 'config_file' works as intended
--h : Prints out a help message and exits
-
-Writing the Configuration File
-------------------------------
-
-Each 'config_file' has an 'apps' section and a 'pintool' section. The 'apps' section specifies the applications to be run. The 'pintool' section specifies the parameters to the pintool.
-
-Each parameter in the config_file can be varied in 3 ways
-1) [v_1, v_2, ..., v_n] :- This is a list whose values are separated by commas.
-2) [a : b : +c] :- This boils down to a list whose values are [a, a+c, a+2c, a+3c, ...]
-3) [a : b : *c] :- This boils down to a list whose values are [a, a*c, a*(c^2), a*(c^3), ...]
-Both 2) and 3) above include 'b' if possible
-For example,
-[1:5:+2] -> [1,3,5]
-[3:100:*3] -> [3,9,27,81]
-
-Examples of configurations files are given in the directory 'docs/tools/example_test_config_files'. The commands that are executed when each configuration is used is also present in this directory. Please have a look at them before you run any tests. Also, keep in mind that the commands that are executed when a particular configuration file is used can be obtained using the '-dryrun' option.
-When a particular configuration file is used, commands that cover all permutations of the parameters that are varied are run. This is not desirable in one particular scenario, namely, when one of the application arguments corresponds to the number of threads used. Usually, it does not make sense to vary the number of threads in an application independent of the number of cores simulated (i.e, the parameter 'general/total_cores' in the 'pintool' section of the configuration file). In other words, the number of threads in an application is usually varied in accordance to the number of cores simulated. This can be accomplished using the '$' sign before the start of a parameter list in the 'apps' section. See the example configuration files for illustrations of how to use the '$' sign. Note that only one parameter in a particular line of the 'apps' section can be varied using the '$' sign. If multiple '$' signs are used in a particular line of the 'apps' section, only the last parameter that is varied using the '$' sign is varied in proportion to the number of cores. Also, the '$' sign cannot be used in the 'pintool' section of the configuration file. Note that the size of the parameter list having the '$' sign must be equal to the size of the parameter list corresponding to 'general/total_cores'.
-
-Viewing the Output
-------------------
-
-The outputs of each experiment are put in a sub-directory under the directory named 'results'. This subdirectory is named using the time at which the experiment was started. Inside each experiment subdirectory are present subdirectories corresponding to each run of the experiment. These subdirectories are named using the parameters used for the run as well as the run number. In these sub-directories are stored simulator outputs as well as standard outputs.
-
-Current Limitations
--------------------
-
-1) Currently, 'comments' in the configuration file are not supported - This feature is currently being added
-2) The example configuration files should not be used to run tests. They are just provided as examples to illustrate the features of the automatic test script
-3) 'run_tests.py' must always be run from the simulator root directory, i.e, as './tools/run_tests.py' - A workaround for this would be to use an environment variable like '$GRAPHITE_HOME' to specify the simulator root directory and is currently being added
View
@@ -1,19 +0,0 @@
-[apps]
-
-water-spatial_bench_test \< ./tests/benchmarks/water-spatial/input
-
-[/apps]
-
-[pintool]
-
-[general]
-total_cores = 32
-num_processes = 4
-
-[/pintool]
-
-[plot]
-
-Instructions [Core 0, Core *]
-
-[/plot]

0 comments on commit d7faf9c

Please sign in to comment.