Graphfire is domain-specificy memory hierarchy approach for graph applications. We modified the MosaicSim simulator and have provided our implementation here. To run Graphfire, utilize the graphfire_inorder.txt and graphfire_sim.txt configuration files.
For further details on Graphfire, please refer to the paper.
Below are instructions on using MosaicSim:
Simulator for DECADES Project
This project was built with the following tools:
- GNU Make 4.1
cmake3.11.4ninja1.8.2clang/LLVM toolchain, 9.0.0+ (with C++14 support)libomp4.5 (e.g., to install it in CentOS type: sudo yum install llvm-toolset-7-libomp)
DECADES Compiler (DEC++): https://github.com/PrincetonUniversity/DECADES_compiler
To fetch submodules within MosaicSim repo (like DRAMSim2) do a submodule update:
git submodule update --init --recursive
No compatibility is guaranteed for older compilers/versions of these toolchains, mainly because LLVM is fairly backwards-incompatible.
Define the next set of variables:
DECADES_COMPILER_INSTALL_DIR=[COMPILER_DIRECTORY]
MOSAIC_INSTALL_DIR=[SIMULATOR_DIRECTORY]
OMP_SHARED_LIB=[PATH_TO_OPEN_MP_LIB]
Your Compiler path must be defined and $LD_LIBRARY_PATH must be updated to always find libomp.so. Add this lines to your ~/.bashrc: Add the following lines to your ~/.bashrc
export PATH=$DECADES_COMPILER_INSTALL_DIR/build/bin/:$MOSAIC_INSTALL_DIR/tools/:$PATH
export LD_LIBRARY_PATH=$OMP_SHARED_LIB:$LD_LIBRARY_PATH
(For CentOS, OMP_SHARED_LIB would typically be /opt/rh/llvm-toolset-7/root/usr/lib64/)
Finally, to remove restrictions due to running with limited resources, add the following line to your bashrc:
export MOSAIC_EXPERT=true
Source your bashrc to enable the change:
source ~/.bashrc
To compile the LLVM pass and other libraries, navigate to the root directory of the project. To compile the files, simply run
make
to generate compilation files in the build directory. Then, a simple run of
ninja -C build
in the root directory will compile the files.
Workloads must be specially compiled through some LLVM passes, to generate a Data Dependency Graph (DDG) for the simulator and run on the host (to generate a trace of memory accesses and control flow paths). For this, we must use a MosaicSim wrapper (PDEC++) around the DECADES compiler. Then, the generated binary must be run natively.
Type PDEC++ -h for all compilation options.
For example, to compile the graph projections benchmark for 2 threads with decoupled supply/compute:
cd workloads/graph_projections/gp_count/decades
These commands will compile and run for "Decoupled Implicit" mode. This compilation mode slices the kernel function into supply and com- pute programs completely automatically.
PDEC++ -m di -t 2 main.cpp
decades_decoupled_implicit/decades_decoupled_implicit ../../../inputs/moreno_crime/x_to_y_graph.txt
These commands will compile for "Base" mode. It identifies the kernel function, per- forms function inlining and wraps the function invocation in the tile launcher.
PDEC++ -m db -t 2 main.cpp
decades_base/decades_base ../../../inputs/moreno_crime/x_to_y_graph.txt
After compiling and running, there should be files generated in a directory prefixed by "output". Check that decades_base/output*/ctrl.txt, decades_base/output*/mem.txt and decades_base/output*/graphOutput.txt are not empty.
Type mosaicrun -h for all run options.
To run the workload on MosaicSim we invoke the simulation from the same folder that we compiled and run to generate the DDG and the memory trace. We must enter commandline arguments corresponding to what the workload was compiled for (for the example above, it would be decoupling with 2 threads). Type:
mosaicrun -n 2 -d .
This defaults to the explicit command (core_inorder and sim_default are the default configs):
mosaicrun -n 2 -d -cc core_inorder -sc sim_default .
CUSTOM CONFIGURATION FILES:
There are config files in sim/config for the different preset modes "mosaicrun -h" displays. You can modify the current ones to change the size of hardware resources or create new ones. Note that config files must be named in the form [configname].txt.
For a number of pre-automated compilation and test runs, navigate back to workloads/graph_projections/gp_count/decades. Type:
make
After completion, the simulator outputs run statistics directly to the console (e.g., # cycles, # cache misses, # dram accesses, IPC, etc). MosaicSim can be run with an optional -o flag to specify a directory for these stats. MosaicSim also prints out additional statistics to specific files, outputted to the provided directory name or the run directory, if none is provided.
Statistics on runahead distances (# cycles between issues of a PRODUCE or LOAD_PRODUCE instructions and issues of corresponding CONSUME instructions) will be outputted to "decouplingStats"
Statistics of latencies of each load instruction will be outputed to "loadStats".
In order to integrate other core or accelerator models with MosaicSim and have them interract together, we have documented an API. See Section E in the linked document: https://www.overleaf.com/project/5c87bee2b8ed496eb059acfb
We also provide further documentation about the simulator and compiler within the DECADES project in the next repo:
https://github.com/PrincetonUniversity/decades_documentation
We provide further workloads, used within the DECADES project in the next repo: