Skip to content
Templates for reproducible economics projects allowing the use of various languages (Python, R, Stata, Matlab, Julia), tied together by Waf.
Python Stata TeX R MATLAB Jupyter Notebook
Branch: master
Clone or download
Latest commit 6be0c2f Aug 6, 2019
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
docs Restructured docs. Aug 6, 2019
hooks Pre commit (#54) May 10, 2019
tests Another instance where shell=True is needed on Linux. May 10, 2019
{{cookiecutter.project_slug}} Newdocs (#60) Aug 5, 2019
.azure-pipelines.yaml Newdocs (#60) Aug 5, 2019
.gitignore Newdocs (#60) Aug 5, 2019
.pre-commit-config.yaml Pre commit (#54) May 10, 2019
.readthedocs.yml Newdocs (#60) Aug 5, 2019
LICENSE Update LICENSE Jan 3, 2014
README.md Pre commit (#54) May 10, 2019
cookiecutter.json Newdocs (#60) Aug 5, 2019
environment.yml Newdocs (#60) Aug 5, 2019
how-to-release.md Newdocs (#60) Aug 5, 2019

README.md

Templates for Reproducible Research Projects in Economics

An empirical or computational research project only becomes a useful building block for science when all steps can be easily repeated and modified by others. This means that we should automate as much as possible, compared to pointing and clicking with a mouse or, more generally, keeping track yourself of what needs to be done.

This is a collection of templates where much of this automation is pre-configured via describing the research workflow as a directed acyclic graph (DAG) using Waf. You just need to:

  • Install the template for the main language in your project (Stata, R, Matlab, Python, ...)
  • Move your programs to the right places and change the placeholder scripts
  • Run Waf, which will build your entire project the first time you run it. Later, it will automatically figure out which parts of the project need to be rebuilt.

Getting started

  1. The template uses cookiecutter to enable personalized installations. Before you start, install cookiecutter on your system.

     $ pip install cookiecutter
    
  2. Make sure to have Miniconda or Anaconda installed. Tested with Python 3.6 and higher. Python 2 will not work. A modern LaTeX distribution (e.g. TeXLive, MacTex, or MikTex) needs to be found on your path.

  1. If you intend to use a remote Git repository, create it if necessary and hold the URL ready.

  2. Navigate to your designated parent directory in a shell and set up your research project by typing:

     $ cookiecutter https://github.com/hmgaudecker/econ-project-templates/archive/v0.1.zip
    
  3. The dialog will move you through the installation. Make sure to keep this page side-by-side during the process because if something is invalid, the whole process will break off.

    • author -- Obvious, separate multiple authors by commas
    • email -- Obvious, but just use one in case of multiple authors
    • affiliation -- Obvious, separate by commas for multiple authors with different affiliations
    • project_name -- The title of your project as it should appear in papers / presentations. Must not contain underscores or anything that would be an invalid LaTeX title.
    • project_slug -- This will become your project identifier (i.e., the directory will be called this way). The project slug must be a valid Python identifier, i.e., no spaces, hyphens, or the like. Just letters, numbers, underscores. Do not start with a number. There must not be a directory of this name in your current location.
    • set_up_git -- Usually yes
    • git_remote_url -- Usually you want to paste your remote URL here
    • make_initial_commit -- Usually yes
    • example_to_install -- This should be the dominant language you will use in your project. A working example will be installed in the language you choose; the easiest way to get going is simply to adjust the examples for your needs.
    • configure_running_python_from_waf -- Select "y" if and only if you intend to use Python in your project and the Python executable may be found on your path.
    • configure_running_matlab_from_waf -- Select "y" if and only if you intend to use Matlab in your project and the Matlab executable may be found on your path.
    • configure_running_r_from_waf -- Select "y" if and only if you intend to use R in your project and the R executable may be found on your path.
    • configure_running_stata_from_waf -- Select "y" if and only if you intend to use Stata in your project and the Stata executable may be found on your path.
    • configure_running_julia_from_waf -- Select "y" if and only if you intend to use Julia in your project and the Julia executable may be found on your path.
    • configure_running_sphinx_from_waf -- Select "y" if and only if you intend to use Sphinx in your project and the Sphinx executable may be found on your path.
    • add_python_code_formatter_to_project -- Choose yes if using Python
    • use_biber_biblatex_for_tex_bibliographies -- This is a modern replacement for bibtex, but often this does not seem to be stable in MikTeX distributions. Choose yes only if you know what you are doing.
    • open_source_license -- Whatever you prefer.

    After successfully answering all the prompts a folder with your chosen name will be created in your current directory.

  4. For Windows users: Execute the following commands in the Anaconda prompt unless you know what you are doing.

  5. Navigate to the folder in the shell.

  1. Type the following commands to see whether the examples are working:

     python waf.py configure
     python waf.py build
     python waf.py install
    

    The first command will fail if any one of the required programs cannot be found.

    If the second step fails, try the following in order to localise the problem (otherwise you may have many parallel processes started and it will be difficult to find out which one failed):

     python waf.py build -j1
    

Additional Prerequisites

  • Running Sphinx requires the extension sphinxcontrib.bibtex. Install via pip:

    pip install sphinxcontrib-bibtex
    
  • For the R example, make sure to have the following libraries installed before you try to run Waf:

    • AER
    • aod
    • car
    • foreign
    • ivpack
    • lmtest
    • rjson
    • sandwich
    • xtable
    • zoo

    Quick 'n' dirty command in an R shell:

    install.packages(
        c(
            "foreign",
            "AER",
            "aod",
            "car",
            "ivpack",
            "lmtest",
            "rjson",
            "sandwich",
            "xtable",
            "zoo"
        )
    )
    

Full documentation

See http://hmgaudecker.github.io/econ-project-templates/ for the full documentation. Please read it before continuing with your project.

You can’t perform that action at this time.