Rui Wang's Undergraduate Thesis

Hierarchical Reinforcement Learning with Advantage-Based Auxiliary Reward

Coauthors: Siyuan Li, Chongjie Zhang @ IIIS MIG, Tsinghua University

Please checkout our paper here on Arxiv!

This work is published on NeurIPS 2019.

Usage and Acknowledgement

使用过程中我修改了原repo的部分文件，使得格式符合新的要求。

I thank ThuThesis and its development team for making this LaTeX template possible. I won't be able to graduate (at least comfortably) without their contribution.

In order to correctly cite references in the appendix, I also consulted this Github Repo. Relavant file is thuappendixbib.sty. My typesetting command lines are located in thuthesis.tpbuild. Please star the repository if it is of some help to you.

Below is the forked README from ThuThesis.

What's ThuThesis?

ThuThesis is an abbreviation of Tsinghua University Thesis LaTeX Template.

This package establishes a simple and easy-to-use LaTeX template for Tsinghua dissertations, including general undergraduate research papers, masters theses, doctoral theses, doctoral dissertations, and post-doc reports. Additional support for other formats (what else is there?) will be added continuously. An English translation of this README follows the Chinese below.

ThuThesis是什么？

ThuThesis为 Tsinghua University Thesis LaTeX Template之缩写。

此宏包旨在建立一个简单易用的清华大学学位论文LaTeX模板，包括本科综合论文训练、硕士论文、博士论文、博士哲学论文以及博士后出站报告。现在支持本科、硕士、博士论文、博士后出站报告格式，对其它格式（还有么？）的支持会陆续加入。

文档

请下载模板，里面包括具体使用说明以及示例文档：

• 模板使用说明 (thuthesis.pdf)
• 示例文档 (main.pdf)

下载

• 发行版：CTAN
• 开发版：GitHub

升级

自动更新

通过TeX发行版工具自动从CTAN更新。

手动更新

从 GitHub下载放入论文目录，执行命令（Windows 用户在文件夹空白处按Shift+鼠标右键，点击“在此处打开命令行窗口”）：

latex thuthesis.ins

即可得到 thuthesis.cls 和 thuthesis.cfg 等模板文件。

提问

按推荐顺序排序：

• 先到 FAQ 看看常见问题
• Github Issues
• TeX@newsmth
• ThuThesis@Google Groups

Makefile的用法

make [{all|thesis|shuji|doc|clean|cleanall|distclean}] \
     [METHOD={latexmk|xelatex|pdflatex}]

目标

• make all 等于 make thesis && make shuji && make doc；
• make cls 生成模板文件；
• make thesis 生成论文 main.pdf；
• make shuji 生成书脊 shuji.pdf；
• make doc 生成使用说明书 thuthesis.pdf；
• make clean 删除示例文件的中间文件（不含 main.pdf）；
• make cleanall 删除示例文件的中间文件和 main.pdf；
• make distclean 删除示例文件和模板的所有中间文件和 PDF。

参数

• METHOD：指定生成 pdf 的方式，缺省采用 latexmk。
  • METHOD=latexmk 表示使用 latexmk 的方式生成 pdf（使用 xelatex）。
  • METHOD=xelatex 表示使用 xelatex 引擎编译生成 pdf；
  • METHOD=pdflatex 表示使用 pdflatex 引擎编译生成 pdf。

Documentation

Download and unzip the template. Specific usage documentation and examples can be found in the files below. At present, these documents are only available in Chinese:

• Template usage (thuthesis.pdf)
• Template example (main.pdf)

Downloads

• Published version: CTAN
• Developer version: GitHub

Updates

Automatic

Get the most up-to-date published version of the TeX tools from CTAN.

Manual

Download the package from GitHub to the root directory of your thesis, then execute the command (Windows users Shift + right click white area in the file window and click "Open command line window here from the popup menu"):

latex thuthesis.ins

You'll get thuthesis.cls and thuthesis.cfg along with other template files.

Reporting Issues

Please follow the procedure below:

• Check the FAQ
• Github Issues
• TeX@newsmth
• ThuThesis@Google Groups

Makefile Usage

make [{all|thesis|shuji|doc|clean|cleanall|distclean}] \
     [METHOD={latexmk|xelatex|pdflatex}]

Targets

• make all same as make thesis && make shuji && make doc;
• make cls generate template file;
• make thesis generate thesis main.pdf;
• make shuji generate book spine for printing shuji.pdf;
• make doc generate documentation thuthesis.pdf;
• make clean delete all examples' files (excluding main.pdf);
• make cleanall delete all examples' files and main.pdf;
• make distclean delete all examples' and templates' files and PDFs.

Parameters

• METHOD：define the method used to generate the pdfs, the default is latexmk.
• METHOD=latexmk use latexmk to generate pdfs (uses xelatex).
• METHOD=xelatex use xelatex engine to compile and build pdfs;
• METHOD=pdflatex use pdflatex engine to compile and build pdfs.