AuTomated assEssment Management System for Interactive Learning
Clone or download
Failed to load latest commit information.
.idea further bugfixes after angular6, spring2 and jhipster5 upgrade Sep 11, 2018
.jhipster Merge branch 'jhipster_upgrade' into develop Sep 9, 2018
data improve README and add database scheme for easier setup Jul 4, 2018
doc improve README Oct 8, 2017
gradle update dependencies and readd generateGitProperties Sep 11, 2018
libs updated to latest bob cli libraries Sep 10, 2018
patches Feature/no implicit any (#101) Sep 8, 2018
src further bugfixes after angular6, spring2 and jhipster5 upgrade Sep 11, 2018
webpack further bugfixes after angular6, spring2 and jhipster5 upgrade Sep 11, 2018
.angular-cli.json Update repository to ArTEMiS 2.0.1 with huge improvements Jun 28, 2018
.bowerrc Update repository to ArTEMiS 2.0.1 with huge improvements Jun 28, 2018
.editorconfig Generated with JHipster 3.4.2 Jun 21, 2016
.gitattributes Generated with JHipster 4.10.0 Oct 18, 2017
.gitignore Merge branch 'jhipster_upgrade' into develop Sep 9, 2018
.prettierignore Generated with JHipster 5.3.1 Sep 8, 2018
.prettierrc Generated with JHipster 5.3.1 Sep 8, 2018
.yo-rc.json Merge branch 'jhipster_upgrade' into develop Sep 9, 2018
LICENSE Initial commit Sep 29, 2016 improve README files May 11, 2018 Merge branch 'jhipster_upgrade' into develop Sep 9, 2018
angular.json Generated with JHipster 5.3.1 Sep 8, 2018
artemis.jh integrate text exercises and file upload exercises into course admini… Aug 30, 2018
bower.json update ArTEMiS version to 2.2.0 Aug 29, 2018
build.gradle update dependencies and readd generateGitProperties Sep 11, 2018 Merge branch 'jhipster_upgrade' into develop Sep 9, 2018
gradlew Generated with JHipster 4.7.0 Aug 23, 2017
gradlew.bat Generated with JHipster 4.7.0 Aug 23, 2017
package-lock.json Feature/no implicit any (#101) Sep 8, 2018
package.json update webpack version Sep 11, 2018
postcss.config.js upgrade to angular 5 Jun 28, 2018
proxy.conf.json upgrade to angular 5 Jun 28, 2018
settings.gradle refactored ExerciseApplication to ArTEMiS Sep 1, 2017
tsconfig-aot.json Merge branch 'jhipster_upgrade' into develop Sep 9, 2018
tsconfig.json Merge branch 'jhipster_upgrade' into develop Sep 9, 2018
tslint.json Feature/angular6 (#100) Aug 30, 2018
yarn.lock update webpack version Sep 11, 2018

ArTEMiS: AuTomated assEssment Management System

This application was generated using JHipster 5.3.1, you can find documentation and help at

Curent version: 2.2.0

Main features

ArTEMiS has the following main features:

  1. Programming exercises with version control and automatic assessment with test cases and continuous integration
  2. Quiz exercises with multiple choice questions and drag and drop questions
  3. Modeling exercises with semi-automatic assessment using machine learning concepts (beta)

All these exercises are supposed to be run either live in-class with instant feedback or as homework. Students can submit their solutions multiple times within the due date and use the (semi-)automatically provided feedback to improve their solution.

Top-Level Design

The following UML diagram shows the top-level design of ArTEMiS which is decomposed into an application client and an application server. The application server then connects to a version control system (VCS), a continuous integration system (CIS) and a user management system (UMS).

Top-Level Design

While ArTEMiS includes generic adapters to these three external systems with a defined protocol which can be instantiated to connect to any VCS, CIS or UMS, it also provides 3 concrete implementations for these adapters to connect to:

  1. VCS: Atlassian Bitbucket Server
  2. CIS: Atlassian Bamboo Server
  3. UMS: Atlassian JIRA Server (more specifically Atlassian Crowd on the JIRA Server)

Programming Exercise Workflow

Conducting a programming exercise consists of 7 steps distributed among instructor, ArTEMiS and students:

  1. Instructor prepares exercise: Set up a repository containing the exercise code and test cases, build instructions on the CI server, and configures the exercise in ArTEMiS.
  2. Student starts exercise: Click on start exercise on ArTEMiS which automatically generates a copy of the repository with the exercise code and configures a build plan accordingly.
  3. Optional: Student clones repository: Clone the personalized repository from the remote VCS to the local machine.
  4. Student solves exercise: Solve the exercise with an IDE of choice on the local computer or in the online editor.
  5. Student uploads solution: Upload changes of the source code to the VCS by committing and pushing them to the remote server (or by clicking submit in the online editor).
  6. CI server verifies solution: verify the student's submission by executing the test cases (see step 1) and provide feedback which parts are correct or wrong.
  7. Student reviews personal result: Reviews build result and feedback using ArTEMiS. In case of a failed build, reattempt to solve the exercise (step 4).
  8. Instructor reviews course results: Review overall results of all students, and react to common errors and problems.

The following activity diagram shows this exercise workflow.

Exercise Workflow

Online Editor

The following screenshot shows the online editor with interactive and dynamic exercise instructions on the right side. Tasks and UML diagram elements are referenced by test cases and update their color from red to green after students submit a new version and all test cases associated with a task or diagram element pass. This allows the students to immediately recognize which tasks are already fulfilled and is particularly helpful for programming beginners.

Online Editor

Development Setup

ArTEMis is based on JHipster, i.e. Spring Boot development on the application server using Java 8 and TypeScript development on the application client in the browser using Angular 6 and Webpack. To get an overview of the used technology, have a look at and other tutorials on the JHipster homepage.

You can find tutorials how to setup JHipster in an IDE (IntelliJ is recommended, but it also runs in other IDEs as well) on Before you can build ArTEMiS, you must install and configure the following dependencies/tools on your machine:

  1. Java 8 JDK: Java is the main development language for the server application of ArTEMiS.
  2. MySQL Database Server 5.7.x: ArTEMiS uses Hibernate to store entities in a MySQL database. Download and install the MySQL Community Server (5.7.x) and configure the 'root' user with an empty password. (In case you want to use a different password, make sure to change the value in application-dev.yml and in liquibase.gradle). The required ArTEMiS scheme will be created / updated automatically at startup time of the server application.
  3. Node.js: We use Node (>=6.9.0) to run a development web server and build the project. Depending on your system, you can install Node either from source or as a pre-packaged bundle.
  4. Yarn 1.9.x: We use Yarn to manage Node dependencies. Depending on your system, you can install Yarn either from source or as a pre-packaged bundle.
  5. Bower 1.8.x: We use Bower to manage CSS and JavaScript dependencies used in the Angular 1 application (in the hybrid mode which is deprecated and will be removed soon). You can install Bower with the command npm install -g bower. You can download all dependencies by running bower install. You only need to invoked this command once. (Note: this is deprecated and will be removed soon)

Server Setup

To start the ArTEMiS application server from the development environment, first import the project into IntelliJ and then make sure to install the Spring Boot plugins to run the main class Before the application runs, you have to configure the file application-dev.yml in the folder src/main/resources/config/ and add the following details:

  repo-clone-path: ./repos/
  encryption-password: <password>
  result-retrieval-delay: 5000
    user: <user>
    password: <password>
    admin-group-name: <admin-group>
    user: <user>
    password: <password>
    bitbucket-application-link-id: de1bf2e0-eb40-3a2d-9494-93cbe2e22d08
    user: <user>
    password: <password>
    id: exerciseapp_lti
    oauth-key: exerciseapp_lti_key
    oauth-secret: <secret>
    user-prefix: edx_
    user-group-name: edx
    name: ArTEMiS
    email: <email>

Change the entries with <...> with proper values, e.g. your TUM Online account to connect to the given instances of JIRA, Bitbucket and Bamboo. Alternatively, you can connect to your local JIRA, Bitbucket and Bamboo instances using Docker.

The ArTEMiS server should startup by running the main class using Spring Boot.

One typical problem in the development setup is that an exception occurs during the database initialization. ArTEMiS uses Liquibase to automatically upgrade the database scheme after changes to the data model. This ensures that the changes can also be applied to the production server. In some development environments, it can be the case that the liquibase migration from an empty database scheme to the current version of the database scheme fails, e.g. due to the fact that the asynchronous migration is too slow. In these cases, it can help to manually import an existing database scheme using e.g. MySQL Workbench or Sequel Pro into the ArTEMiS database scheme in your MySQL server. You can find a recent scheme in the data folder in this git repository. If you then start the application server, liquibase will recognize that all migration steps have already been executed. In case you encounter errors with liquibase checksum values, run the following command in your terminal / command line:

java -jar liquibase-core-3.5.3.jar --url=jdbc:mysql://localhost:3306/ArTEMiS --username=root --password='' --classpath=mysql-connector-java-5.1.43.jar  clearCheckSums

You can download the required jar files here:

Please note: ArTEMiS uses Spring profiles to segregate parts of the application configuration and make it only available in certain environments. For development purposes, the following program arguments can be used to enable the dev profile and the profiles for JIRA, Bitbucket and Bamboo:,bamboo,bitbucket,jira 

Client Setup

After installing Node, you should be able to run the following command to install development tools. You will only need to run this command when dependencies change in package.json.

yarn install

To install the Angular 1 JavaScript dependencies for the hybrid mode, you have to execute the following command once:

bower install

To start the client application in the browser, use the following command:

yarn start

This compiles TypeScript code to JavaScript code, starts the hot module replacement feature in Webpack (i.e. whenever you change a TypeScript file and save, the client is automatically reloaded with the new code) and will start the client application in your browser on http://localhost:9000. If you have activated the JIRA profile (see above in Server Setup) and if you have configured application-dev.yml correctly, then you should be able to login with your TUM Online account.

For more information, review Working with Angular. For further instructions on how to develop with JHipster, have a look at Using JHipster in development.

Building for production

To optimize the ArTEMiS application for production, run:

./gradlew -Pprod clean bootRepackage

This will concatenate and minify the client CSS and TypeScript / JavaScript files. It will also modify index.html so it references these new files. To ensure everything worked, run:

java -jar build/libs/*.war

Then navigate to http://localhost:8080 in your browser.

Refer to Using JHipster in production for more details.


The following UML deployment diagram shows a typical deployment of ArTEMiS application server and application client. Student, Instructor and Teaching Assistant (TA) computers are all equipped equally with the ArTEMiS application client being displayed in the browser.

The Continuous Integration Server typically delegates the build jobs to local build agents within the university infrastructur or to remote build agents, e.g. hosted in the Amazon Cloud (AWS).

Deployment Overview

Data Model

The ArTEMiS application server used the following (initial) data model in the MySQL database. It supports multiple courses with multiple exercises. Each student in the participating student group can participate in the exercise by clicking the Start Exercise button. Then a repository and a build plan for the student (User) will be created and configured. The initialization state variable (Enum) helps to track the progress of this complex operation and allows to recover from errors. A student can submit multiple solutions by committing and pushing the source code changes to a given example code into the version control system. Each submission is automatically tested by the continuous integration server, which notifies the ArTEMiS application server, when a new result exists. In addition, teaching assistants can assess student solutions and "manually" create results. The current data model is more complex and supports different types of exercises such as programming exercises, modeling exercises and quiz exercises.

Data Model

In the future, we want to allow different types of exercises, so expect multiple subclasses for programming, modeling and quiz exercises.

Server Architecture

The following UML component diagram shows more details of the ArTEMiS application server architecture and its REST interfaces to the application client.

Server Architecture


The following UML component diagram shows the details of the Version Control Adapter that allows to connect to multiple Version Control Systems. The other adapters for Continuous Integration and User Management have a similar structure

Version Control Adapter

The Version Control Adapter includes the following abstract interface that concrete connectors have to implement:

+ copyRepository(baseRepository, user)
+ configureRepository(repository, user)
+ deleteRepository(repository)
+ getRepositoryWebUrl(repository)

The Continuous Integration Adapter includes the following abstract interface that concrete connectors have to implement:

+ copyBuildPlan(baseBuildPlan, user)
+ configureBuildPlan(buildPlan, repository, user)
+ deleteBuildPlan(buildPlan)
+ onBuildCompleted(buildPlan)
+ getBuildStatus(buildPlan)
+ getBuildDetails(buildPlan)
+ getBuildPlanWebUrl(buildPlan)