One important issue in the development of recommender systems is a thorough and significant evaluation of the proposed algorithm. However, some aspects of recommending music are inherently subjective, such as serendipity, and thus the evaluation of such algorithms can only be done in vivo, i.e. with real users not in an artificial environment.
Therefore we developed a system that takes care of all regular tasks that are involved in conducting such evaluations. MuSe provides the typical off-the-shelf evaluation algorithms, offers an online evaluation system with automatic reporting, and by integrating online streaming services (eg. Spotify) also a legal possibility to evaluate the quality of recommended songs in real time. In addition evaluations can be configured and managed online.
Recommender algorithms can be added to the system internally, or plugged in comfortably by using our API.
Step 0. Requirements
You will need Java 6+, a servlet container (eg. Tomcat) and a database to run the system. Download the current release here.
Step 1. Configuration
To configure the application open the file app.properties in the src directory and provide the missing information, inlcuding a permanent directory which can be read and written by the application. Finally move the file recommenders.json to the specified directory.
Step 2. Database schema
The application requires access to a certain table structure in your database. The DDL is included in the file DB_INIT.sql. Simply import it to the database given in app.properties from before. This will in addition create an initial administrator account (username: admin, password: admin). Note that the init script and the queries of the application are written in the oracle flavor of SQL and problems may arise by using another RDBMS.
For further explanations take a look at our wiki.