Digital Libraries (DLs) like IEEE Xplore, ACM DL, SpringerLink, etc., are being used quite frequently for executing the Automatic Search Phase of Secondary Studies such as Systematic Literature Reviews and Mapping Studies. However, the execution behavior of the various search related features of these DLs is not as consistent as required by such secondary studies. This repository intends to make a continuous effort toward reporting the current state of execution behavior of various search features of DLs used in secondary studies related to software engineering domain. In particular, the repository targets behavioral inconsistencies with respect to the feature set required in the conduct the search process of secondary studies. The repository will be updated with every recent search feature related changes in the respective DLs and hence would provide the secondary study researchers with an up-to-date information about the robustness and reliability of such DLs. To start with , we target five DLs: IEEE Xplore, ACM DL, SpringerLink, Science Direct and Wiley, and report their search features with appropriate scores extracted through a formal feature analysis.
The repository has four components:
1) DL Scores.xlsx - Contains feature wise scores for each DL
2) Experimental Search Strings.xlsx - Lists the search strings used for experimenting with search features
3) Issues Snapshots.pdf - Contains the snapshots to illustrate the inconsistencies observed during the execution of various features
4) Motivational Analysis.xlsx - Enlists information extracted from a set of 26 Software Engineering secondary studies published in 2016-2017
5) Features Description.pdf - Provides description of each feature and its sub features that are used to evaluate DLs