Protocol

Objectives

This Systematic Mapping is intended to map the DSLs to software functional tests and their features, drawbacks, benefits, and trends. In order to verify the largest deficits and benefits within the current scenario, and propose a new domain-specific language for software functional tests to mitigate the drawbacks found and unite most of the benefits and trends.

PICOC

• Population: All published articles that propose or use a DSL for software functional testing.
• Intervention: All DSLs for software functional tests and their features, drawbacks, and benefits.
• Comparison: Not included because the objective is to detect drawbacks to mitigate and unite the most benefits found.
• Outcome: Set of DSLs for software functional testing along with most drawbacks, benefits, and trends.
• Context: All academic and industrial contexts.

Research Questions

ID	Research Question
RQ01	The reported DSL products (e.g., generated scripts and models) are applied to which domains?
RQ02	What are the DSL features?
RQ03	What technologies and notation were used for the development of DSL functional testing?
RQ04	What technique/approach/ method does DSL use to ensure coverage of the generated tests?
RQ05	How System Under Testing (SUT) input data are represented into the models?
RQ06	What are the benefits, drawbacks, and trends related to the use of DSL for functional testing?

Search Strategy

• For the inclusion or exclusion of articles, the titles, abstracts, and conclusion are read in order to verify and perform a pre-selection of studies that present a DSL for software functional tests.
• For an article to be accepted, it must have at least one of the inclusion criteria. However, if the study meets an exclusion criterion, it will be removed from the selection.
• Thereafter, a full reading of the selected studies will be conducted in order to respond to the specified research questions. For this purpose, the data extraction form described in this plan will be used. Quality questions will also be used to evaluate articles according to their contribution to the study.
• Studies can also be excluded during full reading if they exhibit any of the exclusion criteria.

Keywords and Synonyms

Keyword	Synonyms	Related to
Domain-Specific Language	domain specific language, domain-specific-language, domain-specific modeling language, domain-specific modeling language, domain-specific-modeling language, domain-specific-modeling-language, DSL, DSML	Outcome
Functional testing	black box test, black-box test, black box testing, black-box testing, functional test, regression test, regression testing, acceptance test, acceptance testing	Intervention

Search String

Base Search String

("domain-specific language" OR "domain specific language" OR "domain-specific-language" OR "domain specific modeling language" OR "domain-specific modeling language" OR "domain-specific-modeling language" OR "domain-specific-modeling-language" OR "DSL " OR "DSML") AND ("functional testing" OR "black box test" OR "black-box test" OR "black box testing" OR "black-box testing" OR "functional test" OR "regression test" OR "regression testing" OR "acceptance test" OR "acceptance testing")

Sources

Source Name	URL
ACM Digital Library	http://portal.acm.org
IEEE Digital Library	http://ieeexplore.ieee.org
Science Direct	http://www.sciencedirect.com
Scopus	http://www.scopus.com
Springer Link	http://link.springer.com
EI Compendex	http://www.engineeringvillage.com

Selection Criteria

ID	Inclusion Criteria
IC01	The primary study must explicitly propose or present a DSL for software functional testing.

ID	Exclusion Criteria
EC01	Articles written in languages ​other than English.
EC02	The study does not present a DSL for software functional tests or the use of one.

ps.: In the 2023 version, we insert a new exclusion criteria EC03: Previously reviewed article, for not reviewing the same article verified in 2018 version