Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Tasks for the Participants. #1

Open
masud-technope opened this issue Oct 10, 2018 · 0 comments
Open

Tasks for the Participants. #1

masud-technope opened this issue Oct 10, 2018 · 0 comments

Comments

@masud-technope
Copy link
Owner

masud-technope commented Oct 10, 2018

Available Features

The prototype offers four distinct features currently. I provided 12 bug reports from the ECF repository.

  • How to execute your own query for a specific Bug ID?
  • How to execute the baseline queries for a specific change request?
  • How to get suggested queries from STRICT for a single change request?
  • How to get suggested queries from STRICT for all the change requests?

Tasks to be Performed

Using these above features, the students should answer the following questions:

Note: **QE** = *Query Effectiveness*. The lower the QE is, the better the query is. 
However, QE= -1 means *RESULT NOT FOUND*, i.e., the worst query.
  • T1: Report your output for each of the sample commands provided in the README file.
  • T2: What is the best query you can come up with for each change request/bug report? The better your query is, the higher your grade is. Use the above available features to answer this question.
  • T3: What is the rank improvement between your query and the best performing baseline query? Suppose, your QE is 10 and the baseline QE is 20. Then you have a rank improvement of 10.
  • T4: Provide your best query for each change request/bug report which is the shortest in length, i.e., contains the least amount of keywords.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant