Fetching contributors…
Cannot retrieve contributors at this time
74 lines (60 sloc) 3.2 KB

+++ title = "Using simulation to evaluate retest reliability of assessment results" date = 2018-04-01T00:00:00 draft = false

Authors. Comma separated list, e.g. ["Bob Smith", "David Jones"].

authors = ["Brooke Nash", "Amy K. Clark", "W. Jake Thompson"]

Publication type.


0 = Uncategorized

1 = Conference paper

2 = Journal article

3 = Manuscript

4 = Report

5 = Book

6 = Book section

7 = Encyclopedia entry

publication_types = ["1"]

Publication name and optional abbreviated version.

publication = "National Council on Measurement in Education" publication_short = "NCME"

Abstract and optional shortened version.

abstract = "As diagnostic assessment systems become more prevalent as large-scale operational assessments, consideration must be given to the method of reporting reliability. Alternatives to traditional reliability methods must be explored that are consistent with the design, scoring, and reporting level of diagnostic assessment systems. One method for evaluating retest reliability when practical constraints make a second empirical administration infeasible is with the use of simulation methodology. The purpose of this paper is to summarize the method and application of using a simulated second test administration to report reliability for one large-scale operational diagnostic assessment program. Using operational administration data, student response data was simulated based on model-calibrated parameters. Reliability estimates were calculated to provide a measure of association between true and estimated mastery of skills. Overall, results provide support for reporting reliability via simulation-based methods and for the valid interpretation and use of skill mastery information provided in diagnostic score reports. This paper includes a summary of the methods used, presentation of example results, broad implications for its application within the measurement field and future directions."

Is this a selected publication? (true/false)

selected = false

Projects (optional).

Associate this publication with one or more of your projects.

Simply enter your project's folder or file name without extension.

E.g. projects = ["deep-learning"] references


Otherwise, set projects = [].

projects = ["dynamic-learning-maps"]

Tags (optional).

Set tags = [] for no tags, or use the form tags = ["A Tag", "Another Tag"] for one or more tags.

tags = ["educational-assessment"]

Links (optional).

url_pdf = "pub/2018-Nash-NCME-Sim-Reli.pdf" url_preprint = "" url_code = "" url_dataset = "" url_project = "" url_slides = "slides/2018-Nash-NCME-Sim-Reli.pdf" url_video = "" url_poster = "" url_source = ""

Custom links (optional).

Uncomment line below to enable. For multiple links, use the form [{...}, {...}, {...}].

url_custom = []

Digital Object Identifier (DOI)

doi = ""

Does this page contain LaTeX math? (true/false)

math = true

Featured image

To use, add an image named featured.jpg/png to your page's folder.


Caption (optional)

caption = ""

Focal point (optional)

Options: Smart, Center, TopLeft, Top, TopRight, Left, Right, BottomLeft, Bottom, BottomRight

focal_point = "" +++