Usage
  • 142 views
  • 91 downloads

Validating student score inferences using person fit statistic and verbal reports: A person-fit study for cognitive diagnostic assessment

  • Author(s) / Creator(s)
  • The goal of this study was to investigate the usefulness of person-fit analysis in validating student score inferences in a cognitive diagnostic assessment. In this study, a two-stage procedure was used to evaluate person fit for a diagnostic test in the domain of statistical hypothesis testing. In the first stage, the person-fit statistic, the hierarchy consistency index (HCI; Cui, 2007; Cui & Leighton, 2009), was used to identify the misfitting student item-score vectors. In the second stage, students’ verbal reports were collected to provide additional information about students’ response processes so as to reveal the actual causes of misfits. This two-stage procedure helped to identify the misfits of item-score vectors to the cognitive model used in the design and analysis of the diagnostic test, and to discover the reasons of misfits so that students’ problem-solving strategies were better understood and their performances were interpreted in a more meaningful way.

  • Date created
    2013
  • Subjects / Keywords
  • Type of Item
    Article (Published)
  • DOI
    https://doi.org/10.7939/R3WW77D8P
  • License
    © 2013 Wiley. This version of this article is open access and can be downloaded and shared. The original author(s) and source must be cited.
  • Language
  • Citation for previous publication
    • Cui, Y., & Roberts, M. R. (2013). Validating student score inferences using person fit statistic and verbal reports: A person-fit study for cognitive diagnostic assessment. Educational Measurement: Issues and Practice, 32(1), 34-42. https://doi.org/10.1111/emip.12003
  • Link to related item
    https://doi.org/10.1111/emip.12003