Evaluating the consistency of verbal reports and the use of cognitive models in educational measurement

  • Author / Creator
    Wang, Xian
  • In the field of psychology, verbal reports are commonly used as a data source to explain human information processing. To date, few studies have investigated the accuracy of verbal reports for providing information on students’ reasoning and problem solving on educational tasks. The purpose of this study is to evaluate the consistency of verbal data, as well as the effects of student achievement, interviewer knowledge level, and item difficulty on the consistency of verbal reports. Seventy-one Grade 12 students from two high schools provided verbal responses to 15 multiple choice test items from the Alberta Pure Mathematics Diploma Examination. Results indicate higher-achieving students demonstrate greater consistencies in verbal reports than moderate achieving students. The implications of the results are discussed and the limitations of the present study are also presented.

  • Subjects / Keywords
  • Graduation date
  • Type of Item
  • Degree
    Master of Education
  • DOI
  • License
    This thesis is made available by the University of Alberta Libraries with permission of the copyright owner solely for non-commercial purposes. This thesis, or any portion thereof, may not otherwise be copied or reproduced without the written consent of the copyright owner, except to the extent permitted by Canadian copyright law.
  • Language
  • Institution
    University of Alberta
  • Degree level
  • Department
    • Department of Educational Psychology
  • Supervisor / co-supervisor and their department(s)
    • Jacqueline P. Leighton (Educational Psychology)
  • Examining committee members and their departments
    • Rebecca J. Gokiert (Community-University Partnership for the Study of Children, Youth, and Families)
    • Mark J. Gierl (Educational Psychology)