Developing computerized adaptive tests to improve the efficiency of patientreported outcome assessment: Clinically feasible procedures

  • Author(s) / Creator(s)
  • Presentation at 13th Annual Glenrose Rehabilitation Hospital Spotlight on Research Breakfast.

    Patient-reported outcome measures (PRO) are considered valuable sources of information. A clinically useful PRO will balance efficiency (quick administration), while maintaining precision (capturing individual variation) in measuring various health outcomes (e.g., physical function, quality-of-life). Computerized adaptive testing (CAT) can achieve these aims. In CAT, patients receive a unique set of items from a large item bank targeted towards their own health status. The individualized test produces a reliable measurement with far fewer items than traditional questionnaires.

    To demonstrate procedures to develop a computerized-adaptive PRO.

    We used the items in the ‘Lower Extremity Functional Scale’, the Medical Outcomes Study Short Form-36 ‘Role-Physical’, and ‘Physical-Function’ subscales to create a CAT for physical functioning. We analyzed an existing dataset of responses (n=1,429) to the scales, collected from workers with lower extremity impairment. First, we calibrated the items on the same metric, using Item Response Theory. Then, we used computer simulations to design the CAT, and to evaluate the measurement precision of CATs of varying lengths (20 items, 12 items, 8 items, 5 items).

    Comparing the CAT to the three questionnaires (34 items total), we found that a CAT of 8 items in length was sufficient to maintain 95% of measurement precision. If greater precision is desired (99%), 20 items would be sufficient. We developed a CAT for physical function that is fully functional, and ready for implementation into clinical practice.

    CATs are an efficient method of PRO measurement. We demonstrate how practitioners can develop and implement CATs using freely available online platforms.

  • Date created
  • Subjects / Keywords
  • Type of Item
    Conference/Workshop Poster
  • DOI
  • License
    Public Domain Mark 1.0