LSTM Cluster: An Integrated Approach to Cluster Students' Problem Solving Sequences in Log Files

• Author / Creator

  Qi Guo

• Modern technology-based assessments have the capacity to record every student-computer interaction in log files. Cluster analysis of log files could yield insights about students’ problem solving strategies and their misconceptions. However, current cluster analysis algorithms often rely on expert-selected features and they do not take the order of student actions into account. To address these limitations, this study proposes a novel deep learning approach to cluster student actions in log files. The proposed method, Long Short Term Memory (LSTM) cluster, first extracts features relevant to the problem from sequential data, and then clusters students based on the extracted features. In order to demonstrate and evaluate LSTM cluster, a real data study and a simulation study were conducted. In the real data study, LSTM cluster identified four different problem-solving strategies. A detailed examination of these strategies suggested that the order of student actions was indeed important. The simulation study suggested that LSTM cluster had good accuracy for large sample sizes. However, when sample size is small, the number of student actions needs to be reduced in order to prevent overfitting.

• Subjects / Keywords

  • simulation based assessment
  • technology based assessment
  • cluster analysis
  • Long Short Term Memory Model
  • deep learning
  • LSTM
  • sequential pattern analysis
  • sequence cluster

• Graduation date

  Fall 2018

• Type of Item

  Thesis

• Degree

  Doctor of Philosophy

• DOI

  https://doi.org/10.7939/R3WH2DW8B

• License

  Permission is hereby granted to the University of Alberta Libraries to reproduce single copies of this thesis and to lend or sell such copies for private, scholarly or scientific research purposes only. Where the thesis is converted to, or otherwise made available in digital form, the University of Alberta will advise potential users of the thesis of these terms. The author reserves all other publication and other rights in association with the copyright in the thesis and, except as herein before provided, neither the thesis nor any substantial portion thereof may be printed or otherwise reproduced in any material form whatsoever without the author's prior written permission.