1: Language Technologies Institute — Carnegie Mellon University 2: Psychologisches Institut — Eberhard-Karls-Universität, Tübingen 3: Institute of Educational Psychology — Ludwig Maximilians Universität München 4: Knowledge Media Research Center (KRMC) — Institut fur Wissensmedien
Appears in:
Computer Supported Collaborative Learning 2005: The Next 10 Years!: Proceedings of the International Conference on Computer Supported Collaborative Le: The Next 10 Tears! (2005) 125-134
Abstract:
Process analyses are becoming more and more standard in research on computer-supported
collaborative learning. This paper presents the rational as well as results of an evaluation of a tool called TagHelper, designed for streamlining the process of multi-dimensional analysis of the collaborative learning process. In comparison with a hand-coded corpus coded with a 7 dimensional coding scheme, TagHelper is able to achieve an acceptable level of agreement (Cohen's Kappa of .7 or more) along 6 out of 7 of the dimensions when we commit only to the portion of the corpus where the predictor has the highest certainty. In 5 of those cases, the percentage of the corpus where the predictor is confident enough to commit a code is at least 88% of the corpus. Consequences for theory-building with respect to automatic corpus analysis are formulated. Potential applications as a support tool for process analyses, as real-time support for facilitators of on-line discussions, and for the development of more adaptive instructional support for computer-supported collaboration are discussed.
This is a pre-print version of the article published in the Proceedings of the International Conference of CSCL 2005, which is copyrighted by Lawrence Erlbaum Associates, Inc.
log in
