MultiTex

MultiTex – Process-based assessment of multiple documents comprehension (Multiple Documents Literacy)

In the project MultiTex, a computer-based instrument to assess the competence of text comprehension with multiple documents (multiple documents literacy, MDL) of university students is developed and validated. A special methodological focus lies in the usage of additional process-based diagnostics. Accordingly, in this project process-based measures are used, first, as additional diagnostic information; second, in order to identify strategies of processing multiple documents; and third, to test theories of multiple text comprehension.

The aims of the present project can be characterized as follows:

  • Development of a theoretically sound computer-based test of multiple documents literacy (MDL)
  • Analysis of processes of multiple text comprehension for advanced diagnostics
  • Construct validation of the MDL text with two cohorts of university students of two subject groups at two locations
  • Empirical test of assumptions of theories of multiple documents comprehension

Project Homepage

Bamberg subproject - focus on pedagogical-psychological process analysis

The subproject at the University of Bamberg focuses on the development of items and units for the MDL test, the planning of the development study as well as the validation study, the organization of the studies for the Bamberg site as well as the coordination across the sites, the evaluation of the two studies with regard to process measures, the identification of strategies and strategy deficits on the basis of the process data, and the testing of theories of multiple text comprehension. In addition, project coordination is within the scope of the subproject.

The tasks within the present subproject can be characterized as follows:

  1. Development of items and units for a theoretically sound computer-based MDL test, including planning, organization, and implementation of a development study
  2. Construct validation of the MDL test on two student cohorts at two sites in two subject groups: Planning, organizing, conducting, and evaluating the validation study
  3. Analysis of multiple text comprehension processes to identify strategies and strategy deficits
  4. Empirical testing of the assumptions of theories of multiple text comprehension
  5. Project coordination

Publications

Schoor, C., Rouet, J.-F., Artelt, C., Mahlow, N., Hahnel, C., Kröhne, U., & Goldhammer, F. (2021). Readers' perceived task demands and their relation to multiple document comprehension strategies and outcome. Learning and Individual Differences, 88, 102018. DOI: 10.106/j.lindif.2021.10201 Free access until 4th July 2021: https://authors.elsevier.com/a/1d4BV3irP45a5k

Mahlow, N., Hahnel, C., Kroehne, U., Artelt, C., Goldhammer, F., & Schoor, C. (2020). More Than (Single) Text Comprehension? – On University Students’ Understanding of Multiple Documents. Frontiers in Psychology, 11. DOI: 10.3389/fpsyg.2020.562450

Schoor, C. (2020). Lesen in Zeiten von Fake News. Über den Umgang mit multiplen Dokumenten. uni.vers Forschung 2020: Lernen, ein Leben lang - Bamberger Beiträge zur Bildungsforschung, 40-43.

Schoor, C., Hahnel, C., Artelt, C., Reimann, D., Kröhne, U., & Goldhammer, F. (2020). Entwicklung und Skalierung eines Tests zur Erfassung des Verständnisses multipler Dokumente von Studierenden. Diagnostica, 66, 123-135. DOI: 10.1026/0012-1924/a000231

Schoor, C., Hahnel, C., Mahlow, N., Klagges, J., Kroehne, U., Goldhammer, F., & Artelt, C. (2020). Multiple document comprehension of university students: Test development and relations to person and process characteristics. In O. Zlatkin-Troitschanskaia & H. A. Pant (Eds.), Student Learning Outcomes in Higher Education (pp. 223-242). Heidelberg: Springer. https://www.springer.com/gp/book/9783658278854

Hahnel, C., Kröhne, U., Goldhammer, F., Schoor, C., Mahlow, N., & Artelt, C. (2019). Validating process variables of sourcing in an assessment of multiple document comprehension. British Journal of Educational Psychology, 89(3), 524-537. DOI: 10.1111/bjep.12278

Hahnel, C., Mahlow, N., Schoor, C., & Cerdán, R. (2019). Promoting reading goals and strategy knowledge to improve university students' comprehension of multiple documents. In C. Lautenbach, J. Fischer, O. Zlatkin-Troitschanskaia, M. Toepper, & H. A. Pant (Eds.), Student learning outcomes assessment in higher education - ideas, approaches and concepts for research, transfer and implementation (KoKoHS Working Papers, 12) (pp. 10-12). Berlin & Mainz: Humboldt University & Johannes Gutenberg University.

Hahnel, C., Schoor, C., Kröhne, U., Goldhammer, F., Mahlow, N., & Artelt, C. (2019). The role of cognitive load for university students’ comprehension of multiple documents. Zeitschrift für Pädagogische Psychologie, 33(2), 105-118. DOI: 10.1024/1010-0652/a000238

Conference Contributions

Mahlow, N., Hahnel, C., Kröhne, U., Artelt, C., Goldhammer, F., & Schoor, C. (2021). Transmission and transaction beliefs: The factor structure of the German Reader Belief Inventory. Poster auf der 19. Biennial European Conference for Research on Learning and Instruction (EARLI), 23.-27.08.21, Gothenburg, Sweden.

Mahlow, N., Hahnel, C., Kröhne, U., Artelt, C., Goldhammer, F., & Schoor, C. (2020). Transmission and transaction beliefs: Zur Faktorstruktur des Reader Belief Inventory. Poster auf der 8. Tagung der Gesellschaft für Empirische Bildungsforschung, 25.-27.03.2020, Potsdam. https://www.conftool.pro/gebf2020/index.php?page=browseSessions&search=mahlow (Conference canceled)

Mahlow, N., Artelt, C., Hahnel, C., Goldhammer, F., Kröhne, U., & Schoor, C. (2019). More than reading competence? Findings on the understanding of multiple documents by university students. Paper auf der paEpsy-Tagung 2019, 9.-12.09.19, Leipzig.

Hahnel, C. & Schoor, C. (2019). Analyzing trace data as an approach for the investigation of central processes of reading. Symposium auf der 18. Biennial European Conference for Research on Learning and Instruction (EARLI), 12.-16.08.19, Aachen, Germany.

Schoor, C., Hahnel, C., Mahlow, N., Kröhne, U., Goldhammer, F., & Artelt, C. (2019). Processes of multiple document comprehension and their relationship to test performance. Paper auf der 18. Biennial European Conference for Research on Learning and Instruction (EARLI), 12.-16.08.19, Aachen, Germany.

Schoor, C., Hahnel, C., Mahlow, N., Kröhne, U., Goldhammer, F., & Artelt, C. (2019). The relationship of achievement goal orientations and multiple document comprehension. Paper im Rahmen des SIG 2 Invited Symposium auf der 18. Biennial European Conference for Research on Learning and Instruction (EARLI), 12.-16.08.19, Aachen, Germany.

Mahlow, N., Schoor, C., Hahnel, C., Kröhne, U., Artelt, C., & Goldhammer, F. (2019). Mehr als Lesekompetenz? – Befunde zum Verständnis multipler Dokumente von Studierenden. Vortrag auf der 7. Jahrestagung der Gesellschaft für empirische Bildungsforschung (GEBF), 25.-27.02.2019, Köln, Germany.

Hahnel, C., Kröhne, U., Goldhammer, F., Schoor, C., Mahlow, N. & Artelt, C. (2018). Representing Attention to Source Information with the Aid of Process Indicators from an Assessment of Multiple Document Comprehension. Vortrag auf dem 51. Kongress der Deutschen Gesellschaft für Psychologie (DGPs), 15.-20.09.2018, Frankfurt, Germany.

Schoor, C., Rouet, J.-F., Artelt, C., Mahlow, N., Hahnel, C., Kröhne, U., & Goldhammer, F. (2018). Task models in multiple document comprehension. Paper presented at the EARLI SIG 2 conference, 27.-29.08.2018, Freiburg, Germany.

Mahlow, N., Schoor, C., Hahnel, C., Kröhne, U., Artelt, C., & Goldhammer, F. (2018). Domain-related epistemic beliefs and their relation to multiple document comprehension. Paper presented at the 2018 Annual Meeting of the Society for Text & Discourse, 17.-19.07.2018, Brighton, UK.

Hahnel, C., Kröhne, U., Goldhammer, F., Schoor, C., Mahlow, N. & Artelt, C. (2018). Validating Process Indicators of Accessing Source Information Constructed from an Assessment of Multiple Document Comprehension. Vortrag auf der Conference of the International Test Commission (ITC), 02.-05.07.2018, Montreal, Kanada.

Schoor, C., Hahnel, C., Kröhne, U., Artelt, C., & Goldhammer, F. (2018). The relationship of achievement goal orientations and multiple document comprehension: A variable-centered and person-centered approach. Poster presented at the 2018 Annual Meeting ot the American Educational Research Association (AERA), 13.-17.04.2018, New York, USA.

Kröhne, U., Artelt, C., Goldhammer, F., Hahnel, C., Mahlow, N., & Schoor, C. (2018). Formale Definition von Indikatoren aus Log-Daten am Beispiel eines computerbasierten Tests zur Erfassung von Multiple Document Literacy. Vortrag auf der 6. Tagung der Gesellschaft für Empirische Bildungsforschung, 15.-17.02.2018, Basel, Schweiz.

Mahlow, N., Schoor, C., Hahnel, C., Kröhne, U., Artelt, C., & Goldhammer, F. (2018). Zum Zusammenhang von epistemischen Überzeugungen und kognitiven Anforderungen von Multiple Documents Literacy. Poster auf der 6. Tagung der Gesellschaft für Empirische Bildungsforschung, 15.-17.02.2018, Basel, Schweiz.

Schoor, C., Hahnel, C., Artelt, C., Kröhne, U., & Goldhammer, F. (2018). Entwicklung und Skalierung eines Tests zur Erfassung des Verstehens multipler Dokumente von Studierenden. Vortrag auf der 6. Tagung der Gesellschaft für Empirische Bildungsforschung, 15.-17.02.2018, Basel, Schweiz.

Hahnel, C., Schoor, C., Kröhne, U., Goldhammer, F., & Artelt, C. (2017). Lassen sich theoretisch angenommene Prozesse im multiplen Textverstehen auch empirisch wiederfinden? Vortrag auf der 5. Tagung der Gesellschaft für Empirische Bildungsforschung (GEBF) 2017, 13.-15.03.2017, Heidelberg.

Hahnel, C., Kröhne, U., Goldhammer, F., Schoor, C., Artelt, C., Reimann, D., Lockl, K., & Roßbach, H.-G. (2016). Using process data from log files to explain measures of multiple documents literacy (MDL). Paper presented at the EARLI SIG 27 conference, 29.11.-01.12.2016, Oulu, Finland.

Schoor, C., Artelt, C., Reimann, D., Hahnel, C., Kröhne, U., & Goldhammer, F. (2016). Development of a test assessing multiple document comprehension of university students. Paper presented at the MDL workshop, 14.-15.11.2016, Paris, France.