Händel, Marion (2026)
Vortrag auf der bidt Digital Transformation Research Conference.
Naujoks-Schober, Nick; Händel, Marion (2026)
Votrag auf der bidt Digital Transformation Research Conference.
Händel, Marion (2026)
Forschungskolloquium Psychologie der PH Weingarten.
Händel, Marion (2026)
Akademie für Lehrerfortbildung und Personalführung, Lehrerfortbildung Online.
Biller, Simon; Händel, Marion (2026)
Digitale Kommunikation & Leadership: Ergebnisse des Projektverbunds LeadCom 6, 81-92.
DOI: 10.31244/9783818851712
Händel, Marion; Valentin, Katrin; Regelous, Annette (2026)
Zeitschrift für internationale Bildungsforschung und Entwicklungspädagogik 49 (03), 28–34.
DOI: 10.20377/zep-99
Malzahn, Jasmin; Händel, Marion (2026)
54. DGPs-Kongress.
Naujoks-Schober, Nick; Händel, Marion (2026)
Vortrag auf der EARLI SIG 6 & 7 Conference, August 2026.
What do students know about self-regulated learning with GenAI? A situational judgment test
Authors: Nick Naujoks-Schober & Marion Händel
Abstract
The rapid diffusion of generative artificial intelligence (GenAI) tools such as ChatGPT is reshaping students’ self‑regulated learning (SRL) practices, yet little is known about learners’ conditional knowledge for strategically employing these technologies. To address this gap, we developed and preliminarily validated a situational judgment test that measures students’ strategic knowledge of interacting with GenAI across two typical higher‑education learning scenarios. Following a multi‑step design, we (1) conducted a literature review to identify the most frequent cognitive, metacognitive, and resource‑oriented learning situations involving GenAI; (2) performed problem‑centered interviews with 18 students from eight disciplines to elicit real‑world strategies; and (3) refined these strategies into 36 items spanning the forethought, performance, and self‑reflection phases of SRL for two generic scenarios—planning a study project and creating a summary. Experts (N = 48 SRL scholars and AI specialists) rated the usefulness of each strategy on a six‑point Likert scale, yielding significant pairwise discriminations for the majority of items (28/36 for the summary scenario, 21/36 for the planning scenario). The situational judgment test thus captures conditional knowledge of SRL‑GenAI interaction, offering a robust instrument for assessing metacognitive competence beyond self‑report AI‑literacy measures. Findings will inform educators on students’ knowledge about SRL with GenAI and may guide interventions to foster effective, reflective AI‑enhanced learning.
1. Introduction and aims
According to models of self-regulated learning (SRL), students should actively manage their learning processes using situation-specific learning strategies (Panadero, 2017). To employ the most effective strategy in a given context, students require conditional knowledge regarding their strategy use. To assess this knowledge, situational judgment tests compare students’ evaluations of strategy usefulness in realistic, hypothetical learning scenarios against expert benchmarks (Dörrenbächer-Ulrich et al., 2024; Pfost & Hübner, 2025).
However, the rapid rise of generative artificial intelligence (GenAI) applications, such as ChatGPT, is transforming learning scenarios and strategies associated with student SRL (Chiu, 2024). Current research discusses potential benefits of integrating GenAI into higher education for individualizing learning, for instance, through quizzes generated with students’ lecture notes (Dillon, 2024; Gärtner et al., 2024). Conversely, first studies highlight challenges in SRL with GenAI as students may delegate tasks too extensively to the AI (cognitive offloading; Lee et al., 2025) or insufficiently monitor their own learning and interaction with the AI (metacognitive laziness; Chardonnens, 2025; Fan et al., 2025).
According to the current state of research it is unclear whether students possess the strategic knowledge necessary to successfully interact with GenAI during self-regulated learning. Previous measurement instruments to assess AI literacy have focused either on students' self-reports (Almatrafi et al., 2024) or on their knowledge about GenAI specifications (Markus et al., 2025). We therefore aimed to develop and validate a situational judgment test to assess students’ knowledge of how to strategically interact with GenAI during their self-regulated learning.
2. Method
To develop a situational judgment test, we followed a multi-step procedure: (1) We performed a literature search to identify scenarios of leaning with GenAI, (2) we conducted problem-centered interviews with students to select relevant scenarios and to identify strategies to interact with GenAI across different disciplines, and (3) we obtained expert ratings on the consequently developed situational judgment test.
Based on 60 publications, we extracted the three most frequent cognitive, metacognitive, and resource-oriented scenarios. Those scenarios were used for problem-centered interviews with students to analyze their strategy use during GenAI interactions. Using a maximum-variation sampling approach, interviews were held with 18 students across eight different study programs. Students were interviewed regarding their learning behavior when interacting with GenAI. Drawing on the Self-Regulated Learning Interview Schedule (Zimmerman & Pons, 1986), participants first rated the relevance of nine given scenarios (e.g., using GenAI to create a summary) regarding their own learning. Next, students described their strategic approach for those scenarios that they had rated as relevant. Both the content and usefulness of the reported strategies were coded using qualitative content analysis (Mayring & Fenzl, 2019), employing both inductive category development and deductive assignment to overarching learning strategy categories.
In the next step, we extracted strategies for the most relevant scenarios from the interviews. These strategies were iteratively refined according to low, middle, and high usefulness based on the degree of students’ (meta-)cognitive activity and the suitability of the GenAI. This final test was given to experts from the fields of self-regulated learning (N = 31) and/or artificial intelligence (N = 17) who rated the usefulness of the strategies on a 5-point Likert scale from 1 (very low) to 5 (very high).
3. Results
Identification of scenarios. From the literature review, both discipline-specific and cross-disciplinary scenarios and strategies were identified. Especially the generic scenarios provided a solid foundation for the development of the situational judgment test, which is intended to be applicable to students across all fields.
Development of the situational judgment test. Two of the most relevant and generic scenarios for learning with GenAI were selected for the test, namely planning a study project and creating a summary. For each scenario, strategy options were identified from the interviews that differed in terms of their quality and usefulness for learning purposes. In line with Zimmerman's model (1986), each scenario was structured along the three phases of self-regulated learning. That is, the forethought phase before planning (p)/summarizing (s), the performance phase during p/s, and the self-reflection phase after p/s. For each scenario and each phase, six strategies were developed, resulting in 36 strategies differing in usefulness.
Usefulness of strategies (expert ratings). Initial descriptive observations of the expert ratings and two-factor variance analyses for Friedman ranks in connected samples indicate theoretically valid and significant pair comparisons of the strategies. Across all phases of the summary scenario, the expert ratings confirmed 28 out of 36 pair comparisons. In the planning scenario, however, the expert judgments showed only 21 valid pair comparisons. At the time of the conference, data from a student sample from different disciplines will be available, which allows for an initial validation of the test instrument.
4. Theoretical and educational significance of the research
This research addresses the rapidly changing learning behavior shaped by GenAI, where SRL competencies are becoming increasingly vital for actively engaging in and maintaining an overview of one's own learning process. Additionally, by using typical scenarios in higher education and comparing student and expert ratings, the developed test goes beyond current self-reports of AI literacy and knowledge tests about GenAI. In doing so, the situational judgment test also captures an aspect of higher metacognitive skills through conditional knowledge of strategy use, which is often overlooked in other operationalizations of AI literacy (Almatrafi et al., 2024). As metacognitive monitoring and learners’ cognitive engagement seems central for self-regulated learning with GenAI interaction, the situational judgment test should provide a robust measure even against the rapid development of GenAI models.
Assessing conditional knowledge for strategic learning with GenAI also provides educators with an estimate of the learners’ existing competence in this regard. Based on students' answers, it will also be possible to identify how students consider GenAI useful across different learning scenarios. These insights reveal, for example, whether pure task outsourcing is considered more useful than targeted co-constructive processes, and whether students recognize their own (meta-)cognitive activity as a central element. Future research will focus on how students can be supported in their interactive process with GenAI.
5. References
Almatrafi, O., Johri, A., & Lee, H. (2024). A systematic review of AI literacy conceptualization, constructs, and implementation and assessment efforts (2019–2023). Computers and Education Open, 6, 100173. https://doi.org/10.1016/j.caeo.2024.100173
Chardonnens, S. (2025). Adapting educational practices for Generation Z: Integrating metacognitive strategies and artificial intelligence. Frontiers in Education, 10, Article 1504726. https://doi.org/10.3389/feduc.2025.1504726
Chiu, T. K. F. (2024). A classification tool to foster self-regulated learning with generative artificial intelligence by applying self-determination theory: A case of ChatGPT. Educational Technology Research and Development, 72(4), 2401–2416. https://doi.org/10.1007/s11423-024-10366-w
Dillon, T. (2024). Korean university students’ prompt literacy training with ChatGPT: Investigating language learning strategies. English Teaching, 79(3), 123–157. https://doi.org/10.15858/engtea.79.3.202409.123
Dörrenbächer-Ulrich, L., Sparfeldt, J. R., & Perels, F. (2024). Knowing how to learn: Development and validation of the strategy knowledge test for self-regulated learning (SKT-SRL) for college students. Metacognition and Learning, 19(2), 1–45. https://doi.org/10.1007/s11409-024-09379-w
Fan, Y., Tang, L., Le, H., Shen, K., Tan, S., Zhao, Y., Shen, Y., Li, X., & Gašević, D. (2025). Beware of metacognitive laziness: Effects of generative artificial intelligence on learning motivation, processes, and performance. British Journal of Educational Technology, 56(2), 489–530. https://doi.org/10.1111/bjet.13544
Gärtner, C., Moraß, A., Koss, S., Garbusa, S., Matern, S., Innermann, I., & Forschungs- Und Innovationslabor Digitale Lehre, F. (2024). Einsatz, Nutzen und Grenzen von ChatGPT und anderen Large Language Modellen an den bayerischen HAWs (No. 5; Die Studien- und Schriftenreihe des Forschungs- und Innovationslabors Digitale Lehre – FIDL). FIDL – Forschungs- und Innovationslabor Digitale Lehre. https://doi.org/10.34646/THN/OHMDOK-1466
Lee, H.-P. (Hank), Sarkar, A., Tankelevitch, L., Drosos, I., Rintel, S., Banks, R., & Wilson, N. (2025). The impact of generative AI on critical thinking: Self-reported reductions in cognitive effort and confidence effects from a survey of knowledge workers. Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems, Article 1121. https://doi.org/10.1145/3706598.3713778
Markus, A., Carolus, A., & Wienrich, C. (2025). Objective measurement of AI literacy: Development and validation of the AI competency objective scale (AICOS). Computers and Education: Artificial Intelligence, 9, 100485. https://doi.org/10.1016/j.caeai.2025.100485
Mayring, P., & Fenzl, T. (2019). Qualitative Inhaltsanalyse. In N. Baur & J. Blasius (Eds.), Handbuch Methoden der empirischen Sozialforschung (pp. 633–648). Springer Fachmedien Wiesbaden. https://doi.org/10.1007/978-3-658-21308-4_42
Panadero, E. (2017). A review of self-regulated learning: Six models and our directions for research. Frontiers in Psychology, 8, Article 422. https://doi.org/10.3389/fpsyg.2017.00422
Pfost, M., & Hübner, V. (2025). Assessment of strategic knowledge of learning from errors in higher education. Diagnostica, 71(2), 53–63. https://doi.org/10.1026/0012-1924/a000341
Zimmerman, B. J. (1986). Becoming a self-regulated learner: Which are the key subprocesses? Contemporary Educational Psychology, 11(4), 307–313. https://doi.org/10.1016/0361-476x(86)90027-5
Zimmerman, B. J., & Pons, M. M. (1986). Development of a structured interview for assessing student use of self-regulated learning strategies. American Educational Research Journal, 23(4), 614–628. https://doi.org/10.3102/00028312023004614
Fritzsche, Eva S.; Roll, Anika; Rahm, Hendric; Mike, Altieri; Gerner, Verena; Sept, Alexandra; Hösl, Romy (2026)
Fritzsche, Eva S.; Roll, Anika; Rahm, Hendric; Mike, Altieri; Gerner, Verena...
In: Fritzsche, E., Krumme, J., Dieckhoff, C., Böhm, C., Botzum, E., Murry, G. (eds) Zukunftskompetenzen entwickeln. Studierende in der digitalen Transformation begleiten. Waxmann Verlag GmbH, Münster.
DOI: 10.31244/9783818851682
Groß-Mlynek, Lena; Bastian, Jasmin; Biller, Simon; Händel, Marion (2026)
MedienPädagogik: Zeitschrift für Theorie und Praxis der Medienbildung (Jahrbuch Medienpädagogik) 23, 1-27.
DOI: 10.21240/mpaed/jb23/2026.07.23.X
Messenger-Dienste gewinnen als Kommunikationsmedium im schulischen Alltag an Bedeutung; gleichzeitig ist ihr Einsatz zwischen schulinterner Abstimmung und Kommunikation mit Eltern unterschiedlich gerahmt und umstritten. Der Beitrag untersucht auf Basis einer Online-Befragung von Lehrpersonen (N = 250) die Nutzungshäufigkeit, genutzte Dienste, als passend eingeschätzte Kommunikationsanlässe sowie Nutzungsintentionen differenziert nach interner schulischer Kommunikation und Elternkommunikation. Die Ergebnisse zeigen eine sehr hohe Nutzung von Messengern für die schulinterne Kooperation (mehrheitlich täglich oder mehrmals pro Woche), während Messenger für die Kommunikation mit Eltern deutlich seltener eingesetzt werden. In der internen Kommunikation werden neben schulischen Plattformlösungen auch verbreitete Drittanbieter genutzt. In der Elternkommunikation dominieren hingegen Messenger-Funktionen schulischer Plattformen. Messenger werden vor allem für organisatorische und informationsbezogene Anliegen als geeignet eingeschätzt, während für sensible Themen (z. B. Konfliktklärung, leistungsbezogenes Feedback) die Zustimmung deutlich geringer ist. Die Nutzungsintention fällt für interne Kommunikation signifikant höher aus als für Elternkommunikation und hängt zumindest für die schulinterne Nutzung positiv mit der selbsteingeschätzten digitalen Kommunikationskompetenz zusammen. Basierend auf den individuellen (Alter, Geschlecht) und schulartspezifischen Unterschieden in der Messenger-Nutzung sprechen die Befunde für eine funktionale, anlassbezogene Nutzung und unterstreichen den Bedarf an schulischen Rahmenkonzepten (Zuständigkeiten, Regeln, Reaktionszeiten, Datenschutz), um Entgrenzung und Missverständnisse zu reduzieren und gleichzeitig Effizienzpotenziale zu nutzen.
Wiedenhöft, Carina; Kaindl, Anna; Durst, Carolin; Piazza, Alexander (2026)
HMD Praxis der Wirtschaftsinformatik.
DOI: 10.1365/s40702-026-01302-y
Social Media spielt eine zentrale Rolle in der Unternehmenskommunikation und erfordert ein systematisches Verständnis von Plattformdynamiken, datengestützten Entscheidungen und neuen Technologien. Zudem verändert der Einsatz von Künstlicher Intelligenz Themen wie Content-Erstellung, Zielgruppenansprache und Kampagnenoptimierung und wirft zugleich Fragen hinsichtlich deren strategischer Nutzung auf. Der vorliegende Beitrag stellt die Ergebnisse einer Studie vor, die aufzeigt, wie Social-Media-Verantwortliche die Entwicklungen im Arbeitsalltag wahrnehmen und gestalten. Im Fokus stehen dabei Plattformwahl, KI-Einsatz und strategische Priorisierung. Die dafür zugrunde liegende Online-Befragung wurde unter Social-Media Verantwortlichen von April bis Juni 2025 durchgeführt. Die Ergebnisse zeigen, dass durchschnittlich 4,5 Plattformen parallel betreut wer den, wobei Instagram, Facebook und LinkedIn dominieren. Zeitgleich erhöhen neu aufkommende Plattformen und Formate zunehmend die Komplexität. KI-Tools wer den vorwiegend für operative Aufgaben genutzt, wie Content-Erstellung, Social Listening und Kundenservice. Strategische Anwendungen sind unterrepräsentiert und auch das Potenzial für die operative Nutzung wird noch nicht optimal aus geschöpft. Zeitgleich zeigen sich klare Defizite in der strategischen Verankerung: Lediglich 43% der Befragten sind mit ihrer Social-Media-Strategie zufrieden und die Erfolgsmessung wird vor allem über operative Kennzahlen durchgeführt, wobei der wirtschaftliche Beitrag dabei häufig unklar bleibt. Die Studie verdeutlicht damit ein klares Spannungsfeld zwischen steigender Komplexität, zunehmendem Technikeinsatz und unzureichender strategischer Integration. Daraus werden schließlich zentrale Handlungsfelder für ein effektives Social-Media Management abgeleitet.
Händel, Marion; Naujoks-Schober, Nick; Kamath Barkur, Sudarshan (2026)
DGPs-Veranstaltung "Künstliche Intelligenz menschzentriert gestalten" in Berlin.
Kühnlenz, Barbara; Klug, Katharina; Lutz, L.; König, E.; Matisic, M.; Leutz, M.; Piazza, Alexander; Kühnlenz, Kolja E. (2026)
Kühnlenz, Barbara; Klug, Katharina; Lutz, L.; König, E.; Matisic, M.; Leutz, M....
IEEE International Conference on Advanced Robotics and its Social Impact (ARSO) 2026, Vienna, Austria, 271-274.
This position paper investigates the effects of media induced expectations and perceived control on the accep-tance of a social robot in a 2x2 between-subjects laboratory pre-study that simulates a medical history interview in the emer-gency room of a hospital. 52 participants are presented with a priming media report beforehand, conveying either a positive or negative view of robotics and artificial intelligence in the con-text of data privacy to induce either positive or negative expec-tations. Subsequently, the participants interact with the avatar of a social robot either with or without a choice of sharing their own sensitive data. Acceptance was then assessed using a post-reception questionnaire. Results indicate a significant increase of perceived safety by positive priming on the one hand, and - in combination with providing cognitive control in view of sensitive data protection - a significant raise of trust in and subjective performance assessment of the robot, on the other hand.
Rais, Mohammed C.; Kühnlenz, Barbara; Kühnlenz, Kolja E. (2026)
IEEE International Conference on Advanced Robotics and Its Social Impacts (ARSO) 2026, Vienna, Austria, 292-295.
In this paper, we analyze data from a study [10] on cognitive load dependency of anthropomorphism towards exploring the strength of the association of negative attitudes towards robots and anthropomorphism under cognitive load induction by a secondary task. A cooperative pick-and-place study with a non-social robot arm was conducted as main task and number memorization as secondary task inducing extraneous cognitive load. Even though ANCOVA results are insignificant, correlations show an interesting trend of weaker association of anthropomorphism and negative attitudes towards emotions in interaction with robots under high cognitive load. So, the positive association of cognitive load and anthropomorphism to some extent seems to compensate the negative association of negative attitudes and anthropomorphism, which may be explained by lack of inhibition of the default social cognitive pathway in the human brain due to depletion of cognitive resources. Thus, both parameters should be considered in robot design, especially in applications, where the impact of anthropomorphism on collaboration may pose performance or safety issues, e.g. close interaction, and further research is suggested.
Paper Session H: Brain, Cognition and Human Behavior.
Kühnlenz, Barbara (2026)
Paper Session H: Brain, Cognition and Human Behavior.
Walter, Ismeni (2026)
Vortrag im Rahmen des Pride Month im Naturmuseum Südtirol.
Baumert, Anna; Sasse, Julia (2026)
Law, Behavior, and Decision – Recht, Verhalten und Entscheidung: Festschrift zum 70. Geburtstag von Christoph Engel 2026, 119-132.
DOI: 10.5771/9783748947257
Empirische Rechtswissenschaft im Fokus: Dieses Buch bietet einen fundierten Überblick über Stand und Perspektiven interdisziplinärer Rechtswissenschaften. Von Verfassungs-, Europa-, Kartell- und Strafrecht über richterliches Entscheidungsverhalten bis hin zu Fragen von Politikberatung, Arbeitsmärkten und Gemeinschaftsgütern entfalten die Beiträge ein breites thematisches Spektrum. Zugleich zeigen sie, wie Verhaltenswissenschaften, datengetriebene Methoden und Künstliche Intelligenz unser Verständnis des Rechts vertiefen und verändern. Sie zeichnen dabei auch das Wirken von Christoph Engel, Direktor am Max-Planck-Institut zur Erforschung von Gemeinschaftsgütern, nach.
Kühnlenz, Kolja E.; Blattner, Jonas; El-Mejbri, Mohammed Dayyene; Hessner, Benedikt; Janssen, Meret; Lindner, Karl; Resch, Constantin ; Schippers, Louisa; Schmitt, Florian; Schmitt, Jana Barbara; Sommerer, Max; Thau, Simon; Zuniga, Julien; Kühnlenz, Barbara (2026)
Kühnlenz, Kolja E.; Blattner, Jonas; El-Mejbri, Mohammed Dayyene; Hessner, Benedikt...
IEEE International Conference on Advanced Robotics and its Social Impacts (ARSO) 2026, Vienna, Austria, 265-270.
DOI: 10.1109/ARSO68304.2026.11536135
This paper explores whether cognitive load affects intervention behavior of a driver in terms of taking control of the driving situation in autonomous driving. A video of a simulated autonomous driving scenario from a driver's perspective including critical situations is presented to the participants. In parallel, extraneous cognitive load is induced by letting participants mentally solve arithmetic problems as a secondary task. Whenever participants feel that they want to intervene and take control of the driving situation, they are required to press the button of a stopwatch. In contrast to expectations of increased impulsive behavior, results reveal an inverse association of cognitive load and counts of interventions paired with increased trust in the autonomous vehicle, but reduced perceived safety and situation awareness. This behavior may be explained with impaired switching of attentional focus and lack of possibility of internalization of the primary task under depletion of cognitive resources. The observed effects are suggested to be accounted for towards shared autonomy concepts in order to promote the design of safe autonomous vehicles and their integration in society.
Hahn, A; Klug, Katharina; Meier, M.; Schiele, N.; Weigel, F. (2026)
Marketing Review St. Gallen 2026 (3), 76-84.
In today’s fast-paced digital environment, it is essential for marketing professionals to allocate advertising budgets efficiently and maximize return on investment. By leveraging machine learning, particularly regression trees, key success metrics such as cost per click in online advertising campaigns can be predicted and optimized, enabling more effective budgeting decisions in marketing performance optimization. Showcasing a practical use case with a synthetic data set, this study outlines the relevant phases in applying ML to campaign optimization and demonstrates that the advantages of regression trees lie in their transparency and interpretability. Compared to more complex AI models, the results of regression trees are easier for managers to understand and translate into concrete actions. For instance, the models help managers to understand ad effectiveness of specific ad design and campaign decisions before they run costly live tests on ad platforms. Furthermore, the models allow for lean analysis of ad effectiveness across platforms. Finally, they allow capturing nonlinear effects of ad design and campaign decisions on ad effectiveness, thus avoiding overly simplistic analysis results. Therefore, this study shows the application of regression trees, as step-by-step guide for managers and actionable implications, especially for small- and medium sized enterprises adopting AI in marketing.
Hochschule Ansbach