Module 2: APPLYING LKT IN PRACTICE
APPLYING LKT IN PRACTICE
LASER INSTITUTE KT TRACK BADGE ACTIVITY
- Please write a short essay and cite a external paper in response to the following question. How could you apply Logistic Knowledge Tracing to solve (just one) real problem in your research or in practice, that BKT wouldn’t be as good for?
What specific problem are you addressing?
What features of LKT make it particularly suitable for this problem?
How does LKT’s ability to incorporate item difficulty parameters help?
What limitations of BKT make it less suitable for your chosen problem?
- Input that essay to ChatGPT 4 or another Large Language Model of your preference, following the initial prompt:
You are Phil Pavlik, a researcher with extremely detailed knowledge of Logistic Knowledge Tracing and Performance Factors Analysis and an expert on its use within research and in intelligent tutoring systems. Please give feedback on the following essay written by an advanced doctoral student. Please give them feedback on the core ideas and their application on the research or real-world problem; do not give academic paper such as a recommendation to add citations. Please do not give recommendations around functionality that does not exist in LKT (e.g. engagement tracking), and do not make recommendations that apply to every knowledge tracing (e.g. paying attention to student privacy). Give only constructive, negative feedback:What were the main criticisms from the “expert researcher” perspective?
Which feedback points address fundamental misunderstandings of LKT?
How would you modify your essay to address these concerns?
What aspects of LKT did you potentially oversimplify or misrepresent?
- How would you modify your essay, if at all, in response to that feedback?
- Input your modified essay to ChatGPT 4 or another Large Language Model of your preference, following the initial prompt:
You are an award-winning teacher who has developed curricula which leverage Performance Factors Analysis and has spent thousands of hours watching and interacting with students using those curricula. Please give feedback on the following essay written by an advanced doctoral student. Please give them feedback on the core ideas and their application on the research or real-world problem; do not give academic paper such as a recommendation to add citations. Do not make scientifically inaccurate recommendations, such as recommending paying attention to learning styles. Give only constructive, negative feedback:How did the practitioner’s concerns differ from the researcher’s?
What practical implementation challenges were identified?
Which feedback points relate to student experience vs. technical accuracy?
How can you balance theoretical accuracy with practical applicability?
- How would you modify your essay, if at all, in response to that feedback?
Input your modified essay to ChatGPT 4 or another Large Language Model of your preference, following the initial prompt:
You are Maria, a thoughtful and highly intelligent 9th grade student who nonetheless sometimes forgets what she learned in class. You have just spent the last three weeks using a learning system in class, described by the following prompt. You have been asked to give your reflections on that learning system and how to make it better. Do not make scientifically inaccurate recommendations, such as recommending paying attention to learning styles. You say:
(If this prompt does not fit your context of use, please modify it to make it fit!)What aspects of the student experience did you not initially consider?
How might the student’s perspective inform your implementation design?
What trade-offs exist between model accuracy and user experience?
How would you modify your approach to address student concerns?
- How would you modify your essay, if at all, in response to that feedback?