Signed in as:
filler@godaddy.com
Signed in as:
filler@godaddy.com
Look below to see samples of Loraine's education research and evaluation work. Each project demonstrates key skills in Loraine's repertoire.
Previous research has shown that building "meta" skills in learners with differences or disadvantages can lead to measurable impacts on learning, with effects equal to or higher than many other types of programs. Metacognitive and self-regulated learning programs focus on self-awareness, deep dialogue, and strategic problem-solving, which are key to mathematics growth. In this project, Loraine systematically sorted through thousands of research reports and meta-analyzed 60 well-designed studies to determine the overall effects of MC/SRL training programs on K-12 students' math performance.
As the map above shows, nearly half of the studies were done in the US, while the Middle East and Western Europe also contributed a large number of experiments and quasi-experiments in this area. An explicit MC/SRL focus and reporting the study in English were required for inclusion in the review, which limits how geographic trends are interpreted. Still, it appears there is a lack of evidence on the effectiveness of MC/SRL programs in mathematics in some regions of the world, indicating a need for further research that takes context into account.
This graph shows the types of activities most commonly used in the synthesized studies to train "meta" skills in mathematics. During-task reflection and control activities were the most common, and these were usually practiced while solving realistic problems. Students learned metacognitive questions for prompting their next problem-solving steps, for example. Prompts were also embedded into digital problem-solving activities in some studies. Metacognition and self-regulated learning were also trained through pre- and post-task activities, such as planning strategies and reflecting on learning or performance. Verbalizing thinking through discussion or writing, as well as modelling a mathematical situation, were also highly used program activities.
Sixty studies between 2005 and 2019 that trained "meta" skills and had mathematics achievement outcomes were statistically combined in a meta-analysis. For each study, the table above shows the effect size given in standard deviation units, the standard error, and the number of participants. The studies can be ordered by any of these measures by clicking on the column labels. This table shows no consistent relationship between effect size and standard error or sample size, but the most "effective" studies often featured smaller samples. As with other educational interventions, there may be challenges in "scaling-up" effective metacognitive training programs.
Loraine's Ed.D. Thesis from Durham University (pdf)
DownloadThe full report of this research synthesis project is above, but Loraine's research skill-set encompasses much more. Research design and methods should be tailored to the educational stakeholders and question or problem under focus, and Loraine will be happy to walk through these decisions with you. Contact her today!
Loraine worked with a small, liberal-arts college with a growing engineering program to draft an evaluation plan for an NSF grant proposal. Throughout the six years of awarded funding, Loraine is also acting as internal evaluator, giving timely feedback on the program to ensure its success.
In this multi-component program, engineering students would be supported through scholarships as well as a complex system of supports. Based on previous students' internship and research experiences, it seemed these were key in developing academic self-efficacy and identity as engineers, yet many students left the engineering major prior to reaching them. Key elements of the grant-funded program would be a tailored course schedule, academic support and mentoring, and early internship and research experiences. With a small budget for evaluation, Loraine was instrumental in determining the near- and long-term outcomes, clarifying the essential processes, and drafting a realistic and thoughtful evaluation plan, which was a highlight of the accepted proposal.
In addition to offering scholarships for engineering students with unmet financial needs, this program is under-girded by Bandura's Social-Cognitive Career Theory and by the unique roles of program staff, industry partners, and students themselves. In consultation with the project team, Loraine prepared several drafts of the logic model, shown above, to communicate how different people and elements interact within the program to produce the intended outputs and outcomes. The final version included industry partners as important stakeholders and actors in the program. Clarifying the program logic fed back into the grant proposal development, and Loraine's ongoing internal evaluation will also be used to update the logic model.
“This material is based upon work supported by the National Science Foundation under Award No. 2325921. Any opinions, findings and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the National Science Foundation.”
We use cookies to analyze website traffic and optimize your website experience. By accepting our use of cookies, your data will be aggregated with all other user data.