If you follow open education news, you probably heard over the summer that AAC&U recognized Open Educational Resources (OER) as a High-Impact Practice (HIP). OER’s addition to the roster of 12 teaching and learning practices means AAC&U has deemed there to be “…significant educational benefits for students who participate in them—including and especially those from demographic groups historically underserved by higher education.” To achieve the requisite degree of evidence, AAC&U commissioned what it describes as “the largest examination of OER to date.” Over two years, their research team examined around 700,000 student records along with qualitative responses from over 200 instructors who had implemented OER in their courses, drawn from 15 institutions across six Carnegie classifications.
This project has major implications for the future of open education in the U.S., not only as the path to OER’s recognition as a HIP, but also via rich, multifaceted data that requires so much labor to collect and analyze at scale. The insights from this study are valuable both as rationale for institutional support of OER and as practical considerations for open education advocates and instructors. Whether you consider open education a passion, a moral obligation, or a job responsibility, the full report is worth a deep dive. (And a quick unsolicited plug for Open Education Conference, where the AAC&U team shared early results from this study last year). My institution has an office dedicated to promoting HIPs on campus, as I imagine is true at many other colleges and universities. The opportunity to embed support for open education beyond traditional advocacy units (e.g. libraries, teaching centers) may be truly game-changing at institutions where that hasn’t yet happened.
Heather Miceli, Assistant Director of the Institute on Open Educational Resources and a Postdoctoral Research Fellow at AAC&U, kindly answered a few questions about their study and High-Impact Practices for ACRLog.
I’m sure there are many possible practices that could be studied as potential high-impact practices. Why OER? In other words, what led to the initiation of this study, including but also beyond the guiding research questions?
Open Education, as we know it currently, is celebrating a milestone anniversary this year. Twenty-five years, a quarter of a century. And yet, the practice is still fairly siloed, sometimes completely unknown to faculty and instructors whose students would benefit from even just the affordability argument. However, we knew from multiple smaller scale studies that the potential to impact student success was there. But we also knew that there were small sample sizes, confounding variables, and conflicting results. So, we decided to take a shot at trying to gather as much data as possible, from as many different types of institutions as possible, to push forward the conversation on how OER impact student success. At the same time, one of the foundation pieces of high-impact practices (HIPs) is that they are most impactful “when done well.” We wanted to capture the instructor experience and connect it as much as we could with what we were seeing in the quantitative data.
The report describes some differences in instructors’ experiences between those who adopted an OER without revision vs. those who revised, remixed, or created OERs. How would you summarize/synthesize some those differences and what they might mean for librarians who support instructors making course material decisions?
We found considerable evidence across multiple contexts that when instructors choose to revise, remix, or create their own OER (high-level implementation), the withdrawal rates in the course are significantly lower than those who chose to simply adopt (low-level implementation). We attribute this to the fact that higher-level implementation of OER allows instructors to customize the texts specifically for their students, courses, and context – which has been shown in the literature to have a positive impact on student belonging and success.
We also found some interesting correlation in the instructor survey around high- vs. low-level implementation. 52% of instructors that simply adopted their OER as is were externally motivated, meaning that they were required to adopt the text by the institution or the department, as opposed to only 12% that revised/remixed/created their OER. Of those that adopted because they were externally motivated, 34% perceived their first implementation went poorly. We also found that 31% of those who adopted and had no support also perceived their first implementation as poor. These results did not surprise us—we know that support and internal motivation are going to be key variables in the quality of implementation. However, when we looked at instructors who adopted and who perceived their first OER implementation to be poor, we found that they overwhelmingly did not engage in any other teaching practice changes as a result of using OER.
Could you highlight a few other takeaways from the study that might be especially relevant to librarians and other open education advocates?
One of the most significant findings was that at doctoral institutions, withdrawal rates decreased at much higher rates than any of the other institutions when OER was implemented. It was especially impactful for students with a high intersectionality of historically minoritized characteristics. Doctoral institutions are likely the most heterogenous institutions in our study, and this result suggests that OER, on its own, could be a compelling retention strategy for students in their first year courses (the majority of courses in our sample from doctoral institutions were lower-level courses).
In terms of grades, we found that A grades increased across the board, with a small increase also in F grades—we attribute the increase in F grades to students finishing a course when without OER, they might have withdrawn from the course, putting their enrollment in jeopardy.
A frankly jaw-dropping finding at community colleges was that when students who had been enrolled for 4 or more years took 6 or more OER courses, their time-to-completion dropped by over a calendar year. This finding shows that institutionalized OER could be a monumental strategy in shortening time-to-completion for nontraditional students.
With the understanding that their operationalization might look different campus-to-campus, why does it matter for something to be recognized as a high-impact practice by AAC&U? What opportunities can that recognition present?
Since their inception almost twenty years ago, high impact practices (HIPs) have shaped the experiences of millions of students in the US and abroad. We know that when students participate in HIPs, especially those from historically minoritized groups in higher education, they report positive cumulative, additive effects on student success. However, when you look at the list of HIPs, a lot of the experiences require time and resources that aren’t available to all students. For example, not all internships are paid, and there are many students who can’t afford to give their free labor to companies to advance their education; study abroad programs are inaccessible to students that have familial or parenting responsibilities. So, we are starting to look to the future of HIPs knowing that a practice that is included on this list is valued highly by administrators and curriculum developers, so much so that some institutions require participation in HIPs for graduation. We hope that in adding OER to the list, with substantial evidence to support their use in many contexts, we can begin to see a shift towards further institutionalization of OER on campuses, including the necessary instructor support to ensure optimal implementation.
Thank you to Heather for her responses, and thank you to Heather and her research team for this study. We may not understand the full scope of this work’s impact on the field for a while, but I expect it will be significant.