A Call to Develop Course-Based Undergraduate Research Experiences (CUREs) for Nonmajors Courses.

Course-based undergraduate research experiences (CUREs) for non-science majors (nonmajors) are potentially distinct from CUREs for developing scientists in their goals, learning objectives, and assessment strategies. While national calls to improve science, technology, engineering, and mathematics education have led to an increase in research revealing the positive effects of CUREs for science majors, less work has specifically examined whether nonmajors are impacted in the same way. To address this gap in our understanding, a working group focused on nonmajors CUREs was convened to discuss the following questions: 1) What are our laboratory-learning goals for nonmajors? 2) What are our research priorities to determine best practices for nonmajors CUREs? 3) How can we collaborate to define and disseminate best practices for nonmajors in CUREs? We defined three broad student outcomes of prime importance to the nonmajors CURE: improvement of scientific literacy skills, proscience attitudes, and evidence-based decision making. We evaluated the state of knowledge of best practices for nonmajors, and identified research priorities for the future. The report that follows is a summary of the conclusions and future directions from our discussion.

INTRODUCTION

Science educators face the unique challenge of engaging large undergraduate populations with diverse educational backgrounds and interests in science, technology, engineering, and mathematics (STEM). Previous work has demonstrated the positive influence of individual undergraduate research experiences on students’ performance and attitudes (Lopatto, 2007; Russell ; Hanauer and Hatfull, 2015), but such opportunities are typically not scalable or widely accessible. However, course-based undergraduate research experiences (CUREs) meet this need to expand research experiences to a larger number of students. CUREs are laboratory-learning environments that involve an entire class in the investigation of an original research question that has broad scientific importance (Auchincloss ; Bangera and Brownell, 2014). While CUREs have historically been developed with the aim to increase persistence and interest in science for majors, there is recent interest in exploring the impact of CUREs on non–science majors, or nonmajors. Previous work demonstrates a multitude of differences between majors and nonmajors (Sundberg and Dini, 1993; Sundberg ; Klymkowsky, 2005; Nehm and Reilly, 2007; Cook and Mulvihill, 2008; Knight and Smith, 2010; Cotner ), so a consideration of these differences will be important to achieve desired student outcomes and highlight research priorities for nonmajors CUREs. Because nonmajors may not need the lab- or field-specific skills taught in a CURE in their future careers, it is not our objective to train nonmajors to become scientists. However, they may acquire select skills, such as associated learning gains, from classroom and laboratory experiences that improve their perceptions of the discipline and increase science literacy. Previous work exploring the influence of these elements is lacking, and so research into evidence-based pedagogies for nonmajors is essential to our national efforts to improve the science literacy of all students in higher education.

During a breakout discussion at the CUREnet meeting in Cold Spring Harbor in 2014, a group of educators identified “CUREs for nonmajors” as potentially distinct—in goals, learning objectives, and assessment strategies—from CUREs for developing scientists. On the heels of that discussion, several faculty at the University of Minnesota proposed hosting a workshop for like-minded colleagues specifically addressing CUREs for nonmajors. A working group of biology education researchers and course developers convened to identify best practices for CUREs specifically for nonmajors. Each individual brought a diverse perspective reflecting experience from different university environments (e.g., faculty from a large university, small university, community college, religious college). Here, we identify the laboratory-learning goals for nonmajors developed by this working group and discuss the state of knowledge of best practices for nonmajors CUREs. With this baseline information, we identify pressing research priorities for the future and recommend tools to align research questions with student outcomes.

LABORATORY-LEARNING GOALS FOR NONMAJORS

One of the aims of the meeting focused on the question What are the laboratory-learning goals for nonmajors, and how can a CURE accomplish these goals? The three outcomes came as a result of a daylong discussion with 12 faculty who develop authentic research experiences for undergraduate nonmajors in classroom contexts (Supplemental Material). Before we convened on the first day, participants prepared by reading papers about the topic of science literacy (Miller, 2004; Wright, 2005; Klymkowsky, 2005; Feinstein ) and contributing what they consider relevant publications to a shared annotated bibliography. Before the discussion on proposed learning goals for nonmajors, Cotner led a discussion on learning outcomes for nonscientists and the public according to the assigned readings and participants’ existing knowledge.

After the discussion, we concluded that the desired outcomes resulting from nonmajors participation in laboratory or research environments are students characterized by having developed the following:

Scientific literacy skills, or the ability to access and make sense of science relevant to their daily lives (Feinstein ). The United States is exceptional in requiring that students take science as part of general education courses. In turn, U.S. adults have significantly higher levels of scientific literacy compared with adults in countries that do not require students to take science courses at the university level, a fact that underscores the importance of undergraduate science courses for all students (Miller, 2004).

Proscience attitudes, or positive attitudes toward scientists and scientific research (Osborne ). The positive correlation between the public understanding of science and public opinion of science suggests that, across cultures, proscience attitudes about science and technology contribute to actual knowledge (Allum ).

Evidence-based decision-making skills, or solving personally meaningful problems with evidence-based solutions (Feinstein ). After graduation from a college or university, nonmajors will regularly engage with scientific issues relevant to their daily lives and make decisions using science that impact them and their communities (Feinstein ).

Given the importance of developing these qualities for nonmajors, well-designed scalable research experiences embedded in introductory science classes may support the development of these attitudes and skills, as previously demonstrated in majors classrooms. However, practices found to be effective for majors may not engage nonmajors, and we urge educators to consider the distinct learning goals of nonmajors as they develop curricula. Educators should also strive to establish practices that lead nonmajors students to experience the realities of empirical research—to grapple with failure, experience the inherent messiness of science, and understand the process of research from the conception of a testable question to the evidence-based conclusion drawn from experimental results.

Previous work demonstrates that participation in research as an undergraduate leads to positive student outcomes for science majors (e.g., Hathaway ; Zydney ; Russell ; Espinosa, 2011), prompting calls to science education reform that recommend the incorporation of research experiences into curricula (American Association for the Advancement of Science, 2011; Brownell and Kloser, 2015; Shapiro ). Undergraduate research experiences have historically taken the form of individual research apprenticeships, either in individual faculty labs or departments (e.g., Research Experiences for Undergraduates Program funded by the National Science Foundation), through summer research experiences (Lopatto, 2007; Hernandez ), or, when possible, direct engagement with the natural world (e.g., through field experiences or research; Smith, 2004; Boyle ). Although these types of research experiences lead to documented benefits (Hathaway ; Zydney ; Russell ; Espinosa, 2011), they are not logistically feasible for reaching a large number of students (Wood, 2003; Desai ).

COURSE-BASED UNDERGRADUATE RESEARCH EXPERIENCES

CUREs are a type of scalable laboratory-learning environment that expose students to the process of research early in their college careers (Auchincloss ; Bangera and Brownell, 2014). According to Auchincloss , CUREs possess five defining dimensions: 1) Iteration. Cycles of experimental repetition followed by critical evaluation of data are inherent to the nature of science and, in the context of a CURE, may reveal biological variation or trends. 2) Collaboration. Students work cooperatively to ask research questions and tackle complex problems with other students and the laboratory and/or course instructor. 3) Scientific process. Students learn scientific practices by engaging in science investigations. 4) Broad relevance. Students conduct research that has relevance to the larger scientific or local community. 5) Discovery. Students work with novel data and a question to arrive at an answer unknown to the student, instructor, and broader scientific community.

Although other laboratory-learning environments may integrate one or more of these features, a well-designed CURE is characterized by encompassing all five dimensions. In contrast, the traditional “cookbook” laboratory course, in which recipe-like instructions lead students through investigative experiences, sometimes involves scientific practices or some form of collaboration (Brownell ), although it lacks elements of both discovery and broad relevance given its “known answer.” However, the hallmark of a CURE is really the emphasis on seeking discoveries that have broad relevance, making these not two independent dimensions but rather one (Brownell and Kloser, 2015; Corwin ).

When the meeting participants discussed the defining features of a CURE as outlined in Auchincloss , we acknowledged that the relative importance of specific dimensions of a CURE have yet to be empirically tested. In achieving the stated goals for nonmajors, can laboratory activities lacking one or more dimensions be sufficient for achieving overarching objectives of improving scientific literacy skills, evidence-based decision-making skills, and promoting proscience attitudes? For example, two common laboratory activities resemble CUREs as they were defined earlier but differ notably for lacking one or more CURE-defining aspects, and so we will define them for the first time here: In student-led inquiry laboratories, students ask their own questions within an established model system. However, there is no expectation to ask novel questions or generate original results or inform any community beyond the classroom (Minner ). In these laboratories, it will be important to test whether providing students with the autonomy to ask their own questions outweighs the benefits they experience by contributing to broader scientific discovery. In discovery-based inquiry laboratories, students ask novel questions but findings are also not considered broadly relevant, because there is no expectation to disseminate results. A discovery-based inquiry laboratory differs from a CURE, in which students ask novel questions and are expected to share their findings with communities outside the classroom (Figure 1). In these laboratories, we may expect that students who do not disseminate their results benefit from the laboratory experience as much as those who, for example, speak about their conclusions to the local community or provide their raw data to a research laboratory.

FIGURE 1.

Differences and similarities among inquiry-based labs present students a range of opportunities for engaging in the process of science.

Until now, STEM education researchers have focused primarily on the effects of CUREs on developing scientists, or those who intend to obtain a degree in a science field. Such studies indicate that CUREs increase student performance, retention, self-reported learning, and ability to “think like a scientist” (Jordan ; Brownell ). For these reasons, we would expect that students poised to flow outside the “science pipeline” may also benefit from laboratory research experiences. Among these students are nonmajors, for whom we have little information regarding best practices. We identify here the differences between majors and nonmajors, highlight gaps in our understanding of best practices for nonmajors, and consider research priorities that will inform how we teach future students.

WHAT DO WE KNOW ABOUT NONMAJORS?

Before developing CUREs for nonmajors, it is important to understand how the student population differs from majors students, a group that has been studied extensively to identify best science-teaching practices. Knowledge of the differences between majors and nonmajors can inform our learning goals and approaches when educating both student cohorts. Some authors have focused on differences between majors and nonmajors, emphasizing that nonmajors have less interest in STEM (Knight and Smith, 2010); motivation to learn and participate in science (Glynn ); understanding of the nature of science (Partin et al., 2013); and science content knowledge (Knight and Smith 2010; Medina ). Still others have noted differences in how nonmajors compared with majors perceive socially polarizing topics in the sciences, such as human evolution (Miller, 2004; Paz‐y‐mino and Espinosa, 2010) and anthropogenic climate change (Kahan, 2010). Smith confirm that nonmajors primarily enroll in STEM courses to fulfill graduation requirements rather than to satiate curiosity or obtain desired skills. Nonmajors at the University of Minnesota are less likely than majors to see science as personally relevant, and they are more likely to express misconceptions about the nature of science (Cotner ). To shift this perception, along with others, the development of CUREs for nonmajors should focus on the elements of scientific literacy that are personally and culturally relevant, such as public policy (Martin and Richards, 1995; Oreskes, 2004), personal health (Chervenak and McCullough, 1990; Larson ), and place-based exercises (which incorporate the geographic and cultural meanings of a location as context for the scientific study; Semken and Freeman, 2008). Further, there is a positive correlation between attitudes toward science and knowledge of science, such that, across cultures, positive attitudes lead to increased understanding of scientific concepts (Allum ; Partin ). Furthermore, nonmajors, who represent a range of interests beyond the sciences, are likely to exhibit multiple diverse perspectives (Cotner ). In light of these broad differences between majors and nonmajors, we expect course design elements of CUREs that emphasize personal relevance and promote inclusive environments to particularly improve the learning and performance of nonmajors. Further, diverse perspectives may lead to more diverse outcomes following stratification by major, and future research will need to carefully untangle and address these differences in the evaluation of CURE outcomes.

THE STATE OF KNOWLEDGE OF BEST PRACTICES FOR NONMAJORS CURES

Institutional resources may favor investment in science majors over nonmajors, and science educators are bound to prioritize the development of future scientists. As a consequence, literature on nonmajors’ experience in STEM courses overall (to say nothing of CUREs specifically), while informative, is limited. We know very little about how these individuals approach course-based research, what features of a CURE are likely to promote our desired outcomes, or how an ideal CURE for a nonmajor may differ from that of a developing scientist. Cotner and Hebert (2016) document how nonmajors in a discovery-based inquiry experience value the “authenticity” of research over other, cookbook-style lab activities; however, this work lacked broad relevance and was not, by definition, a CURE.

Clearly, further work is needed to determine how inquiry in general, and course-based research experiences specifically, influence scientific literacy. To start, we must determine whether nonmajors CUREs should be considered distinct from majors CUREs. Following that, and if warranted, we can address specific questions about the design and implementation of CUREs for nonmajors, to unpack which, if any, design features or implementation strategies are more or less critical for achieving learning outcomes for nonmajors. Realistically, a one-­semester nonmajors science course may be students’ only formal scientific training in college and perhaps the only opportunity to experience scientific research. Thus, we can investigate important questions about how nonmajors engage in the research, and how a research experience contributes to scientific literacy in our nonmajors population (e.g., Cotner and Hebert, 2016).

RESEARCH PRIORITIES FOR DETERMINING BEST PRACTICES FOR NONMAJORS CURES

There are a number of national CUREs that target both majors and nonmajors (e.g., SEA-PHAGES, Small World Initiative, Community College Undergraduate Research Initiative), and many individual faculty members who use CUREs (e.g., through the Course-based Undergraduate Research Experiences Network, www.curenet.cns.utexas.edu). Despite the growing implementation of CUREs, the focus of research stemming from these efforts has either not identified nonmajors students in the analyses or these data are unpublished. If the widespread adoption of CUREs continues to expand, faculty and students will benefit from research focused specifically on the experience of nonmajors, because we anticipate that their needs differ from majors students—even if these different needs do not require different CUREs. Ongoing CURE programs and existing evaluative tools designed to assess the effects of CUREs on majors lay the groundwork for testing similar hypotheses about nonmajors (for a recent summary of assessment tools, see Brownell and Kloser, 2015; Shortlidge and Brownell, 2016), and evaluating best practices for one group of students may inform best practices for the other (Table 1).

TABLE 1.

Specific research questions for future consideration pooled into two broad categories of inquiry related to nonmajors students: improving CURE design elements and addressing unique learning gains or course outcomes

Pooled research category	Research questions
Improving CURE design elements for nonmajors	What features of a CURE are critical for achieving our desired nonmajors-specific outcomes? Specifically, should a CURE be discovery based and broadly relevant, or is student-led inquiry sufficient for achieving our overarching goals for science literacy?
	How do nonmajors compare with majors with respect to motivation, interest, engagement, self-efficacy, and scientific products (results, interpretation, etc.)? If there are differences, can we use knowledge of these differences to better tailor the research experience for nonmajors?
	Do nonmajors require additional knowledge in preparation for a CURE? If so, what steps are needed to deliver this information?
Addressing unique learning gains or course outcomes for nonmajors	Do CUREs improve nonmajors science literacy, proscience attitudes, or evidence-based decision-making skills?
	What are the unique learning needs and learning gains of a nonmajor vs. a major in the context of a CURE?
	In conducting course-based research, do nonmajors see themselves—even briefly—as members of the scientific community? Or, by doing small tasks that contribute to a larger project, do they see themselves as peripheral participants in scientific research?
	Do nonmajors recognize the value of a research experience?

ALIGNING EXISTING ASSESSMENT TOOLS WITH GOALS

Assessment tools allow instructors to ask specific questions that align teaching goals with practical outcomes (for a comprehensive list of possible CURE outcomes, see Corwin ). In the context of nonmajors CURE research, we hope to achieve three broad objectives: the improvement of scientific research literacy skills, proscience attitudes, and evidence-based decision making. Here, we discuss assessments that are relevant to those central objectives or that can document how student perceptions, attitudes, and academic performance can change in response to CUREs.

Scientific literacy skills can be measured using an existing instrument called the Test of Scientific Literacy Skills, which quantifies student proficiency in using scientific concepts beyond the classroom (Gormally ). Alternatively, instructors can measure nonmajors knowledge of relevant course content after different laboratory experiences as a proxy for scientific literacy. Though this method has been tested on majors students (Shaffer , 2014; Brownell ; Kloser ; Jordan ), who exhibit knowledge gains on related topics after experiencing a CURE, research has not demonstrated whether nonmajors benefit in the same way. We also caution that science content knowledge differs markedly from science literacy skills, and the two should not be used interchangeably (Klymkowsky, 2005). Future research will also profit by examining the extent to which CUREs affect nonmajors scientific literacy by measuring gains in analytical skills (Shaffer ; Bascom-Slack ; Brownell ; Hanauer ; Kloser ).

Proscience attitudes can be directly measured by the Test of Science-Related Attitudes, which quantifies favorable attitudes toward science and scientists (Fraser, 1978). Cotner found a significant difference between majors and nonmajors perceptions of scientists and scientific methods, such that nonmajors were more likely to view science as a static discipline that is mostly “an accumulation of facts, rules and formulas” and that is “not connected to non-science fields such as history, literature, economics, or art.” Further, they found nonmajors more likely than majors to hold naïve and inaccurate perceptions about the nature of science and to see science as less personally relevant. Given these misconceptions, nonmajors student populations may particularly benefit from exposure to CUREs with the potential to contribute new scientific knowledge. Such contributions may instill a greater appreciation for science as both a process and a discipline. However, the lack of studies on this and other metrics means that all we can do is point to the possibility that CUREs may benefit nonmajors students in ways that have not been quantified. Rigorous research on a wide range of inquiry-based experiences—including CUREs—is required if our studies aim to evaluate the generality of different impacts.

Prior research demonstrates CUREs contribute to proscience attitudes among majors by promoting student motivation to do science (Alkaher and Dolan, 2014; Shaffer ), collaboration skills or perceptions about interactions with peers (Shaffer , 2014; Alkaher and Dolan, 2014), and sense of belonging to a larger community (Jordan ; Shaffer ). Overall positive shifts in sense of belonging and motivation are likely to have positive impacts overall, especially on historically underrepresented student groups in science, for whom campus climate and sense of belonging are strong predictors of student retention and degree completion in higher education (Seymour and Hewitt, 1997; Hausmann ; Museus ). CUREs research will profit from a close examination of the impact that CUREs have on the connection between attitudinal changes, proscience attitudes, and academic performance for nonmajors.

Although critical to education research interests, we are unaware of established techniques for assessing students’ evidence-based decision-making abilities, the third objective for improvement among nonmajors. A future contribution to this field will be the development of a comprehensive tool to specifically assess both short-term and long-term changes in this competency.

Parallel comparisons between “cookbook” labs, student-led inquiry labs, discovery-based inquiry labs, and CUREs are another approach to investigating whether a CURE for nonmajors effectively achieves its three central goals. Comparisons will show whether observed shifts in performance or perceptions over the course of a semester are due to the CURE design specifically or whether students experience similar or even more positive changes in other lab models. Three design features of biology CUREs can be directly measured by the Laboratory Course Assessment Survey, which quantifies students’ perceptions of collaboration, discovery and relevance, and iteration (Corwin ). Alternatively, the Laboratory Observation Protocol for Undergraduate STEM will provide clear characterization of instructional practices teaching assistants enact in laboratories and can be used to obtain information about practices in different laboratory-teaching environments (Velasco ). Future research should also emphasize which of the five characteristic elements of a CURE are best at achieving course goals and objectives over others using quasi-­experimental design approaches. Dividing students by majors and nonmajors status will highlight differences between developing scientists (majors) and the scientifically literate citizenry (nonmajors; e.g., Brownell ).

OPPORTUNITIES TO COLLABORATE AND DISSEMINATE BEST PRACTICES FOR CURES FOR NONMAJORS

Collaboration and dissemination of effective strategies are critical to the improvement of laboratory teaching and the implementation of CUREs for nonmajors. Although future research may support the notion that nonmajors CUREs are distinct entities from majors CUREs, we describe here the growing number of resources for developing and publicizing CUREs for majors. For example, CUREnet is a website that hosts a collection of tested examples of laboratory activities written by a diverse community composed of instructors, researchers, information technology specialists, and curriculum developers. One can browse projects according to relevant CURE features such as data type, student audience, and core competencies. One future direction for this community may be the formation of a CUREnet subgroup for nonmajors, committed to evaluating and promoting best practices for nonmajors specifically. Establishing such a community would require support for meetings, disseminating ideas, developing instruments, and forging collaborations between departments and institutions.

Many organizations promote the study of STEM education and offer platforms to disseminate ideas and research to instructors who teach broad audiences, from majors and nonmajors university students to high school science students. The Society for the Advancement of Biology Education Research is a group dedicated to developing evidence-based strategies to improve biology education, and they support education research by fostering collaborations among investigators. Their national meetings highlight hypothesis-driven research projects that examine all aspects of student learning and education practices. The National Association of Biology Teachers is another group that supports life sciences education with an emphasis on high school and undergraduate-level biology. Many national STEM conferences, such as the joint annual Evolution conference of the Society for the Study of Evolution, the Society of Systematic Biologists, and the American Society of Naturalists, feature separate breakout sessions for discipline-specific education research within the conference schedule. These large conferences are prime opportunities to present research and discuss scientific teaching with colleagues. In many cases, these conferences are ideal venues for introducing the concept of CUREs to a new audience of potential implementers—educators who will likely demand evidence of CURE efficacy.

Collaborative funding opportunities, such as the Research Coordination Network through the National Science Foundation, can also facilitate discussion among like-minded colleagues and lead to the publication of novel ideas. Using this funding, organizations can host education researchers and CURE curriculum developers to communicate research directions and teaching practices and share future initiatives across institutional and geographic boundaries.

SUMMARY

The goal of this workshop was to identify best practices for CUREs for nonmajors. Our determination of student outcomes was informed by recent research comparing nonmajors with majors. We also discussed the state of knowledge of best practices for nonmajors and used that to identify research priorities for the future.

We identified desired outcomes as 1) scientific research literacy skills, 2) proscience attitudes, and 3) evidence-based decision making. We described ways to directly and indirectly assess these student outcomes with the use of existing survey instruments, which will address the most pressing questions about the effect of CUREs on nonmajors students. Historically, research has not focused on nonmajors or analyzed nonmajors performance in response to different teaching methods, and so there is tremendous potential to support this critical group of students through evidence-based approaches. We hope this report provides instructors with the questions and the tools needed to start incorporating pedagogical research into their own inquiry-based teaching. Systemic efforts to collaborate and disseminate results among institutions will be essential to our national efforts to improve teaching with CURES specifically and to promote STEM disciplines more broadly.