| Literature DB >> 30496032 |
David I Hanauer1, Justin Nicholes2, Fang-Yu Liao3, Aaron Beasley4, Heather Henter5.
Abstract
The San Diego Biodiversity Project introduces undergraduate students at four different 2- and 4-year schools to a short-term research experience (SRE) that was implemented as a module in the last third of a traditional laboratory course. The study assesses the qualities of this SRE for students using three different methods. Twenty-one participants were interviewed about their experiences in the traditional and research components of their course. In a repeated-measures design, 124 participants took the Persistence in the Sciences (PITS) survey immediately before and after their participation in the SRE. Finally, using a propensity score matching technique, PITS survey results for SRE students were compared with those for students in a course-based research experience (CRE). Student perceptions of the traditional lab and the SRE are different-students appreciate learning basic processes and procedures in the traditional lab, but they express having personal investment in and a sense of participating in science in the SRE. Significant increases were found for the variable of Project Ownership in the SRE condition over the traditional lab, but SRE outcomes were lower than CRE outcomes. Although the SRE may not provide the benefits of a CRE, it is a serious option for expanding access to authentic research.Entities:
Mesh:
Year: 2018 PMID: 30496032 PMCID: PMC6755894 DOI: 10.1187/cbe.18-03-0046
Source DB: PubMed Journal: CBE Life Sci Educ ISSN: 1931-7913 Impact factor: 3.325
Demographic Information for quantitative studies (SRE, n = 124; CRE, n = 61)
| SRE participants | CRE participants | |||
|---|---|---|---|---|
| Demographic category | Frequency | Percentage | Frequency | Percentage |
| Male | 52 | 41.9 | 17 | 27.4 |
| Female | 71 | 57.3 | 43 | 69.4 |
| Missing | 1 | 0.8 | 1 | 1.6 |
| Freshman | 8 | 6.5 | 0 | 0 |
| Sophomore | 46 | 37.1 | 56 | 90.3 |
| Junior | 33 | 26.6 | 2 | 3.2 |
| Senior | 19 | 15.3 | 2 | 3.2 |
| Undefined | 18 | 14.5 | 1 | 1.6 |
| American Indian | 3 | 1.6 | 1 | 1.6 |
| Asian | 27 | 14.9 | 10 | 16.1 |
| African American | 9 | 4.9 | 5 | 8.1 |
| Hispanic/Latino | 35 | 19.3 | 5 | 8.1 |
| Hawaiian | 4 | 2.2 | 1 | 1.6 |
| White | 82 | 45.3 | 40 | 64.5 |
| Other | 13 | 7.2 | 0 | 0 |
| Multiethnic | 8 | 4.4 | 1 | 1.6 |
| Below 2.5 | 4 | 3.2 | 1 | 1.6 |
| 2.6–3.0 | 31 | 25 | 11 | 17.7 |
| 3.1–3.5 | 45 | 36.3 | 35 | 56.5 |
| 3.6–4.0 | 43 | 34.7 | 14 | 22.6 |
| 4.1 and higher | 0 | 0 | 0 | 0 |
| Missing | 1 | 0.8 | 1 | 1.6 |
| No college degree | 41 | 33.1 | 13 | 21 |
| Associate degree | 24 | 19.4 | 0 | 0 |
| Bachelor’s degree | 31 | 25 | 14 | 22.6 |
| Master’s degree | 18 | 14.5 | 19 | 30.6 |
| Doctorate or professional degree | 9 | 7.3 | 15 | 24.2 |
| Missing | 1 | 0.8 | 1 | 1.6 |
| Unskilled labor | 13 | 10.5 | 3 | 4.9 |
| Skilled labor | 27 | 21.8 | 7 | 11.5 |
| Clerical | 4 | 3.2 | 1 | 1.6 |
| Service | 9 | 7.3 | 2 | 3.2 |
| Managerial | 25 | 20.2 | 12 | 19.4 |
| Professional | 45 | 36.3 | 36 | 58.1 |
| Missing | 1 | 0.8 | 1 | 1.6 |
aParticipants could report more than one ethnicity and thus the total number of participants is more than 124.
Traditional laboratory and SRE coding system
| Code name | Definition | Examples |
|---|---|---|
| Traditional | ||
| 1. Developing foundational knowledge of skills and procedures | Statements that express that participation in lab work aided in the development of basic knowledge, skills, and procedures in the field of biology | “I got a lot of technical skills when I was working in this section.” “And I mean I think the central thing was understanding the foundational concepts behind most of the things we are learning.” “It was just kind of having—developing a toolset that you would need.” |
| 2. Helping with future classes | Statements that express the belief that participation in the lab will contribute to future classes in which the student will participate | “Overall I mean it helps me in all my other classes.” “So I was just thinking like, oh, I’ll just use this stuff and it’ll be used in my upper-division classes.” |
| 3. Providing hands-on experience and greater understanding of lecture material | Statements that express that lab work enhanced the understanding of the lecture material as a result of hands-on nature of the lab | “It was more practical application of the lectures.” “With lab I feel that it was very valuable to be able to do those concepts yourself in your own hands. For example, like I just mentioned, bacteria. You know the concepts. You would be able to just think of that conceptually. But being able to do it hands-on, be able to see what happens in real life really adds to the experience.” |
| 4. Results are clearly defined and tied to classroom outcomes such as tests, assignments, and grades and are not important in themselves | Statements that express that work in the lab was directed toward activities that were part of classroom assessment such as tests, assignments, and grades; any results received not considered important beyond the classroom | “All the labs, they’re like lab reports. You basically filled them out. Usually it’s just answering a lot of questions. Sometimes you might have to draw, like, the basic shape of a molecule.” “It’s not figuring out an unknown. It’s not actual research. It is research in a sense of we’re doing an experiment using scientific methods, but it’s not research in the sense of hey, this is something we don’t fully understand, or something that we don’t have a complete picture of.” “I felt like it was more kind of like you’re copying the real thing. You’re not actually doing something that contributes outside of yourself.” “We’re just doing this one time and it’s all you’ll ever see it again.” “The first section it was just like, “Oh, if you didn’t get the results, then you could just like redo it, and it doesn’t matter how many times you redo it, you can still get your results and write about it.” |
| 5. Procedures used were not interconnected | Statements that express that the procedures used in the lab were independent of one another and not part of a single research process | “In the first half everything was split apart.” |
| 6. Providing an exciting introduction to biology (processes and procedures) | Statements that express that working in the lab provided an exciting introduction to the field of biology and the processes and procedures that biological research involves | “I think getting that lab experience with biology, I think [that] was really cool experience.” “The first part was really eye-opening.” |
| 7. Lab work involved low levels of pressure | Statements that express that the work within the lab was not stressful and involved low levels of anxiety | “The pressure wasn’t as intense.” “So it’s a lot more of the reality of the situation when in lecture you kind of have things more catered to you and you have a lot more things that if it works, everything works, and it goes magically.” |
| SRE | ||
| 8. Expression of excitement toward research | Statements that express a sense of excitement and fulfillment toward the activity of conducting research | “It was really exciting to see that the research actually worked.” “So I immediately felt like that’s an amazing feeling.” |
| 9. Providing a sense of conducting authentic research | Statements that express that the participant felt he or she was in involved in real, authentic research | “It is true research and it is being used.” “It contributed to my education a little bit more because when you do things and apply to actual life, it’s a little bit more, I guess, of a better experience.” “I was able to go out and explore and that is just something I envision biologists doing. Just being able to go out and explore things and understand the animals or understand just the plants and the biology that surrounds them.” |
| 10. Personal lab work is important to future research, the scientific community and contributes to society | Statements that express that lab work contributes to future scientific work, involves new discoveries, and is more broadly important to the scientific community and society | “When we uploaded to BOLD, that was not just something personal like writing in my own notebook. It was uploading so that others can be able to access that data as well, so it’s kind of a bigger community.” “We’re actually contributing information that may not be so well known already. We are providing contributions to the scientific community.” “That felt rewarding too, because I feel like, because I am actually putting stuff that I’ve done out there into the scientific community and, I guess, contributing.” |
| 11. Provide an exciting experience of making a new discovery | Statements that express that doing research involved the positive experience of making a new discovery | “When they look at the database to see, like, ‘Oh, there is this a species that was found in this area of California.’” “Having that thrill of maybe it could be something new that I would find or something that is related to something else.” |
| 12. Lab work involved the possibility of failure | Statements that express that within the lab it was a possibility that experiments and lab procedures would fail | “It’s just nerve-racking every single time, because you don’t know if it’s going to work or not.” “This in a way is different, because it’s, like, well, we don’t know if this is actually going to work.” |
| 13. Providing accurate results and being careful about procedures is a personal responsibility | Statements that express that it was a important that any procedure performed in the lab was done responsibly and that it was a personal responsibility to ensure that the work was done and reported accurately | “I was trying to be very meticulous during this whole project, trying to actually do everything correct.” “You feel more of a, I don’t know, a responsibility or something to do it for the others, not of just yourself. It’s not personal. It’s a bigger picture that you’re a part of.” “It really kind of highlights the importance of proper procedure and handling of these things. Because even just a small fraction of, like, a piece missing of that gene sequence, you’re not going to get an accurate reading. So I mean it did really stress the importance of, like, proper procedure, proper handling of everything.” |
| 14. Personal investment, engagement and involvement, with the lab work conducted | Statements that express that the student was personally engaged, involved, and invested in the lab work being conducted | “Instead of just sitting around watching someone else do it. In smaller groups you’re able to do it more yourself; you have more opportunities. So I felt more involved in that process.” “Absolutely I was more engaged with the honors section than I was with the regular section.” “It’s a project that you start, so I feel like you become more invested in what you’re doing.” |
| 15. Procedures used were part of a process and interconnected and coherently tied to results | Statements that express that procedures and experiments conducted in the lab were connected and part of a full research process | “The second part they were all connected and in the end it all showed how they were.” “Because I do understand the way in that it links into the big picture. I know WHY we’re doing it.” |
| 16. Lab work involved application of skill and procedural knowledge to real-world scientific questions | Statements that express that lab work involved the application of skill and procedural knowledge that had been acquired to real questions and a scientific research agenda | “And so we’re answering a real question, a real-life science question, that will be hopefully answered with the research.” “So it was like basically applying all of the things that we had learned and learning newer stuff again and to apply it to, like, one research—like, actual research project.” |
| 17. Lab work led to talking to friends and family | Statements that express that work in the lab was discussed with friends and family | “So, like, I just tell my friends about it all the time.” “I did talk about the honors section to some of my friends and my parents. I didn’t, I don’t think I ever talked about the non-honors part of the course.” “Remember, like, telling my friends and my mom and my dad, look what I’m doing in my bio class!” |
| 18. Lab work was beneficial to my future career | Statements that express that work in the lab was believed to be beneficial to the student’s future career beyond the current undergraduate studies | “I think that both sections were very helpful in that aspect, because I think that learning the concepts were very important, but also learning the direct career application was also extremely important.” “Knowing … how DNA bar-coding works—that would be more applicable to a career or studying biology as I go on.” |
| 19. Increased my interest and desire to be in a STEM major | Statements that express that work in the lab made the student more interested in staying a STEM major | “It was just something that helped me be even more interested in biology than I was before.” |
| 20. I felt like a scientist and part of the scientific community | Statements that express that, as a result of working in the lab, the student felt more like a scientist and a member of the scientific community | “I would say the second part, because it felt for me, to feel more like a scientist.” “As a scientist, I think once you go into the lab, there is that factor of pressure to get results and you have like a timeline that you need to meet, like to present your results afterwards. So I think that the second section makes you feel more like a scientist.” “That must be part of the feeling when you feel like a scientist.” |
| 21. Group collaboration was beneficial and exciting | Statements that express that group collaboration was a positive and beneficial aspect of the lab experience | “I really liked working with other people.” “I think it’s more valuable, because you, instead of it just being for yourself, other people are also collaborating with you.” |
Code frequencies for interview data organized by total number of statements (across all participants) made in relation to the traditional laboratory and the SRE
| Code | Traditional lab | SRE |
|---|---|---|
| 1. Developing foundational knowledge of skills and procedures | 67 | 2 |
| 2. Helping with future classes | 5 | 1 |
| 3. Providing hands-on experience and greater understanding of lecture material | 16 | 21 |
| 4. Results are clearly defined and tied to classroom outcomes such as tests, assignments, and grades and are not important in themselves | 34 | 0 |
| 5. Procedures used were not interconnected | 5 | 1 |
| 6. Providing an exciting introductory to biology (processes and procedures) | 18 | 5 |
| 7. Lab work involved low levels of pressure | 13 | 1 |
| 8. Expression of excitement toward research | 4 | 58 |
| 9. Providing a sense of conducting authentic research | 1 | 63 |
| 10. Personal lab work is important to future research, the scientific community and contributes to society | 3 | 35 |
| 11. Provide an exciting experience of making a new discovery | 7 | 14 |
| 12. Lab work involved the possibility of failure | 1 | 20 |
| 13. Providing accurate results and being careful about procedures is a personal responsibility | 1 | 33 |
| 14.Personal investment, engagement, and involvement with the lab work conducted | 2 | 33 |
| 15. Procedures used were part of a process and interconnected and coherently tied to results | 6 | 26 |
| 16. Lab work involved application of skill and procedural knowledge to real-world scientific questions | 0 | 14 |
| 17. Lab work led to talking to friends and family | 7 | 24 |
| 18. Lab work was beneficial to my future career | 7 | 28 |
| 19. Increased my interest and desire to be in a STEM major | 1 | 12 |
| 20. I felt like a scientist and part of the scientific community | 7 | 28 |
| 21. Group collaboration was beneficial and exciting | 1 | 13 |
Means and standard deviations for six PITS survey variables for the traditional laboratory and the SRE
| Variable | Traditional laboratory | SRE |
|---|---|---|
| Project Ownership Content | 3.62 (0.79) | 3.84 (0.72) |
| Project Ownership Emotion | 3.75 (0.76) | 3.82 (0.77) |
| Self-Efficacy | 4.12 (0.63) | 4.19 (0.63) |
| Scientific Identity | 3.93 (0.85) | 3.99 (0.95) |
| Scientific Community Values | 5.28 (0.64) | 5.32 (0.62) |
| Networking | 3.48 (0.83) | 3.57 (0.82) |
Repeated-measures ANOVAs for five PITS survey variables for the traditional laboratory (time 1) and SRE (time 2)
| Variable | Mean square | Greenhouse-Geisser | Partial eta squared | |||
|---|---|---|---|---|---|---|
| Project Ownership Content | 1.607 | 1, 69 | 3.919 | 0.05 | 0.05 | 0.054 |
| Project Ownership Emotion | 0.13 | 1, 69 | 0.331 | 0.57 | 0.57 | 0.005 |
| Self-Efficacy | 0.134 | 1, 69 | 0.378 | 0.54 | 0.54 | 0.093 |
| Science Identity | 0.056 | 1, 42 | 0.113 | 0.74 | 0.74 | 0.003 |
| Scientific Community Values | 0.054 | 1, 69 | 0.21 | 0.65 | 0.65 | 0.003 |
| Networking | 0.311 | 1, 69 | 1.2 | 0.28 | 0.28 | 0.017 |
Means and standard deviations for 10 Project Ownership Content scales for the traditional laboratory and the SRE
| Project Ownership Content scale | Traditional laboratory | SRE |
|---|---|---|
| My research will help to solve a problem in the world. | 3.4 (1.06) | 3.63 (1.01) |
| My findings were important to the scientific community. | 3.33 (1.07) | 3.67 (0.96) |
| I faced challenges that I managed to overcome in completing my research project. | 3.7 (0.91) | 3.83 (0.92) |
| I was responsible for the outcomes of my research. | 4.04 (0.92) | 4.26 (0.79) |
| The findings of my research project gave me a sense of achievement. | 3.94 (1.03) | 4.11 (0.88) |
| I had a personal reason for choosing the research project I worked on. | 3.2 (1.04) | 3.2 (1.19) |
| The research question I worked on was important to me. | 3.32 (0.95) | 3.48 (1.08) |
| In conducting my research project, I actively sought advice and assistance. | 3.79 (1.02) | 4.07 (0.89) |
| My research project was interesting. | 3.87 (0.93) | 4.19 (0.86) |
| My research project was exciting. | 3.71 (1) | 4 (0.92) |
Repeated-measures ANOVAs for 10 Project Ownership Content scales for the traditional laboratory and the SRE
| Project Ownership Content scale | Mean square | Greenhouse-Geisser | Partial eta squared | |||
|---|---|---|---|---|---|---|
| My research will help to solve a problem in the world. | 1.83 | 1, 69 | 2.418 | 0.12 | 0.12 | 0.03 |
| My findings were important to the scientific community. | 4.11 | 1, 69 | 4.99 | 0.03 | 0.03 | 0.07 |
| I faced challenges that I managed to overcome in completing my research project. | 0.58 | 1, 68 | 1.11 | 0.29 | 0.29 | 0.02 |
| I was responsible for the outcomes of my research. | 1.61 | 1, 69 | 2.65 | 0.11 | 0.11 | 0.04 |
| The findings of my research project gave me a sense of achievement. | 1.03 | 1, 69 | 1.25 | 0.27 | 0.27 | 0.02 |
| I had a personal reason for choosing the research project I worked on. | 0 | 1, 69 | 0 | 1 | 1 | 0.05 |
| The research question I worked on was important to me. | 0.88 | 1, 68 | 1.16 | 0.29 | 0.29 | 0.02 |
| In conducting my research project, I actively sought advice and assistance. | 2.86 | 1, 69 | 4.68 | 0.03 | 0.03 | 0.06 |
| My research project was interesting. | 3.46 | 1, 69 | 5.74 | 0.02 | 0.02 | 0.07 |
| My research project was exciting. | 2.89 | 1, 68 | 4.68 | 0.03 | 0.03 | 0.06 |
Means, standard deviations, and average treatment effects on the treated (ATET propensity score matching) for SRE and CRE courses (n = 96)
| Estimation method | Project Ownership Content | Project Ownership Emotion | Self-Efficacy | Science Identity | Scientific Community Values | Networking | |
|---|---|---|---|---|---|---|---|
| SRE ( | 3.64 (0.13) | 3.63 (0.15) | 4.05 (0.12) | 3.91 (0.26) | 5.31 (0.08) | 3.38 (0.14) | |
| CRE ( | 4.16 (0.05) | 4.06 (0.08) | 4.49 (0.05) | 4.13 (0.07) | 5.36 (0.08) | 3.73 (0.12) | |
| ATET propensity score matching | Coefficient SE z | −0.74 0.14 −5.29 0.0001 | −0.68 0.27 −2.42 0.02 | −0.66 0.09 −6.9 0.0001 | −0.3 0.13 −2.34 0.02 | −0.3 0.16 −1.88 0.06 | −0.66 0.19 −3.48 0.0001 |