Part 2: Can first-year undergraduates read primary scientific literature?

This is Part 2 of a three part series on introducing first-year geoscience students to the primary scientific literature in a large classroom setting. Part 1 described the motivation and desire to initiate this program, and Part 3 will describe the details of how the students handled the material and what the most commonly used strategies were for the students. These events occurred in the GLGY 201 class at the University of Calgary during the Fall  2011 semester (Instructors: Leslie Reid, Ben Cowie). 

This entry is a bit of a methods dump – how did we instruct a large classroom of students to read the primary literature. After working as a teaching assistant for an upper year seminar class in 2010, it was apparent to me that undergraduate students needed guidance on reading scientific articles earlier in their university career. Given the opportunity to incorporate research literature into GLGY 201 as the instructor this year, I jumped at the chance. The next question was “how should this be implemented?”

Many first year courses in sciences start with the basics of library research skills and referencing, but these didn’t seem to fit well within the context of the course I was teaching. There would be no writing assignment for the students to practice referencing skills, and to reference something in written format, one must understanding its contents. After some discussion about learning objectives, we came up with a few relating to scientific literature for GLGY 201: 1) students can differentiate between popular and scholarly articles; 2) students can describe the components of a scientific research paper and 3) students know how to approach reading new and unfamiliar scholarly materials. It was decided to pre-select reading for the course, and use in-class peer-instruction to augment the comprehension of these articles. It was very important to select research papers that were relevant to course content that students already had some prior background knowledge. Geology 201 is focused on three key content areas: Plate Tectonics, The Rock Cycle, and Geologic Time, so we chose one paper from each broad section. There were four classes dedicated to research literature, all four of which would include an in-class assignment. The first class was a library skills session: what type of information resources are available and when should you use them. The second, third, and fourth were group-work classes where students worked in groups to answer questions about the pre-assigned reading.

The first class was an introduction to the different types of literature (popular, scholarly) available in the library and online. This session was given by the head of the geology library Claudette Cloutier. For this session, the instructors asked students to bring a scholarly article to class, without telling them what a scholarly article was. These articles were submitted to the instructor at the end of class with answers to a couple brief questions (listed below). As Claudette introduced “what is scholarly literature” the students who brought popular articles quickly became aware that their selected pieces didn’t have abstracts, a comprehensive reference list, figures, data or the wonderful jargon that accompanies most scholarly papers. It was interesting to see the variety of articles that students procured for the session. Roughly half of my ~200 students brought a scholarly article, either a review article or peer-reviewed research. The other half brought an assortment of ScienceDaily articles (we had previously used these in class), Scientific American, New Scientist, blogs, news articles and similar popular science materials. It was also interesting to see how many students answered the question “is your article scholarly or popular” with negative sentiment if they brought a popular article to class. “Popular 😦 ” [sic] was a common answer. There’s a great role for popular articles in society, so I made a point of writing a comment for students who included this type of answer. Claudette also provided a library guide for our students (link to library guide), supporting their search for scientific materials.

The remaining three classes focused mainly on primary research literature. The structure for the classes involved pre-assigned article reading (list of articles at the end of the blog entry), accompanied by a podcast I prepared to guide them through each paper. These video podcasts (made available via Blackboard course management software) gave tips on what to look for in research articles, and were intended to assist students with understanding the complexity of scientific writing. Arriving in-class, the students formed small groups (two or three students) and were provided with a brief introduction to the questions they were asked to answer. The rest of the class was an open-book in-class discussion session, and the students were required to submit their work at the end of class. Students were coached by two instructors and four teaching assistants, who wandered throughout the classroom during the one hour session (suggest only four instructional staff are necessary per 200 students for future sessions, instead of six)The teaching team was instructed to answer any questions the students asked even if it “gave away” part of the answer. This was a learning opportunity, not a test.  Each question required a different student to function as the “discussion leader” who was instructed to guide the group’s discussion, and keep the group on track. The discussion leader system worked anecdotally well (difficult to verify) – as it encouraged peer-instruction and teamwork, rather than simply having the strongest student answering all the questions in the group. A typical set of questions would ask about 1) the objective, purpose or hypothesis of the paper, 2) the methodology used to test the hypothesis, and 3) the conclusions or importance of the research findings. The questions were fairly broad short answer questions, so any single response from the instructional team would not have been a complete ‘full-marks’ answer. Here’s an example of one of the worksheets, the rest are available at the end of the blog entry: In-class activity 1: Active submarine eruption of boninite.

The first research literature class ran fairly smoothly – the students responded to questions at a fairly high level, and very much rose to the challenge of reading a complicated article, so we decided to up the ante for the second and third sessions by bringing in the researcher who wrote the paper. In the second and third research literature classes, we selected articles authored by a faculty member from our department. In these two classes, Andrew Leier and Charles Henderson generously volunteered their time to give a five minute introduction to their research at the start of class. This provided students with a “behind the scenes” look at the scientific process, and both Andrew and Charles did a great job of identifying some of the challenges of doing science that don’t always make it into the final manuscripts. Anecdotal comments from students suggested having the researchers present in the classroom made a big difference in the students’ interest in research.

This approach was the first time primary scientific literature was introduced in a first year geology class at U of C. My next blog entry (Part 3) will describe how the students responded, how students used the resources available to them, and how I would improve this exercise for next time. I’m be interested to hear how literature is taught at other universities – please comment below if you have any feedback. If you’re still a student (or can remember when you were) how were you taught to read scientific literature?

Questions asked in the initial literature session with geology librarian:

1) is your article a scholarly or popular article?
2) is your article an original research article or a review? (in hindsight, this should have been an “if your article is scholarly” question; with a matching question for popular)
3) describe how you found your article.

Scientific Literature examined for in-class activities.

1) Active submarine eruption of boninite in the northeastern Lau Basin http://www.nature.com/ngeo/journal/v4/n11/full/ngeo1275.html
2) Continental-scale detrital zircon provenance signatures in Lower Cretaceous strata, western North America http://geology.geoscienceworld.org/content/39/4/399.short
3) Calibrating the End-Permian Mass Extinction http://www.sciencemag.org/content/334/6061/1367.short


Worksheets assigned in class: 

Worksheet 1 – Active submarine eruption of boninite
Worksheet 2 – Detrital zircon provenance
Worksheet 3 – Calibrating the end-Permian mass extinction

Advertisements

Part 1: Can first-year undergraduates read primary scientific literature?

This is Part 1 of a planned three part series on introducing first-year geoscience students to the primary scientific literature in a large classroom setting. Part 2 will illustrate what was done to introduce the primary literature in geosciences, and Part 3 will describe the details of how the students handled the material and what the most commonly used strategies were for the students. These events occurred in the GLGY 201 class at the University of Calgary during the Fall 2011 semester (Instructors: Leslie Reid, Ben Cowie). 

If they are provided with proper support and assigned appropriate articles, we believe they can.

One of the biggest challenges of an undergraduate degree is learning to read the primary scientific literature (in the geosciences, this can include journals like Geology, Nature Geoscience, Geochimica et Cosmochimica Acta, and broader scientific staples like Science and Nature). Not only should students learn how to read these articles, they should develop the ability to critically evaluate the contents of these papers – and the ability to contrast peer-reviewed science with popular science media like ScienceDaily. A big question I’ve spent some time thinking about is “when should this learning process start?” At what point do undergraduates need to dig into the primary literature, and how are they instructed to approach these articles? Often students are never explicitly instructed in this important skill. However, by the time they reach senior level courses, they are expected to read papers and provide summaries, use the research literature to write research papers, and search for data and references that contribute to undergraduate theses. In first year courses students are sometimes encouraged to visit the library to develop search and referencing skills to avoid plagiarism, and provide a broad overview of resources available but aren’t specifically guided in how to approach the complexities of research literature. Encouraging undergraduate students to think outside the textbook and delve into the literature is a task that has traditionally been left to senior level courses because, “first year students don’t have enough basic geological knowledge to read cutting edge material,” or, “you cannot teach students to read primary research in a large classroom setting” or, “students won’t get anything out of reading the paper because they don’t understand all the concepts presented.” I disagreed with these statements for a few reasons: 1) students learn important geological concepts in first year classes, 2) as a ‘seasoned’ Ph.D. student, I definitely don’t understand everything in every paper I read, so I have to learn it independently, 3) if articles are selected with content that is relevant to the course, students aren’t pushed too far out of focus and 4) large classes require more planning but with careful execution and support, most learning can be achieved in a large classroom. To answer the question: “Are first year students ‘ready’ and capable of reading primary literature?” we prepared a series of reading assignments from the literature in a first year geoscience class to find out if the preconceived notions about first year students not being able to handle the complexity of scientific publishing are true. I will present our methodology and some results of our ‘experiment’ in my next few blog entries.

I’m interested in any feedback about your experience with first year students and your perceptions of their abilities with comprehension of research literature. Have you tried readings from the primary literature before in first year or upper year classes? What were the results? How big was your class? How did the students respond?

Part 2 & Part 3 will follow in the next couple days.