What Does Student Engagement Mean in your Discipline?

Journal - New Directions for Teaching and Learning JournalA summer 2018 volume of New Directions for Teaching and Learning focuses on student engagement. Ten chapters worth!

One interesting chapter, Students Engaged in Learning, is worth a close read. (the link to the full article can be found at the bottom of this post). The authors, Emad Ismail and James Groccia, provide a compelling structure for the chapter.

The article is presented in this fashion—research findings related to engagement in the cognitive domain, followed by research on engagement in the psychomotor domain, and finally, of research literature pertaining to engagement in the affective domain. Several meta-analyses are cited. Rather than delve deeply into any single research article, I thought it might be more interesting to talk about the research he cites as part of each section (after all, you can read the full article yourself). The remainder of this post presents a short summary of the research he cites related to cognitive engagement:

Leaf

Discipline: Biology
Title:Teaching More by Lecturing Less
Findings Snippet: “The results we present here indicate that even a moderate shift toward more interactive and cooperative learning in class can result in significantly higher student learning gains than achieved using a standard lecture format.”

Authors: Knight and Wood
Year: 2005

Discipline: Biology
Title:Cooperative and Active Learning in Undergraduate Biological Laboratories at FIU– Implications to TA Teaching and Training

Findings Snippet: Teaching assistants underwent a 2-day training workshop to implement cooperative learning and active learning techniques for Biology courses, and the results were very positive. Responses from instructors indicate “an increase in the cognitive level of the material communicated, learned, and assessed”, in addition to “an increase in their [students’] ability to devise and practice scientific experimentation.”|
Authors: Penwell, Elsawa, and Pitzer
Year: 2004

Cell FusionDiscipline: Physics
TitleInteractive-Engagement vs. Traditional Methods: A Six-Thousand-Student Survey of Mechanics Test Data for Introductory Physics Courses
Findings Snippet: “The conceptual and problem-solving test results strongly suggest that the classroom use of interactive-engagement methods can increase mechanics-course effectiveness well beyond that obtained in traditional practice.”
Authors: Hake
Year: 1992

Discipline: Physics
TitleCan Students Learn from Lecture Demonstrations?
Findings Snippet: “Students who had a chance to predict an outcome of a demonstration prior to seeing the demonstration achieved a significantly higher success rate of 25% to 35%.”
Authors: Milner-Bolton, Kotlicki, Rieger
Year: 2007

Human BrainDiscipline: Psychology
Title:Keeping it Short and Sweet: Brief, Ungraded Writing Assignments Facilitate Learning
Findings Snippet: “These results suggest that in-class writing and discussion improved performance on factual and conceptual multiple-choice exam questions, beyond any gain from time for in-class thinking and discussion.”

Authors: Drabick, Weisberg, Paul, and Bubier
Year: 2007

Physical ChemistryDiscipline: Physical Chemistry
Title:“I Believe I Will Go Out of This Class Actually Knowing Something”: Cooperative Learning Activities in Physical Chemistry
Findings Snippet: “We found that cooperative learning activities move students away from rote learning strategies and toward more meaningful strategies which allowed them to integrate concepts over the entire semester.”

Authors: Towns, Grant
Year: 1997

Two PeopleDiscipline: Human Resource Management
Title:The Immediate Feedback Assessment Technique (IF-AT): An Innovative Teaching Technique for Human Resource Management Students
Findings Snippet: “…through the use of Team Based Learning and the incorporation of the IF-AT students’ skills in the areas of communication, overall learning, cognitive and interpersonal skills through the use of teams or groups of students was enhanced. Authors: Blackman, Michaelsen, Knight, and Fink

Year: 2004

StatisticsDiscipline: Statistics
Title:Evaluating an Active Learning Approach to Teaching Introductory Statistics: A classroom workbook approach
Findings Snippet: “The activity based curriculum evaluated here produced significant positive changes in students’ attitudes toward statistics. Specifically, after experiencing the workbook curriculum students liked statistics more and were more confident in their ability to perform and understand statistics.”

Authors: Carlson and Winquist
Year: 2011

Robot ArmDiscipline: STEM
Title:Effects of Small-Group Learning on Undergraduates in Science, Mathematics, Engineering, and Technology: A Meta-Analysis
Findings Snippet: “The meta-analysis demonstrates that various forms of small-group learning are effective in promoting greater academic achievement, more favorable attitudes towards learning, and increased persistence….”
Authors: Springer, Stanne, and Donovan
Year: 1999

Discipline: STEM
Title:Active Learning Increases Student Performance In Science, Engineering, And Mathematics
Findings Snippet: A meta-analysis of 225 studies discovers that (on average, based on effect size) student performance on exams and concept inventories increased by .47 SDs when faculty utilized active learning strategies and methods (n=158 studies).

Authors: Freeman et al.
Year:2014

Human PhysiologyDiscipline: Human Physiology
Title: The Effect of Active Learning on Student Characteristics in a Human Physiology Course for Nonmajors

Findings Snippet: “Students in a treatment group [taught using a continuum-based, actdive-learning model] acquired significantly more content knowledge and were significantly more efficacious than students in the control groups [taught using traditional didactic lecture methods].”
Author: Wilke
Year: 2003

William Buskist, a co-editor in this volume, presents in a most familiar way the issue of student engagement that many of us are struggling with:

Are there universal principles of instilling student engagement that apply across students, disciplines, and institutional settings, and if so, what are they? Do these principles similarly or differentially affect the domains of doing, feeling, and thinking? Once students become engaged, what are the most effective methods of keeping them engaged throughout the remainder of their college careers in terms of doing, feeling, and thinking?

Thankfully, the research provided in this chapter illustrates that yes, universal principles do exist.

The full article is available here.

Icons courtesy of icons8.

Improve Student Note-Taking

2014 study by Mueller and Oppenheimer indicated that students who took notes in class with their computer performed more poorly than students who took notes by hand.

67 students participated in the research study, and students were asked to use their typical note-taking method (laptop or longhand) while watching a video. Although students who typed their notes on the computer were able to recall facts equally well (no statistical difference found), their performance on conceptual-application questions was significantly worse (M = -0.156).

A 2012 study by Aguilar-Roca, Williams, and O’Dowd of 400 students found a correlation between exam performance and note taking preference—those who took notes by paper scored significantly higher than those who took notes on a laptop (p < 0.01, paired t-test). And Kraushaar and Novak, in 2010, discovered that students with laptops engaged in substantial multitasking behavior about 42% of the time (defined as surfing, entertainment, email, instant messaging, and updating computer software).

So what does this mean for us as faculty? Does this suggest we ban laptops overnight in our classes? Not necessarily.

Teasing out these questions (and potential solutions) is best addressed in the department meeting, committee, or faculty task force. But in the meantime, there are steps you can take to begin shaping the conversation with your own students.

Explain to your students, in the context of empathy and care, that you want to see them succeed in every way, and that these studies have you thinking differently. Tell them that isn’t that you want to take their laptop away; it’s that others who have taken this subject seriously enough to study it, have determined that it has a real impact. They are here to learn, after all.

Still, if you’re unsure how they will respond to a sudden change in classroom policy, poll them anonymously. Gauge their reluctance, and tell them you’re thinking about a change (sleep on it).

If and when you are ready to be more intentional about your students taking notes by hand, consider modeling the way. It is entirely possible that your students have never taken notes by hand, or received any feedback whatsoever about the quality of the notes they write. Show them an example of what good notes and poor notes look like

Or you might simply try it with them in a low stakes manner —lecture about a topic for 5 minutes, then ask them to share out loud what they wrote. If they are reluctant, take them up, then read a random few. Have a conversation (non-judgmental, of course) about the differences in how people process what they hear. Ask them whether you talk too fast or too slow. The conversation could be quite fruitful.

If you are in the planning phases for next term’s courses, consider using a syllabus statement, a short paragraph that explains the importance of note-taking. Given that most faculty go over their syllabus that first week, this is a logical place to include it. We’ve created an example of one below, and it’s plug-in ready (just copy and paste).

Indent the text below 1 inch and include a cursor pointer directly to the left of it.

Example of Syllabus Statement (feel free to copy or modify):

Recommendations for Note-Taking:
Those who study how people learn recently discovered something very interesting. Students who take notes by hand perform better on exams than students who take notes on their laptop (on concept-based questions). Students who use laptops to write down exactly what they hear or see can find themselves unprepared for an exam. Why? Because at the time the material was shared, their brains were not processing and storing what they learned. They merely copied what they heard. So try these things:

 

  • Close your laptop during lecture or any other material that is going to be on your exam. Write down, on paper, what is being said.
  • During class, as I’m speaking, write down, in your own words, what I’m saying. Sometimes this will be easy; sometimes this will be hard. When it’s hard, write down the words I’m using and as soon as class is over (or within an hour or two), rewrite it in your own words.
  • If I give you a PowerPoint handout, with the slides on it and areas in the margins to write, write something in the margins as I go. Elaborate in your own words, if you can. You might also ask questions you can later return to. Elaborating really does help you store (and later retrieve) the material.
  • Let me know if you’d like me to slow down.

 

Additional Readings:

Aguilar-Roca, N. M., Williams, A. E., & O’Dowd, D. K. (2012). The impact of laptop-free zones on student performance and attitudes in large lectures. Computers & Education59(4), 1300-1308.

Kraushaar, J. M., & Novak, D. C. (2010). Examining the affects of student multitasking with laptops during the lecture. Journal of Information Systems Education21(2), 241.

Mueller, P. A., & Oppenheimer, D. M. (2014). The pen is mightier than the keyboard: Advantages of longhand over laptop note taking. Psychological science, 25(6), 1159-1168.