Earlier this week I was asked to evaluate an online training program developed by a firm for employees. Like so many other online programs I have reviewed or written myself, there was a heavy emphasis on discussion boards. Research on this topic state that social activities increase motivation and satisfaction in the classroom (Richardson & Swan, 2003) and discussion boards are an obvious way in an online program to replicate the social experience. However, this is not the only tool that should be used in these types of programs. Alternatives are required to allow students time to reflect and to ensure appropriate levels of understanding.
Discussion between students through the use of forums is a great way to encourage engagement and social learning in online classrooms. However, engagement with instructors through this tool can be spotty and intermittent. Online classrooms are known for large student enrollment. Most of the courses I have taught online average 35 - 40 students. I typically require 2 discussion boards a week, two responses for each discussion by each student. In a class of 35 students, that would require me to read and respond to 70 discussions a week and review upwards of 140 responses. It takes approximately 15 - 20 minutes to respond to a graded discussion with feedback. This is nearly 23 hours a week on discussion grading alone! This can vary, of course, depending on the length and content. For many of us we have more than one class we are teaching, and we like to enjoy a little bit of personal life as well. It is difficult for the instructor to provide relevant, real-time feedback on every student's discussion board. What ends up happening is that instructors grade on participation, and provide feedback to only one or two discussions a week. And the grading feedback doesn't happen until the topic being graded has completed and the students have moved onto a new topic. Not very relevant or real-time. If the student does read the feedback given, they quickly disregard it as they have moved onto something new.
Students need consistent and timely feedback to ensure they truly understand the objectives of the course. It is to easy to fall through the cracks when discussions are the only tool used to assess learning in online courses. It is not feasible to add another assessment that requires review and grading feedback by instructors. This just adds to the original issue. Rather, instructors need to identify other assessment methods that allow the students to reflect on what they have learned and gain instant and automatic feedback on their progress.
I often provide critical reflection questionnaires (CRQ) to my students throughout the course to gain their feedback on what is working well, and what they would recommend changing, in regards to the class structure and instruction. This semester a student asked a great question that helped me identify a way to provide this automatic and and instant feedback. I was using a collaborative learning environment for one of the first times and the student asked that I provided them with ungraded tests each week so they can validate that they are "getting it". As the collaborative environment was team based, the student wanted to ensure that they were understanding the materials discussed on an individual level.
A month after getting that feedback I was asked to join a group of students and another instructor on a trip to an entrepreneurship conference. Although my interest areas are leadership and education, I attended because I was told that a well-known instructor would be speaking there. She taught entrepreneurship, but I was more interested in her teaching techniques. She had a history of providing unique and alternative teaching methods in her classroom. The university she worked for is known for developing some of the best entrepreneurs in the country. I had an opportunity to discuss with her some of my experiences in the classroom and she made a comment to me that hit home. She stated that students need a time to 'reflect' on what they have learned. It is not only important to provide them with the knowledge, reinforce it through discussions and assignments, but to allow them to look back on what they have done and reflect on what they have gained.
I applied these two pieces of knowledge to my online classes first. One of the easiest ways to incorporate reflection and instant and automatic feedback in the classes was to develop (as my student recommended) ungraded quizzes each week that included application driven questions on the current topics. It not only provided the students with a safe method for them to identify immediately if they were 'getting it', but it also provided me with instant feedback on their progress. I now had the ability to identify trends in learning and a method to evaluate if the reading, discussions, and recorded lectures were helping the students understand the required objectives. If I noticed that several students were missing a few of the questions on a particular topic, I could reinforce that in a later week, or add a supplemental lecture on it. These quizzes were optional for the students each week, and I realized approximately a 50% participation rate. I may adjust that in future classes to see if I can get better participation. I also plan on incorporating the same technique in my bricks-and-mortar classes.
The time I spent creating the assessments averaged 30 minutes per test. In a traditional semester of 16 weeks (with a few weeks off for midterms/special projects/etc) I average approximately 20 hours of total development time. This is a much smaller impact than changing my grading behavior on discussions. I can now continue to leverage the social rewards of discussions, while giving the students time to reflect on the topic of the week. I also now had a method of measuring student progress in a way that was more objective than just student interaction and participation.
Nice Post! Very interesting!
ReplyDelete