Kate Boardman, University of Teeside
Looked at what Teeside’s staff were actually doing with Blackboard in the light of minimum standards that they had set up, their e-learning framework and they found that the results were in fact “quite scary”.
She started by asking the rhetorical question “If you were asked by one of your Pro Vice Chancellors about the state of e-learning across the campus, what would you say?” You might, um and ah and say, well we’ve got so many modules on Blackboard – for example, at Teeside 80% of modules have a Blackboard site. But of course, “having a Blackboard site” doesn’t necessarily mean that e-learning is taking place. If this hypothetical PVC was to then ask you to be more candid about the exact nature of the e-learning that was taking place, how would you describe that? Kate mentioned a survey that had been done that said 98% of students said the most useful thing that could happen with Blackboard would be if their other lectures used it. That suggests to me that the students do actually use Blackboard, but that not many of the modules are actually used.
Teeside have set up minimum criteria for their Blackboard sites. They must have
-
A clear navigation menu
-
Staff details
-
A module guide
-
An overview of how the module will be delivered
-
Content organised in folder
-
No empty areas
-
Delivery schedule
-
Assessment information
-
Submission instructions
-
Assessment feedback
-
Copies of all teaching materials
-
Regular announcements
-
Link to current reading lists
Setting minimum standards is to invite the obvious question of whether modules actually meet them. It was time for a reality check. The evaluation team employed a Peer observation and review methodology, which basically employed 20-25 students in each school to review the modules with a brief to look at e-quality (which I imagine means whether the sites meet the minimum standards) across schools, levels, subject groups, and staff. Kate also suggested that presentation is important creating and interesting online module presence and reported a finding that students frequently comment adversely on sites that are difficult to navigate, This makes some sense because presentation is part of the communication process with students. She reported that only 26% of Teeside’s sites had changed from the default appearance provided by the University. It would be quite interesting to conduct a similar survey here, although I’m not convinced that this is quite as important as Kate seemed to think. If the default appearance provides adequate navigation, then there seems to be little value in changing it for the sake of aesthetics. Another aspect of communication is the obvious one of how many announcements have been made in the site? Over 60% of Teeside’s module had none.
More significant , I thought, was the issue of construction – in a higher level module it is not unreasonable to expect students to demonstrate a higher level of knowledge and understanding of the subject matter by constructing relevant information. Blackboard provides tools such as blogs, but the trick is to ask what students are doing, not whether or not the Blackboard site has a wiki. Although, again according to Kate, 89% of the sites at Teeside did not provide any opportunity for students to produce or publish the results of their own work.
I suspect that a similar review conducted at Lincoln, or pretty much any university would probably produce similar results. On the plus side, any intervention makes people think about their teaching. Kate echoed Andy Ramsden’s keynote with her suggestions about how Teeside proposed to tackle the situation. She basically advocated a return to sound principles, including the encouragement of contact between students and teaching staff, the development of on-line activities, the production of self test assessments, which importantly provide the students with feedback, and the provision of media rich content. That of course raises the question of how you do this. The old idea of providing staff development workshops, she thought, (and I agree) doesn’t work, because they are not immediately relevant to most people’s needs. (Which actually raises the question of why we still think the lecture meets students’ needs, but I digress). Instead we should be focussing on small steps taken by individuals. When people do raise an issue we should be working with them, on a one-to-one, and just-in-time basis if necessary. We should then write up the case study and publicise it as widely as possible. The more case studies we have, the stronger our understanding of what e-learning is going on in the University.
[…] Although Blackboard would generate statistics in a different way from Moodle, I’m sure a similar approach could be developed. I’m not sure however to what extent this system would be workable at TVU. There is such a diverse range of courses (Programmes and/or Modules), and such a diversity of ways in which Blackboard courses are used, that the bare statistics might be meaningless. But definitely worth investigating. (As a comparison, see this report on a presentation by Kate Boardman, from the University of Teesside, at the 2009 Durham Blackboard Conference: Time For a Reality Check? How Many Courses do you Really Have that Make A Difference to Learning?) […]