Menu

Tag Archives: Evaluation

The final day of the first semester was a little unusual. The morning was given over to a review of the assignments for this module which are to complete the UKPSF form, critique a learning session, analyse a learning theory, and write a report on the experience of peer observation, comparing the experience of being the observer and the observee. Drafts are due at the end of semester 2, with final versions by September. All well and good, and all covered in the module guide. This session didn’t add anything, and yet we did literally spend the entire morning debating it. Strange things happen when you have academics as students.

The afternoon session was more useful. First there was a short presentation on evaluation in general, why and how to do it, followed by an introduction to nominal group technique. A definition of evaluation was given as ‘assessing the process and practice of a prior learning strategy or event by feedback and trying to make objective summaries of an often subjective interpretation.’ This was followed by a discussion on the different types of evaluation – student, staff, data, and self – and the difference between quality assurance, which is backwards looking and tends to be about accountability, and quality enhancement, which is about how to improve and develop your programme or module.

With quality enhancement in mind, nominal group technique was then introduced followed by actually using it to evaluate this first semester. As a group, and with the programme leader absent, we drew up two lists of ten to twelve points of things that are going well, and things which we think need to be improved. These were written on a board in no particular order, then individually we had ten votes, or points, with which to rank what we thought were the most important points. So for example, if you thought that ‘over-assessment’ and ‘use of VLE’ were the two most important things that needed to be improved upon, then you could give each one five votes. The programme leader was then invited back in and the votes were added up to show what we collectively ranked as the most important things for improvement, and what we felt was going well. The outcome of this evaluation will be actively used in the development of the programme for the second semester.

Ah! Blackboard, my old friend, it’s been a while. Since we’re officially in the market for a new VLE now, the team dipped into one of Blackboard’s roadmap webinars to see what’s new.

The first thing I noted was that the webinar was delivered using the classic version of Blackboard Collaborate, not Ultra, which I later learned is because Ultra is currently limited to 100 participants. They are working on upgrading this to 250, with 1,000 users under consideration for further in the future. This was the first time I had seen Ultra in any detail and it looks so much nicer and smoother than classic Collaborate. It’s entirely browser based, with no downloads or plugins required, which is great as this is still the major stumbling block for collaborative and conferencing tools. There are also still some features of classic that haven’t made it into Ultra yet, including Breakout Groups and Polling, though they are on the roadmap. For this reason most institutions are running with both version at the moment, a possible source of confusion.

Next up was the core product, Learn, which still looks very much like it did when I left Northumbria which was on 9.1 with Service Pack 14 at that time. Blackboard showed some screenshots of how it is going to evolve as they integrate the design language from Ultra (naughty screenshot above), which is also going to include significant improvements on responsive design in many areas. Under the hood they are upgrading the JDK to version 8 and introducing support for SQL Server 2014.

In spite of the efforts to improve Learn with responsive design, they are also still supporting and developing a number of iOS and Android mobile apps. The old Blackboard Mobile Learn app looks to have been abandoned now – no updates to the iOS version since September 2014 – but they are still supporting it for existing users. This has been superseded by the new Blackboard Student app, with a Blackboard Instructor app under development for staff. As a stopgap they have released Blackboard Grader for staff which allows you to grade and provide feedback on assignments.

Finally there was discussion of the various models of provision. Though self and managed hosting are still available, they are actively encouraging people to migrate to their new SaaS and continuous release model.

TEL AND ED TWEETERS

ABOUT

This is my personal, professional blog: personal in the sense that it is entirely my own work, professional in the sense that it's purpose is to 'talk shop'. All content and views expressed are wholly my own and may not represent those of The University of Sunderland, Northumbria University or any other organisation with whom I am, or have been professionally involved.

COOKIES

Some of the technologies used to create this blog use cookies, and you may not want third party cookies to track you across different websites. For more information about EU Cookie Law see this page on the ICO's website, and for instructions on how to restrict cookies in all popular browsers, please see here on aboutcookies.org.