Tuesday, 18 August 2009

Anusha, Monica and I have finished a first (short) round of user tests. We got very interesting feedback from them which we will use to design a first online version of the BluePages. We will have a second round in maybe a month time.

In the mean time I am going to give you a brief overview of the process we designed for the user tests.

We recruited a small number of testers from within the Library Services unit plus 2 external voluntiers. Most of these testers do not necessarily belong to any of the groups identified in the Stakeholder Analysis ("researchers", "administrators", and "strategists and disseminators".) As this was the first round and as we had a basic mockup we first needed general input.

We designed a script which had 2 main objectives: (1) to refine our initial design and (2) to identify and embed clear purposes and uses of Research Activity Data in the BluePages. Note: I am aware that this last objective involves more than one or more sets of user tests. However we are using these interactions with testers to start making sense of the features that need to be enhanced to make the BluePages transmit ideas such as collaborations, connections and membership. With this I think we can get acceptance which is an important part of the embedding process.

Introductory Questions1.Ask tester to browse the site for 1 minute (or just to see the frontpage?). From looking at this site, what kinds of information do you think you could get from this site?2.Who do you think this site is designed for? Why?

Tasks1.Name the sponsor for one project run by Prof. AAAAA.2.Obtain a list of collaborators of Prof. BBBBB and email that list to a friend3.You are an academic in the area of statistics who wants to explore new areas of research. For that you are looking for some reading material. You are looking for information about genome-related diseases particularly from studies that use big samples (over 10000).4.You are the Head of the Management department and are going to build a new Decision Making Support laboratory as part of a program to boost research among your staff. As you or your staff do not have any experience with building laboratories that need special computers and software you need to find someone in Oxford who could offer you some guidance. That person could be someone who is an expert in computers and/or works in laboratories.5.You just set up your new project’s website and would like it to be listed in the BluePages. What do you need to do?

Briefing1.Ask again: what kinds of information do you think you could get from this site?2.What is your overall opinion of the BluePages?3.Would you use a site like this? What kinds of information would you be interested in?

We always had two observers during the tests (either Anusha and I or Monica and I) We took turns to ask the questions. We had copies of the script and wrote notes separately. We also gave testers the list of tasks on a sheet of paper.

When we finished I transcribed all the notes and classified them by task or question. I then wrote a summary which highlighted main issues under each task or question.

After this we met to discuss our next strategy. This involves a clearer idea of the data "objects" that are searched for and browsed in the BluePages and the way these objects can be presented and connected. But I won't say more because this is a topic for another post.
Print this post

About this Blog

Cecilia Loureiro-Koechlin

I am the BRII Project Analyst and responsible for this blog. I work at the Systems and e-Research Service at the Bodleian Libraries - Oxford University. E Cecilia.Loureiro-Koechlin@bodleian.ox.ac.uk, T +44 (0) 1865 280028, Contact address: Osney One, Osney Mead, Oxford, OX2 0EW

Project Website

Our Goal

Building the Research Information Infrastructure (BRII) aims to support the efficient sharing of Research Activity Data (RAD) captured from a wide range of sources. BRII develops an infrastructure that harvests and archives RAD, and Web services which disseminate and reuse this kind of data by using a lightweight solution based on semantic web technologies. Phases of the project include: a stakeholder analysis to collect views from interested parties (e.g., academics and administrators); an iterative development process which uses information collected in the analysis phase; and an embedding and sustainability phase where user acceptance is assessed and strategies to support the expansion of the information research infrastructure are designed. Additional outputs of the BRII include: an application programming interface (API) for harvesting and querying data; a collection of ontologies and taxonomies used to organise and classify data; a themed Web site; and the Oxford Blue Pages displaying RAD in creative ways. By facilitating access to RAD, BRII expects to improve the research visibility of the institution and its research impact, as well as boost collaboration.

Rumsey, S. (2010) BRII registry & other outputs A description of the pilot Research Activity Data Registry functionality, services and other outputs that will be developed by the project end (March 2010) and suggestions for further work.

Adding a researcher profile. Video clip demonstrating how to search for a researcher profile in the ORA registry and then embed this in a content managed website.

Loureiro-Koechlin C. (2009) Selling an abstract concept to a practical audience (presented at the Modular e-Administration of Teaching (MEAoT) Assembly, Centre for Applied Research in Educational Technologies (CARET), University of Cambridge, 10 December 2009.)