Moritz Schubotz

University of Konstanz, Information Science Group, Konstanz, DE; and National Institute of Informatics, Digital Content and Media Sciences Research Division, Tokyo, JP

Abstract

We here present DiViDu, a research software, which we developed for a dual task experiment with an integrated divided visual field paradigm. The dual task experiment consists of a lexical decision task with different semantic verb categories, and a complex tapping task with either the left or right hand. The software allows researchers the replication of our experiment, as well as the reconfiguration for further dual task experiments with alternative tapping tasks and stimuli (e.g., word classes, semantic classes, task languages) as well as adjusted experimental settings. Furthermore, with only slight modifications to the source code, researchers can implement various new experimental setups including a large variety of language tasks (e.g., silent and aloud reading, naming, verbal fluency) and non-verbal tasks. The software DiViDu is implemented using the .NET framework and is available under the Apache 2 License on GitHub (https://github.com/dividu/dividu).

Funding statement: The publication of the paper was supported by the Open Access Publication Fund of the University of Konstanz.

How to Cite:
Heck, N. and Schubotz, M., 2018. DiViDu – An Open Source Solution for Dual Task Experiments with Integrated Divided Visual Field Paradigm. Journal of Open Research Software, 6(1), p.14. DOI: http://doi.org/10.5334/jors.199

(1) Overview

Introduction

Neuroimaging techniques like functional magnetic resonance imaging (fMRI) are widely used in research regarding the interaction of the language and the motor system [1]. Nevertheless, behavioural experiments, especially dual task experiments, still play an essential role, as they are inexpensive and readily available [2]. Dual task experiments compare the performance of participants while engaging in two tasks simultaneously with their performance in only one of the two tasks. Thus, they help to understand higher cognitive functions and more specifically the lateralisation of the human brain. To explore the interaction of the motor and the language system, different studies investigate the mutual influence of a language task with different semantic word categories and a simultaneously performed motor task [3, 4, 5, 6, 7, 8]. However, the comparison of the results is challenging due to various experimental settings, groups of participants, a large variety of language tasks and task languages as well as differing complexity and type of motor tasks. Furthermore, lateralisation effects in the interaction of the motor and the language system have been investigated in fMRI studies [9, 10], but rarely in behavioural experiments [8]. Implementing a Divided Visual Field Paradigm helps to investigate hemispheric differences. Therefore, the stimuli are presented on either the left or the right visual half-field only and thus are first processed by just one, the contralateral, hemisphere [2].

We here present a software solution for a dual task experiment that integrates a Divided Visual Field Paradigm. While commercial software like E-Prime® (Psychology Software Tools, Inc.) is available for behavioural experiments, open source software is not only more cost-effective, but also offers different additional opportunities. Our software DiViDu enables researchers, students as well as the interested community to reuse and modify the software for future experiments and thus helps to expand the knowledge in this research field. It enables the replication of our experimental setup, as well as the modification and adaption by modifying the settings as well as the source code. Moreover, the raw empirical data can be shared in an anonymised way. Thus, researchers can collect a large pool of data for retrospective meta-studies.

In the following, we describe the experimental setup, the implementation, the requirements as well as the full range of adaption potential.

Implementation and architecture

Experimental Setup

We developed DiViDu for a dual task experiment, where participants perform either a lexical decision task only (single task) or simultaneously with a complex one-handed tapping task (dual task) (cf., [11] for an overview). The participants perform the tapping task either with their right or left hand, while responding to the lexical decision task with the other hand. Furthermore, all stimuli are presented in the right visual field (RVF) and the left visual field (LVF) (divided visual field paradigm) (cf., Figure 1). The word stimuli contain of hand-related (H) [e.g., clap, write], as well as foot-related (F) action verbs [e.g., run]. We further subdivided the category of hand-related actions words into a group of unimanual (H1) and a group of bimanual (H2) hand-related actions words. The verbs in category H1 describe actions normally performed with only one hand [e.g., write], while the verbs in category H2 describe actions normally performed with both hands simultaneously [e.g., clap].

Figure 1

Experimental setup, exemplary stimulus presentation in the LVF and RVF in the single task (left) and dual task (right) condition for group R.

Every lexical decision sequence consists of the presentation of a fixation cross (800 ms) and a stimulus (180 ms), a response period (3000 ms maximum) and an interstimulus interval (1200 ms) (cf., Figure 4).

The complex one-handed tapping task consists of six steps (2-3-4-5-2-5) with the index (2), middle (3), ring (4) and little (5) finger of the right or left hand.

The participants enter the lexical decision response (word/pseudoword) as well as the complex tapping task sequence on a regular, but rotated, keyboard (cf., Figure 1). In our experiment, one-half of the participants (group R) performed the tapping task with the right and responded to the lexical decision task with the left hand. We recorded F11 (word) and F12 (pseudoword) key inputs for the lexical decision response, as well as F4, F3, F2 and F1 key inputs for the tapping input. The other half of the participants (group L) performed the tapping task with the left hand and the response to the lexical decision with the right hand. We recorded F2 (word) and F1 (pseudoword) key inputs for the lexical decision response, as well as F9, F10, F11 and F12 for the tapping input. Furthermore, we recorded the reaction time for the lexical decision responses as well as the sequence of the tapping keys and the intertap intervals, reflecting the period between key down of one of the tapping keys and key down of the next tapping key. We subdivided the experiment into different parts, separated by breaks. The participants determine the length of the breaks. Moreover, the participants initiate the start of the entire experiment as well as the continuation of the experiment after a break. In our experiment, we defined breaks after every 80 stimuli presentation. At the beginning of the experiment, as well as when changing task condition (from a dual task condition to single task condition or the reverse), participants see an instruction screen for 3000 ms (cf., Figure 2).

Figure 2

Instruction screens.

In addition to the main experiment, our participants performed a training task (cf., Figure 3), a dual task setting with a tapping task and a non-verbal task. Therefore, the software displays a yellow or red bar instead of a word or pseudoword. We instructed our participants to respond according to the colour but not the position of the bar. During the training task, the response ‘yellow’ is entered with the word key, while the response ‘red’ is entered with the pseudoword key. We implemented the training task to accustom the participants to a dual task, as well a visual field experimental setting.

Figure 3

Training task.

We implemented DiViDu using the most straightforward programming technology to ensure that scientists with limited programming experience can understand and change the source code. We use the programming language Visual Basic in the Visual Studio 2017 framework. Visual Studio has a very convenient debugging interface, which allows less experienced programmers to experience a direct connection between the current state of graphical user interface and the position in the source code.

Our software has a global state. The main loop iterates through a trial list until the end of the list is reached. The three data sources, the keystrokes for the tapping input and the lexical decision input, as well the information from the trial list, are written into a joint log file.

In addition to state altering keypress events, we use a stopwatch control to record the duration between the keystrokes (reaction time for the lexical decisions and intertap intervals for the tapping). Furthermore, we use a stopwatch (timer) to advance the state in between the sequence. The flow diagram of our software DiViDu is shown in Figure 4.

Figure 4

Flow diagram.

Trial list

We defined the stimuli, as well as the presentation settings and the task condition for each stimulus in four different trial lists (cf., Table 1). Our original German trial lists are provided via GitHub. Table 1 shows exemplarily a section of the trial list in English. The trial list includes the stimuli (1) and the visual field setting (2) [LVF/RVF]. Furthermore, it specifies the stimulus type (3) [pseudoword (TRUE)/word (FALSE)], the task condition (4) [dual task condition (TRUE)/single task condition (FALSE)] the semantic word categories (5), as well as the subcategories (6).

Table 1

Exemplary trial list for the lexical decision task.

Stimulus (1)

VisualField (2)

Pseudoword (3)

Tapping (4)

Wordcategory (5)

SubCategory (6)

run

LVF

FALSE

TRUE

F

F

lun

LVF

TRUE

TRUE

F

F

plap

RVF

TRUE

TRUE

H

H2

clap

RVF

FALSE

TRUE

H

H2

run

LVF

FALSE

TRUE

F

F

lun

RVF

TRUE

FALSE

F

F

plap

LVF

TRUE

FALSE

H

H2

clap

RVF

FALSE

FALSE

H

H2

write

LVF

FALSE

FALSE

H

H1

grite

LVF

TRUE

FALSE

H

H1

Output file

The software provides a separate CSV output file for each participant. The output table (cf., Table 2) includes the date and time of the experiment conduct and a comment (2) which signalises the instruction period at the beginning of a new task condition. Thus, row 2 reflects no lexical decision results, but the key input (tapping sequence and intertap intervals) during the instruction period. The following columns reflect the stimuli information including the stimulus type (3), the visual field setting (4), the task condition (5), the table includes the stimuli (6), the word category (7) as well as the subcategory (7). Finally, it contains the correctness of the response (correct/incorrect/timeOver) (10) and the reaction time (11). Thus, ‘timeOver’ reflects a missing response after a defined response period, in our experimental setup 3000 ms.

Quality control

We provide a test trial list in English, which allows developers to perform a manual test with overall 20 stimuli. The test trial lists will automatically be installed with the software, the setup covers all possible states of our software so that the user can quickly ensure the integrity and stability of the software. The only requirement for this test is a break-distance setting smaller than the stimuli number (e.g., 5), to reach and test the break state. After every modification of the source code, the user should carefully check the following physical parameters of the experimental setup: (1) Correct size of the stimuli on the screen with respect to the screen resolution and the physical dimensions of the screen and (2) Correct timing of the experimental trials and the recording of the time periods and (e.g., with a high-speed camera).

(2) Availability

Operating system

Windows 7, 8, 10

Programming language

Visual Studio 2017 (Visual Basic)

Additional system requirements

To collect valid data for scientific purposes, users should ensure the following requirements and provide the following equipment. To download and use the software, users need a Windows PC and a screen with a minimal size of 15-inch. After the start of the software, users have to specify their screen size in the settings. The software is preconfigured for a 1280 × 1024 px (non-curved) screen. Furthermore, the reaction time of the screen should be considered for the precision of the presentation setup. and a chin rest is needed to ensure a constant distance between the eyes of the participants and the screen. The software is preconfigured a distance of 60 cm between eyes and screen. See [2] for recommendations regarding the position of stimuli presentation (visual angle) and presentation period in divided visual field experiments. Additionally, an input device (number pad or regular keyboard) is needed. Again, the delay of the keyboard should be considered for the precision of the reaction time for the lexical decision input as well as the intertap intervals. Furthermore, a low-stimulus environment (i.e., appropriate seating, quiet, well-tempered room) as well as controlled light condition, preferably dimmed room with a single light source on the ground, is essential for reliable participants performance.

Software location

Code repository

Language

English

(3) Reuse potential

Behavioural experiments regarding the interaction of the motor and the language system include various language and motor task. The language tasks comprise lexical decision [3], [8], reading [5], naming [12], verbal fluency [6] and verbal memory tasks [7]. Similarly, the complexity of the motor task highly various between the experiments including only one [6] or both hands [7]. Furthermore, the task and stimuli language, the experimental setup as well as the used software differs between the experiments [4, 5, 6, 7, 8], [12]. Open Source software allows researchers to reproduce results, as well as to modify only one or a few aspects of an experimental setting to produce comparable results. In the following, we will describe the reuse potential of our experiment by adapting, the trial lists, the settings as well as the source code.

The modifications of the trial lists allows users to modify the stimuli type and language.

Settings

Furthermore, the adaption of the settings (cf., Figure 5) at the beginning of the experiment, allows users to modify the software to their specific needs regarding timing of the presentation sequence, the number and location of the input keys and the labels of the instruction screens. The settings from the last usage remain stored as defaults for the next usage. Thus, it is easy to perform a sequence of experiments with identical settings.

Figure 5

Experimental settings.

The user can specify the input keys, for the tapping task as well as for the language task, in number and location. Thus, the software allows a large variety of tapping tasks, ranging from a simple one-finger tapping to a complex tapping sequences with up to five fingers. As DiViDu records the tapping sequence, the experimental setup allows not only the analysis of the tapping frequency, but also the analysis of errors in the tapping order.

For the language tasks, binary decisions, as well as decisions with more than two response keys can be performed. If the experimental design includes two groups that perform the tasks with different hands, the user can define the tapping hand at the beginning of the experiment.

To easily adapt the experiments for participants with different languages and different tasks, users can specify the labels for the start, break and final instruction as well as for the task instruction.

Moreover, the user can define the duration of the individual states in the presentation sequence (task instruction, fixation cross-presentation, stimulus presentation, response screen as well as the interstimulus interval).

The instructor can define the time between the start of the software and the beginning of the experiment, as well as the break duration. Alternatively, the instructor can choose an extended period and let the participant start the experiment, as well as initiate the continuation of the experiment after a break of desired length, by pressing the ESC key. Furthermore, the number of stimuli to be performed between two breaks can be defined accordingly to the entire number of stimuli and the complexity of the dual task setting.

Adaption of the Source Code

The software structure allows additional experimental setups for a large variety of behavioural experiments. In the following, we present some possible adaption for future research.

Language tasks

Instead of a here performed lexical decision task, the software structure provides the opportunity for a large variety of language tasks in dual task designs. Tasks include reading tasks either silently or aloud. A divided visual field paradigm, due to the stimuli location as well as the short presentation period, limits the stimuli to words. Presenting the stimuli in a central location (excluding a divided visual field paradigm) allows reading tasks with phrases or sentences. Furthermore, semantic as well as phonological decision task can be implemented by adapting the input keys and the stimuli. Moreover, by implementing pictures instead of verbal stimuli, a naming task can be implemented. A more challenging adaption includes speech recording or audio output for verbal memory or speech comprehension tasks.

Motor tasks

We here describe a dual task experiment with a complex one-handed tapping task. As mentioned above, multiple different one-hand tapping tasks can be implemented by adapting the settings at the beginning of the experiment. Furthermore, the adaption of the source code, as well as the usage of alternative input devices, allow a huge variety of different motor tasks. These include motor tasks with other body parts (i.e., feet). Language tasks that do not require key input (e.g., reading, verbal fluency, verbal memory tasks), allow motor task input with both hands or feet.

Nonverbal tasks

The implementation of pictures instead of word stimuli, can either be used for naming tasks [13], or non-verbal tasks. Thus, the experiment is not limited to investigating the interaction of the language and the motor system, but can also be used for other research fields.

Divided Visual Field Paradigm

Our software uses a divided visual field paradigm and thus presents all stimuli in the LVF and RVF. Minor adaption of the software allows the presentation of stimuli in both visual field or a central presentation (excluding divided visual field paradigm).

We here use a simple fixation cross to ensure the central fixation prior to the stimulus presentation in the LVF or RVF, and instruct the participants to fixate the fixation cross. The presentation of a letter or digit, which participants report afterwards, increases the central fixation rate, but can also interact with the following task [2].

In conclusion, our software DiViDu offers a variety of possibilities for neuropsychological research experiments. By adapting the settings as well as the source code, it allows users with and without programming skills to adapt the software to their specific needs. Furthermore, as freely available software, it helps researchers to replicate the experiments of other research groups as well as to investigate other fields, but comparable experimental setups.

Support

Users are encouraged to report issues on GitHub and make pull request.

Postle, N, Ashton, R, McFarland, K and de Zubicaray, G I 2013 “No specific role for the manual motor system in processing the meanings of words related to the hand.” Front. Hum. Neurosci., 7(11). Jan. DOI: https://doi.org/10.3389/fnhum.2013.00011