FAQs

Reliability and validity measures for the VB-MAPP.

Two measures of reliability on administering the VB-MAPP can be found in the paper by Barnes, Mellor, & Rehfeldt (2014) titled “Implementing the Verbal Behavior Milestones Assessment and Placement Program (VB-MAPP): Teaching Assessment Techniques.” These authors examined the administration of the VB-MAPP by two school psychologists under two conditions. In the first condition the psychologists, who had no history of administering the VB-MAPP, read the administration manual then administered the assessment. The second condition was conducted following additional training using a VB-MAPP behavior skills training (BST) package consisting of 5 components: instructions, modeling, rehearsal, feedback, and remedial teaching. Administration performance was measured on a 35-item checklist based on the information in the VB-MAPP administration guidelines. The results showed just reading the manual alone resulted in an average administration score of 57% on the checklist, with an interobserver agreement (IOR) score of 83%. Reading the manual and obtaining specific training with a BST package produced an average administration score of 92%, with an IOR score of 86%. Thus, VB-MAPP administration performance is clearly enhanced through additional hands-on training involving instructions, modeling, rehearsal, feedback, and remedial teaching. And the reliability measures on test administration were consistent across the two different levels of staff skills.

Two types of validity measures on the VB-MAPP have been published in the literature. External validity between the VB-MAPP and the assessment program Promoting the Emergence of Advanced Knowledge Relational Training System (PEAK) was examined by Dixon, Belisle, Stanley, Rowsey, Daar, & Szekely (2015). These authors found that “The results of a Pearson correlation suggest that there is a strong relationship between the two assessments (r=0.8266, p<0.0001), and that total scores on the VB-MAPP are a strong predictor of total scores on the PEAK-combined (R2=0.6833)” (p. 228). Dixon, Carmen, Tyles, Whiting, Enoch, & Daar, (2014) also demonstrated acceptable external validity measures between the PEAK and the Peabody Picture Vocabulary Test, providing additional indirect validity support for the VB-MAPP.

Construct validity and reliability for the intraverbal section of the VB-MAPP was demonstrated in a study by Sundberg and Sundberg (2011). In this study 39 typically developing children between the ages of 23 and 61 months old were assessed on an 80 item intraverbal subtest, and their results were compared to those of 71 children with autism on the same subtest. Reliability measures on the scoring of the intraverbal responses across both groups averaged 93%. The results demonstrated that the performances of typically developing children reflected the gradual increase in the difficulty of the intraverbal items, and their chronological age. The scores of children with autism followed a similar pattern, but age was not the best predictor of performance, rather, the presence of pre-requisite verbal skills was a better indicator of intraverbal performance. The authors concluded “The current data suggest that the intraverbal repertoires of typically developing children can provide a guide for intraverbal assessment and intervention for individuals with language delays” (p. 37). The results of this study were used as a basis for sequencing the skills in the intraverbal domain of the VB-MAPP.

Has the VB-MAPP been used in research?

Yes, the VB-MAPP has been used as a tool to measure the participants' verbal skills, as well as other uses, in studies published in several different journals including the Journal of Applied Behavior Analysis (JABA), The Analysis of Verbal Behavior Journal (TAVB), Research in Autism Spectrum Disorders, Behavior Analysis in Practice, and the Journal of Developmental and Physical Disabilities. It has also been used in several studies presented at conferences, and appears in various ethics scenarios in Bailey, J.S., & Birch, M.R., (2016) Ethics for Behavior Analysts, 3rd ed. New York and London, Rutledge. Below are 43 research studies that have used the VB-MAPP for quantifying the verbal skills of their participants. Note the use of the VB-MAPP as a pre- and post-measure of the effects of an intervention program in the study by Mason & Andrews (2014).

How does the VB-MAPP address areas in the DSM-5?

The VB-MAPP Barriers Assessment specifically assesses areas identified in the American Psychiatric Association's Diagnostic and Statistical Manual, Fifth Edition (DSM-5) diagnostic criteria for Autism Spectrum Disorder. The VB-MAPP barriers include all the areas identified in the DSM-5, and then some http://www.cdc.gov/ncbddd/autism/hcp-dsm.html In the VB-MAPP they are written in behaviorese, but that is so they can be assessed and addressed in a behavioral manner. You'll find that the DSM's A 1.2.3. are mostly among the first 8 VB-MAPP Barriers. The DSM's B 1.2.3.4. are mostly among the last 8 barriers.

Is there an electronic version of the assessment?

Yes, the VB-MAPP App is available from the Apple iTunes store. The VB-MAPP App allows the user to complete the assessment on the Apple iPad. The App offers portability and does not require an internet connection once it has been downloaded. The App has no monthly or yearly subscription, and additional students can be added as needed. For more information go to www.behaviortrackerpro.com or the iTunes store.

There is also a

new web-based VB-MAPP

that can be used with any device or platform that has internet access (www.vbmappapp.com).

For what ages can the VB-MAPP be used?

The VB-MAPP can be helpful for an individual of any age whose language skills are not commensurate with the language skills of a 4-year-old typically developing child. Keep in mind that a typically developing 4-year-old has some very sophisticated language skills. The Barriers Assessment and the Transition Assessment components in the VB-MAPP may reveal problems that affect individuals of any age, such as prompt dependency, difficulty adapting to change, or when demands weaken their motivation.

Can the VB-MAPP be used for individuals with other developmental disabilities?

The VB-MAPP can be helpful for any individual who demonstrates language delays, regardless of the disability.

What programs might be helpful after a child has progressed past the academic areas in the VB-MAPP?

Some children with ASD may excel in the academic skills listed in the VB-MAPP, and be “off the grid” in the reading, writing, and math. However, they may still be at lower levels in other areas such as social, play, and the verbal operants (mand, tact, listener, intraverbal). They also may continue to present barriers that require intervention and on-going monitoring. This is not atypical for children with ASD. To support their academic strengths while continuing to build the other areas, we suggest the books ABA Curriculum for the Common Core – Kindergarten, and ABA for the Common Core – First Grade, by Sam Blanco. We also suggest the tried and true Teach Your Child to Read in 100 Easy Lessons by Siegfried Englemann, Phyllis Haddox, and Elaine Bruner.

How does the VB-MAPP compare to other assessments?

There are two studies that compare commonly used assessments for children with autism or other developmental disabilities with the VB-MAPP. A study by Esch, LaLonde, & Esch, J. W. (2010) reviewed 28 commonly used assessments for the treatment of autism and concluded, “Most speech-language assessments in widespread use today evaluate response topographies (forms of responses) alone, without regard for a functional analysis of the causal variables” (p. 166). For example, 26 of the 28 assessment programs reviewed failed to provide a measure of a student’s ability to mand. These authors point out that the VB-MAPP contains a functional analysis of language, and includes a mand assessment component.

A similar study by Gould, Dixon, Najdowski, Smith, & Tarbox (2011) is also available (with that journal's subscription) and compares 30 assessments, including the ABLLS-R, Bayley, Brigance... and the VB-MAPP. These authors reviewed the 30 assessments in the following categories: comprehension, targets child development, considers behavior function not just topography, link from the assessment to curricula targets, and useful for tracking child progress over time. The authors concluded: “After reviewing the assessments described above, only four meet our original five criteria most closely: the VB-MAPP, Brigance IED-II, VABS-II, and CIBS-R.”

Does the VB-MAPP assess self-care skills?

The VB-MAPP does assess some self-care skills. However, the main focus of the VB-MAPP is on communication, social skills, barriers, and behavioral characteristics that are often demonstrated by individuals with autism. Self-care skills are an important part of the child’s growing independence and should be assessed and taught using procedures derived from applied behavior analysis (e.g., prompting, fading, breaking down tasks as needed). On the AVBPress.com website there is checklist of self-care skills which can be downloaded and printed as needed to complete your child’s program. See the Self-care checklist among the Downloads at www.AVBPress.com. For older children and adults who might need a program with more of a focus on functional living skills, we suggest Essential for Living by Pat McGreevy, Troy Fry, and Colleen Cornwall.

Is the VB-MAPP standardized?

The VB-MAPP is a criterion-referenced assessment - it is not a standardized (norm referenced) assessment.

How does ABA that includes Verbal Behavior (VB) compare to other ABA approaches?

A verbal behavior approach to language assessment and intervention shares many common aspects with other ABA approaches. Both are based on the procedures, teaching techniques, and accumulated evidence-based data derived from the field of Applied Behavior Analysis. The approaches differ in terms of the analysis of language that provides the foundation for the assessment program and intervention curriculum used in each approach. The foundation for the verbal behavior approach is based on Skinner’s (1957) analysis of language where he provides an alternative to the traditional cognitive view of language characterized by the expressive-receptive framework common to most ABA programs. For more information on the value of Skinner’s analysis of verbal behavior for children with autism, and some distinctions between the two general approaches the reader is referred to Petursdottir and Carr, (2011), and Sundberg and Michael (2001).

How long does it take to conduct the assessment?

The amount of time it takes to conduct the VB-MAPP depends on the level of the individual being tested, his or her cooperation, availability of materials, and the skill of the assessor. In general, for a trained assessor it will take approximately 1-3 hours for a child who scores at Level 1 (beginner), 3-6 total hours for a child at Level 2 (intermediate), and 6-10 total hours for a child scoring at Level 3 (advanced).

Who can conduct the assessment?

Language assessment is not an easy process. While we tried to make the VB-MAPP as user friendly as possible, there are still several necessary prerequisite skills to conduct the assessment. Here are five skills sets: 1) It is essential that the tester have a basic understanding of Skinner’s (1957) analysis of verbal behavior. For example, in order to assess a child’s mand repertoire, the tester must understand what a mand is, and how the mand is related to motivating operations (MOs); 2) knowledge in basic behavior analysis. For example, being aware of the subtleties of the various types of prompts, and being able to determine if a response is controlled by inadvertent prompting, is essential for determining exactly what skills a child has truly mastered; 3) it is also important that the assessor be familiar with basic linguistic structure; 4) be familiar with the linguistic development of typically developing children; 5) and, have a good understanding of autism and other types of developmental disabilities. Finally as with any language assessment tool, one must read and study the manual, and practice administering the tool. The more skilled a person is in all of these areas the more s/he will get out of the assessment.

Are there translations of the VB-MAPP into other languages?

The VB-MAPP is now available in Chinese, French (app/web-based only), Italian, Polish, Russian, and Spanish (app/web-based only). It will be available in several other languages by later 2016. If you would like to receive a notice about the VB-MAPP translations join the VB-MAPP Facebook and we will post information as it becomes available.

Are there specific materials that should be used to conduct the assessment?

The person conducting the assessment should have a VB-MAPP Guide and each individual being assessed should have their own Protocol. Many of the materials recommended to conduct the assessment can often be found in classrooms and/or home. There is a suggested materials list in the VB-MAPP Guide. There is also a VB-MAPP Kit sold through Different Roads to Learning.

Can I get an idea of how to set up an ABA/VB program?

There is a free webinar that will give you starting points for your program available through Autism Training Solutions; click on Resources, then webinar, and scroll down to the talk by Mary Lynch Barbera, Ph.D., BCBA, Ten Key Components Needed for an Effective Autism Program Regardless of Age, Ability Level or Setting.

Are there demonstrations of how the VB-MAPP is being used?

If you are interested in seeing how the VB-MAPP is being used by professionals and parents, there are presentations available on-line. For a few examples see:

Through the Florida Institute of Technology, Applied Behavior Analysis Program
Presentation by Amiris DiPuglia, M.D., BCBA from the Pennsylvania Training and Technical Network titled “Large Scale Implementation of the Verbal Behavior Model.” This presentation demonstrates meaningful gains, and use of the VB-MAPP throughout 170+ public school classrooms www.fit.edu/bst/programs/autism/index.php.

Are there downloadable materials from the web that can be used?

There are several websites that offer free downloadable pictures that can be used for teaching skills such as tacting/labeling, listener/receptive, matching to sample, listener responding by feature, function and class (LRFFC), and some websites offer clever ideas and tips for both assessment and intervention. For example browse the links at www.marksundberg.com.

Where can I attend a training?

The author of the VB-MAPP, Dr. Mark Sundberg, presents at conferences, and does 2-3 day trainings that are either private or open to the public (see the schedule at www.marksundberg.com).