Transcription

1 Open Source Visualization Tools to Enhance Reading Comprehension and Concept Attainment Carol A. Brown, EdD Associate Professor, East Carolina University Department of Mathematics, Science, and Instructional Technology in Education Ragsdale 342 mailstop 566 Greenville NC Jennifer R. Banas, EdD Assistant Professor, Northeastern Illinois University Department of HPERA 5500 N St Louis Ave Chicago IL Visualization can be defined as the conversion of information to a symbolic representation of a particular idea, concept, or data object. In simplified terms, McCormick (1987) explained visualization as the process of transforming data, information, and knowledge into graphic symbolic presentations. There are advantages in use of tools designed to make the transformation of text possible. First, visualization tools can be used to make information more accessible. Early proponents reported successful use of visualization retrieval tools to present bibliographic displays generated from hugh amounts of digital information. According to Wise, (Wise, et al, 1995) data sources become manageable and information retrieval efficient through organized graphic displays. Secondly, visualization permits perception at a higher level. Tools designed to create visualizations allow users to explore the symbolic structure of a text. Thinking processes are enhanced as users are interactively engaged in the reading process. Users may create images in order to identify relationships, main ideas, and patterns thus facilitating concept attainment and critical analyses of reading materials (Sadoski, & Paivio, 2001). Johnson- Glenberg examined the effects of question-writing and word association with visual imagery. The results of her study showed significant increase in reading comprehension scores for struggling readers (2005). These and other generative strategies suggest visualization tools can be used for ensuring recall and comprehension for readers of all ages (Hook & Borner, 2005; Mills, 2009; Wittrock, 1992). In more simple settings such as elementary school classrooms, concepts maps, pictographs, and word clouds can be used for making connections and predicting themes within expository text (Foote, 2009; Oliver, 2009). Most teachers have used pictographs and other representations for reading lessons however word clouds have only recently been used in K-12 classrooms. The website Wordle.net provides an easy to use tool for creating word clouds by both teachers and K-12 students. In higher education, visualization tools accessible through Many Eyes provide interactive activities that include word clouds, tag clouds, and word trees, but with more complex textual information (Eisenberg, 2008; Hook & Borner, 2005; Viegas, Wattenberg, & Feinberg, 2009). Developed by designers in IBM labs, Wordle is the product of the creators for Many Eyes. Wordles produced by cut and paste of a selected reading passages result in a simplistic image from a complex narrative. Zhang refers to these visualizations as metaphors. Mental images can be formed and conceptual ideas more easily recognized, communicated, understood, and remembered (Zhang, 2008). Both Wordle.net and Many-Eyes.alphaworks.ibm.com are interactive open source tools, but only Many Eyes permits registered users to post commentary on any of the thousands of visualizations published for public viewing. Although text can be entered directly through the user s keyboard, value is added to the use of these tools through the cut & paste process possible with digital information. The wealth of accessible online resources makes use of these tools easy and efficient for educators. 39

2 Purpose of this Study Strategies using tools such as Wordle, Many Eyes, and Tag Cloud provided promise for visualization tools to enhance reading within a variety of contexts and learning environments. Could use of visualization tools such as word cloud imagery enhance reading comprehension and help both graduate and undergraduate students understand complex ideas and abstract concepts? This paper is a report on findings in use of a variety of visualization tools to enhance reading for adult learners. Methods Two populations were examined for use of visualization tools to enhance reading comprehension and concept attainment for assigned reading in both graduate and undergraduate classes. The first data collection involved graduate students in a master s level program for instructional technology. Visualization tools were used to analyze the contents of a job description for school technology specialists. A 500 word online reading from the state department of education was used as the source document for analysis. Using their assigned reading to copy and paste into Wordle.net, students generated visualizations representing the main functions of a technology facilitator. In small group discussion forums, students analyzed the keywords displayed in the visualization, predicting possible scenarios for the position of technology facilitator in a K-12 school. After the online discussions were concluded, students submitted proposals for internship experiences at their local schools. After writing the first draft of the internship proposal and posting these to the online discussion forum, students participated in a second discussion forum to compare interpretations of job functions for technology facilitators. Following the second discussion, a final proposal was written and submitted to the course instructor for evaluation. The design of internship proposals provided the first data set for this study. These are discussed in the results section below. A second data collection involved pre-service teachers who received instruction in use of Phrase Net tools to visualize conceptual relationships in an assigned reading. Students in a traditional face-to-face Health Education methods class were given an online book chapter as assigned reading on the topic of learning and cognition. Following the reading of the book chapter, multiple choice tests were used to assess understanding of concepts discussed in the online book chapter as well as measures of confidence levels related to personal understanding. Test items included these areas: 1) concept attainment; 2) relationship between concepts with supporting ideas and examples; 3) relevancy to personal experiences. Mean scores for each of the measures were used to identify differences in pre and post use of the visualization tools. Mean scores for students self reported confidence levels for pre and post tests were used to identify differences in confidence levels when using the visualization tools. A third group included both graduate and undergraduate students who examined visualization tools for potential use in their K12 classrooms. Review of students discussion threads revealed creative ideas for instructional use of tools. Lesson ideas were submitted to the course instructors who categorized each activity by skill, instructional method, outcomes, and assessment of learning. A summary of selected activities are presented in the results and discussion of this paper. Word Clouds to Analyze Job Descriptions. Results and Discussion Interns in the MAEd in Instructional Technology used visualization tools to analyze content of internship proposals compared with similar visualizations produced using content from an online job description provided by the state of education. The tag cloud tool was used to calculate the presence and count of unique words in a document as well as statistical analysis of frequency and context of words and letter strings within the document. Interns compared output from their internship proposals with output generated from job descriptions accessed through the state department of education. The content of the job descriptions were dropped into Tag Cloud tools to produce visualizations that include word counts for all terms within the document. The interns used the output from their visualizations as a guide for discussions in an online forum. The visualizations resulted in a focused dialog with emphases in main functions for the job of technology integration specialist and technology facilitator. Qualitative evaluation of the students proposals showed a clear and consistent alignment with national standards for these positions in K-12 schools. Interns proposals from previous semesters did not reveal depth of understanding evident in this pilot group using visualization tools to analyze future job descriptions. Keywords predominate in the 40

3 visualizations prompted interns to plan around terms such as teacher support, instruction ; and collaboration. These were then used as prompts for negotiating projects for the semester internship experiences. Phrase Nets to Enhance Reading Comprehension. Undergraduate students were given an assigned reading in an online book chapter followed by an assessment of their understanding for 1) main ideas, 2) relationship between terms in the readings, and 3) relevancy to readers personal learning experiences. The participants were also asked to provide a self-assessed level of confidence in their interpretations of content from the book chapter. Following the reading assignment and assessment of understanding, students were instructed to access the website Many-Eyes.alphaworks.ibm.com and generate a visualization using the Phrase Net tool. Phrase Net analyzes a text by looking for pairs of words that fit particular patterns. In Figure 1 is an example from a science article on the solar system. The user will specify a particular pattern such as the terms earth or planets. Phrase Net will create a network diagram of the words it found as matches. The terms earth/planets will be connected if they occurred in the same phrase. When viewing the output from the visualization, the user can compare differences in font size, color, and size of connectors to determine frequency and relationship of the terms. The size of a word is proportional to the number of times it occurred in a match. Figure 1. Visualization using PhraseNet Note in the figure above the term dioxide is connected to terms atmosphere and carbon. Bold lines indicate a strong connection between terms solar system ; and magnetic field(s). Drawing attention to strong and weak connections between ideas enhances the reader s conceptual understanding of complex reading material. Undergraduate students who participated in this study completed visualization activities followed by a post assessment to measure reading comprehension and confidence levels when using the Phrase Net tool. Students 41

4 responses were rated 0 to 4 with 4 being the highest score possible. T Test analyses were used to compare pre and post assessment for the following: 1) understanding main ideas; 2) comprehension of relationships between main ideas in the readings; 3) ability to make connections between main ideas and personal learning experiences, and 4) self-reported confidence levels in understanding and comprehension for the readings. Differences in Pre assessment and Post assessment of main ideas when using the Phrase Net visualization is marginally significant (p <.04, 2- tailed). No significant differences were identified between pre and post assessments relating readings to personal experiences. However T Test comparison shows a significant difference in assessment of students ability to see Relationship Between Ideas when using the Phrase Net tool (p <.000, 2 - tailed). Note in Table 1 differences in T scores (T = 11.3; p <.000, 2 - tailed) for the pretest [before use of Phrase Net] compared to T scores ( T = 14.3, p <.000, 2 tailed) for the post test score [after use of Phrase Net]. Table 1. T Test comparison of students ability to see relationships between ideas when using visualization tools. N Mean SD Std Error RelationPre RelationPost Confidence Interval t df Sig. (2-tailed) Mean difference lower upper RelationPre * RelationPost * Students confidence levels in identifying relationships among ideas also appear to be impacted through the use of Phrase Net visualization tool. In Table 2, differences in pre and post self-reported confidence levels is significant (p <.000, 2-tailed). Table 2. T Test comparison of Pre use of Phrase Net with Post use of Phrase Net when measuring students confidence in ability to identify relationships of main ideas in assigned reading. Confidence in Identifying Relationships Between ideas t df Sig. (2-tailed) Mean difference Confidence Interval Lower upper ConfRelaPre * ConfRelaPost * Students comments following the use of Phrase Net seem to support the positive effect of the visualization tools used to help students understand relationships between major terms appearing in assigned reading. One student commented: To visually see the connections of how strongly 2 concepts are linked to one another made me view this article in a different light. Previously, I selected main subjects points that were not as important or had fewer connections compared to the ones that I have selected after using PN. It reinforced the main issues that were being discussed in the article, rather than focusing on mini subjects that ewer not he key points. For example, PN greatly reinforced the strong connection between synapse over production and loss, which is an imperative method in how information is translated into learned concepts. 42

5 Ideas for Using Word Clouds in K-12 Classrooms. Both graduate and undergraduate students provided innovative ideas for use of visualization tools for K-12 classroom instruction. In response to a discussion forum asking for possible uses of Wordle (Wordle.net), students submitted ideas for a classroom activity and method for evaluating outcomes from the lesson. See Table 3 for a selected sample of classroom activities designed by students participating in the study. Table 3. Instructional activities using word cloud and tag cloud visualization tools. Skills Instructional Method Outcomes Assessment View word cloud for each Students made connection between font paragraph one page narrative; Teacher observation; Identify main size and number of occurrences in the compare key words; write one enhance concept of idea narrative; discussion on meaning of sentence with main idea for each "Big Idea" prominent words. paragraph. Critical thinking Individually generate a list of terms associated with educational theme; groups generate a 2nd list of terms; independently generate word cloud from assigned reading on the theme; reflect and discuss comparison of independent and group lists Critical thinking required to compare and contrast word lists; accurate analysis of assigned reading; selfassessment associated with reflections on personal word clouds representative of themes in the reading Comparison of word clouds representative of themes and main ideas within the reading; knowledge and understanding of vocabulary in the reading. Expressive Writing Assigned writing describing yourself; paste into word cloud software; compare characteristics with others in class; identify repeated words; reflect on selfimage and your best attributes Creative writing; good use of adjectives and adverbs; positive reinforcement for all students; identify the purpose of "sparkle words" for narrative writing. Teacher assessment of writing style, use of vocabulary and positive dialog during whole class discussions. The researchers summarized all students word cloud activities and placed these into categories. Although more than 30 student assignments were submitted, we synthesized these into three main themes: Reading to Identify Main idea; Critical Thinking Skills, and Expressive Writing. Table 3 provides sample activity for each of the three themes. Summary/Conclusion Use of visualization tools as a pre or post reading activity has potential to enhance reading comprehension in adult learners. Although the researchers consider this a preliminary study, pre and post tests reveal a positive effect through use of Phrase Net tool for identifying relationships in ideas in expository reading. Feedback from participants suggests a positive effect on reading for understanding using complex college level materials. The readers were able to make connections between key ideas within the narrative. Use of visualization tools reinforced what some readers identified as related terms within the assigned book chapter; for others use of the visualization tools resulted in aah ha moments with new understanding in the readings. The researchers also suggest that visualization tools might aid the generative thinking processes as students recognize conceptual relationships within the text. Students are motivated to use visualization tools resulting in cognitive maps. By viewing the visualizations, the participants in the study were able to participate in discussions based on a mental map of abstract concepts and ideas. We consider differences in students pre and post tests strong enough to warrant continued work in this area of research. Use of word clouds and tag clouds provided imagery representing the many tasks and responsibilities of a technology specialist in a K-12 school. As students generated original word clouds and view output from others in 43

Comparison of and Perceptions of Best Practices in Online Technology s David Batts Assistant Professor East Carolina University Greenville, NC USA battsd@ecu.edu Abstract This study investigated the perception

Hacettepe University Faculty of Education Computer Education and Instructional Technology A New Approach to Equip Students with Visual Literacy Skills: Use of Infographics in Education Pınar Nuhoğlu Kibar

Indiana Department of Education Academic Course Framework ARCHITECHTURAL DRAFTING AND DESIGN II Architectural Drafting and Design II presents a history and survey of architecture and focuses on the creative

Instructional Strategies: What Do Online Students Prefer? Kristen Cuthrell Assistant Professor East Carolina University College of Education Curriculum and Instruction Greenville, NC USA cuthrellma@ecu.edu

Standards Based Grading reports a student s ability to demonstrate mastery of a given standard. This Excel spread sheet is designed to support this method of assessing and reporting student learning. Purpose

A STATISTICS COURSE FOR ELEMENTARY AND MIDDLE SCHOOL TEACHERS Gary Kader and Mike Perry Appalachian State University USA This paper will describe a content-pedagogy course designed to prepare elementary

WORLD-CLASS INSTRUCTIONAL DESIGN AND ASSESSMENT The English Language Learner CAN DO Booklet Grades 9-12 Includes: Performance Definitions CAN DO Descriptors For use in conjunction with the WIDA English

21st Century Community Learning Center Grant Overview The purpose of the program is to establish 21st CCLC programs that provide students with academic enrichment opportunities along with activities designed

AC 2007-481: COMMUNITY COLLEGE TEACHER PROFESSIONAL DEVELOPMENT Theodore Branoff, North Carolina State University Ted Branoff is an associate professor of Graphic Communications in the Department of Mathematics,

Special Points for Experienced Teachers to Consider Because you are an experienced teacher, do not feel compelled to relegate your resume to one page. Nonetheless, try not to extend it beyond two pages.

Using Wordle to Create Character Word Clouds www.wordle.net What is Wordle? Wordle is a graphic representation of the most frequently used words or most important words in a speech, a poem, a book, a historical

E-Learning and Credit Recovery: Strategies for Success Brenda Humphrey Valdosta State University GA, United States brhumphrey@valdosta.edu Abstract: The purpose of this study was to describe the effects

Analyzing Experimental Data The information in this chapter is a short summary of some topics that are covered in depth in the book Students and Research written by Cothron, Giese, and Rezba. See the end

Multimedia Learning Theories and Online Instruction Nadaleen Tempelman-Kluit Online library instruction has not traditionally been designed based on educational learning theories. Rather, much of it has

Accessibility Strategies for Mathematics "Equity does not mean that every student should receive identical instruction; instead, it demands that reasonable and appropriate accommodations be made as needed

TOP 10 RESOURCES FOR TEACHERS OF ENGLISH LANGUAGE LEARNERS Melissa McGavock Director of Bilingual Education Reading, Writing, and Learning in ESL: A Resource Book for K-12 Teachers Making Content Comprehensible

Word Clouds - Educational Tools by Terence Cavanaugh While browsing the web you might see some tag clouds or word clouds, often they are over to the side of the page and look like bunches of words random

Proceedings of CLaSIC 2014 BUILDING A READING WEBSITE FOR EFL/ESL LEARNERS Neil Millington (millington@sun.ac.jp) University of Nagasaki-Siebold, Japan Brad Smith (bradsmith@sun.ac.jp) University of Nagasaki-Siebold,

Concept-Mapping Software: How effective is the learning tool in an online learning environment? Online learning environments address the educational objectives by putting the learner at the center of the

Position Statement on English Language Arts Education Connecticut State Board of Education December 3, 2008 The Connecticut State Board of Education believes a high-quality, comprehensive prekindergarten-12

CHARACTERISTICS FOR STUDENTS WITH: LIMITED ENGLISH PROFICIENCY (LEP) Research has shown that students acquire a second language in the same way that they acquire the first language. It is an exploratory

A Teacher s Guide: Getting Acquainted with the 2014 GED Test The Eight-Week Program How the program is organized For each week, you ll find the following components: Focus: the content area you ll be concentrating

Research and Digital Game- based Play: A Review of Martha Madison White Paper Compiled by Anne Snyder, Ph.D. Second Avenue Learning is a certified women- owned business, specializing in the creation of

1 Abstract The purpose of this study was to measure the effectiveness of two instructional activities on teacher credential candidates as they learned how to adapt standards-based content lessons and increase

Embedding Technology in Education for All Learners: CEC s Recommendations to the National Education Technology Plan The Council for Exceptional Children the largest professional organization of teachers,

Instructional Scaffolding for Online Courses Helen M. Grady Mercer University grady_h@mercer.edu Abstract Instructional scaffolding is a process by which an instructor supports a student in executing a

District 203 K-4 Elementary Summer School 2015 The following Elementary Summer School courses will be conducted from Monday, June 8, 2014, through Friday, June 26, 2015. THE SAME COURSES WILL BE OFFERED

Essays on Teaching Excellence Toward the Best in the Academy Volume 17, Number 3, 2005-06 A publication of The Professional & Organizational Development Network in Higher Education (www.podnetwork.org).

School of Public Service and Health PADM 699 Master s Capstone Seminar in Public Administration 3 Credit Hours Prerequisite: Completion of all MPA coursework Length of Course: 16 Weeks Instructor Information

Journal of Teaching English as a Foreign Language and Literature of Islamic Azad University of Iran, 1 (1), 79-85, Winter 2009 Using Word-Search-puzzle Games for Improving Vocabulary Knowledge of Iranian

A Correlation of Prentice Hall Writing Coach 2012 To the Virginia English Standards of Learning A Correlation of, 2012, Introduction This document demonstrates how, 2012, meets the objectives of the. Correlation

High School Science Lesson Plan: Biology Introduction Each lesson in the Adolescent Literacy Toolkit is designed to support students through the reading/learning process by providing instruction before,

Running head: INFORMATIONAL TEXT IN THE PRIMARY CLASSROOM 1 Informational Text in the Primary Classroom A Research Project Submitted as a Requirement For The Degree of Masters In Reading Education In The

Helping English Language Learners Understand Content Area Texts English language learners (ELLs) experience intense problems in content area learning because they have not yet acquired the language proficiency

Identity and Needs in the Modern World: Roles of Orality and Literacy 15 th Inuit Studies Conference, Paris, Oct. 26, 2006 An overarching goal in Inuit communities is to maintain Inuit culture as a dynamic

THE UNIVERSITY OF TEXAS AT BROWNSVILLE College of Education Syllabus Conceptual Framework & Knowledge Base The conceptual framework contains four core concepts, which are themes through which we organize

! ROCHESTER INSTITUTE OF TECHNOLOGY COURSE OUTLINE FORM COLLEGE OF SCIENCE School of Mathematical Sciences New Revised COURSE: COS-MATH-252 Probability and Statistics II 1.0 Course designations and approvals:

School Library Standards for California Public Schools, Grades Nine through Twelve STANDARD 1 Students Access Information The student will access information by applying knowledge of the organization of

VOLUME 31, NUMBER 4, 2013 Leadership and Learning: The Journey to National Accreditation and Recognition Lisa Bertrand, EdD Professor and Program Coordinator Department of Educational Leadership and Counseling

Engaging Students for Optimum Learning Online Informing the Design of Online Learning By the Principles of How People Learn What Is Engagement? As early as 1995, student engagement was "the latest buzzword

Education in our times must try to find whatever there is in students that might yearn for completion, and to reconstruct the learning that would enable them autonomously to seek that completion. Allan

Elementary Math Methods Syllabus Course Description This course is designed to support both new and experienced elementary math educators in refining and focusing their instructional skills. Close examination

Nutrition and Culinary Arts Example SLO A Student Learning Objective (SLO) is a detailed process used to organize evidence of student growth over a specified period of time. The SLO process is appropriate

There are approximately six million English Language Learners, ELLs, in our country today. Exemplary Strategies has been designed for all teachers. Whether the students native language is English, Spanish

ADEPT Performance Standards for Classroom-Based Teachers Revised ADEPT Performance Standards for Classroom-Based Teachers Introduction Central to the ADEPT system is a set of expectations for what teaching

Volume 8, Number 10 April, 2005 ISSN 1099-839X Teaching Students with Learning Disabilities: Constructivism or Behaviorism? Marcee M. Steele University of North Carolina Wilmington There is much controversy

5-A SECOND Making a Difference in Graduate Education: Implementing Online Caring Groups Carol B. Wilson, PhD, RN is a full professor at the University of West Georgia and has a long term history in the

The Alignment of Common Core and ACT s College and Career Readiness System June 2010 ACT is an independent, not-for-profit organization that provides assessment, research, information, and program management

Building Critical Thinking Skills in General Education and Career Programs Wayne County Community College District Presented By: Mary Mahoney Jo Ann Allen Nyquist College Definition of Critical Thinking

In the spring of 2006, a team of Illinois educators created the new Illinois Alternate Assessment (IAA) Frameworks. The purpose of the frameworks is to prioritize the skills and knowledge from the Illinois

Learning-Focused Introduction Introduction By Dr. Mills What is the Learning-Focused Strategies Model? A framework for thinking about planning, and delivering instruction using EXEMPLARY practices with

Philosophy Online class observations are meant to facilitate an instructor s professional growth. They will be used to create an opportunity for reflection and stimulate ideas for improvement in the online