SummaryREASON
VET teachers are currently unable to judge and assess on the fly professionals trainer`s reproduction, demonstration and performance of learning. During short VET courses addressing the World of Work, instructors can't answer questions like
- How successful is/was my teaching?
- How well do/did the students learn the subject taught?
- How much do/did the students learn of the subject taught?
In class communication, interaction and collaboration processes that may enhance effective peer learning processes, where students learn from their peers, are difficult to measure by use of existing ICT technologies

KA3 Done-IT (11-12) project: The brand new Peer Learning Assessment Service (PeLE) system for Smartphones, PAD, PC and Mac gives the teacher a new tool, allowing him/her to either give verification or elaborative feedback to individual students or groups of students immediately after a test. When they still remember the questions in the test, students will learn why the answers are correct or incorrect.Thus, mobile technology provides new evaluation, assessment and testing criteria within education and training

AIMS
Provide instant evaluation in industry oriented short, intense 2-3 days VET professionals courses, by adapting, testing and validating the new online service "PeLe Professional". Extend Kirkpatrick`s learning outcome evaluation model by using modern, easy to use, cheap mobile response technology, to include Assessment for Learning in competence based systems

CONSORTIUM
The consortium has a strong industrial presence with ties to VET providers, mobile learning and mobile response system technologies (HCR) and manufacturing industry (DOM, HiST, CCI, UTH) leading to identification of inadequacies in current training and evaluation systems and standards for effective instructor training delivery. The partnership has complementary expertise and tasks. HiST, HCR, CCI and UTH have cooperated successfully previously. HCR personnel were key development partners in the KA3 ICT mobile technology EduMecca (09-10) and Done-IT projects

OUTCOME
An innovative, extended Kirkpatrick`s Peer Learning Evaluation Method, for evaluation of trainers and Quality VET professional programs, provides:
- reaction evaluation: measure trainers pre-knowledge and how they thought and felt about the training and learning experience
- learning evaluation: measure the increase in knowledge or capability before and during the course, in order to provide corrective actions at the end of the course
- behavior evaluation: measure the extent of applied learning back on the job (implementation of knowledge)
- result evaluation: investigate the effects on the business or environment resulting from the trainee's performance

DescriptionMethodology of Kirkpatrick for evaluation
An innovative, extended Kirkpatrick`s Peer Learning Evaluation Method, for evaluation of trainers and Quality VET professional programs, by used of the extended PELE tool.
It is going to provide:

Reaction evaluation: measure trainers pre-knowledge and how they thought and felt about the training and learning experience
Learning evaluation: measure the increase in knowledge or capability before and during the course, in order to provide corrective actions at the end of the course
Behaviour evaluation: measure the extent of applied learning back on the job (implementation of knowledge)
Result evaluation: investigate the effects on the business or environment resulting from the trainee's performance, and try to assess and validate the Return of Investment in VET programs by using the extended Kirkpatrick`s evaluation model
PELE Professional is going be used to measure pre-knowledge just before the course starts, and these data will be collated with immediate feedback from tests offered towards the end of the course. The data gathered before and after the couse are then merged into an interactive learning activity. The learning approach targets short, intense training courses and applies the pedagogical method to business, economy and agricultural courses. The new learning and evaluation process is going to include four disruptive evaluation-learning activities: pretests, learning, posttests and comparison.

Product informationThe new PELE Proffesional tool is going to provide:

Pretest of attitude and behaviour - to improve the learning phase
Pretest of knowledge before the learning starts - to improve the learning phase
﻿Evaluate satisfaction during learning phase
Perform posttest of knowledge during learning phase
Some time after finishing learning, provide posttest in attitude and behaviour and use these results to compare and improve the effect of training for participants and companies.
Finally, the project will investiagte if Kirkpatricks evaluation method may be adapted and applied for use in higher education courses.

For instance, use of mobile technology dont require any reconstructon of classrooms or other infrastructure at the campus, due to the portabillity and availabillity of handheld tools (smartphones, tabletts and laptops) among the students. Due to this, it is possible to apply this evaluation method in any classroom that is connected to the WI-FI network, thus reducing the costs for carrying out advanced and improved evaluations in large scale training environments with thousands of students.

ADAM, the Project and Product Portal for Leonardo da Vinci is funded by the European Commission, DG Education and Culture. The information in the ADAM portal is provided by the beneficiaries' organisations and is the sole responsibility of those organisations. The National Agencies as well as the Commission declines all responsibility regarding this information, particularly regarding its accuracy and its respect to copyright. (DVR: 4000157)