IMPLEMENTATION AND MONITORING

Transcription

1 IMPLEMENTATION AND MONITORING

2 ACKNOWLEDGEMENTS The guidance paper on Implementation and monitoring is a product of the Managing Urban Europe-25 project. The project was part-funded by the European Commission, DG Environment. The project was co-ordinated by Union of the Baltic Cities (UBC) Environment and Sustainable Development Secretariat and is part of the UBC Agenda 21 Action Programme Roadmap for Sustainable Baltic Cities. The project Steering Group consisted of ICLEI-Local Governments for Sustainability, UNEP/Grid-Arendal, Bodensee Stiftung, and the University of West of England. The publication reflects the author s views and can under no circumstances be regarded as reflecting the position of the European Commission. Editorial board: Annika Claesson, Linda Talve, Kasia Bogucka, Christina Garzillo, Marion Hammerl, Claudia Heberlein, Daniela Paas, Andrea Philipp and Holger Robrecht. Union of the Baltic Cities Commission on Environment (EnvCom). All rights reserved. No part of this publication may be reproduced or copied for commercial use, in any form or by any means without written permission of the UBC EnvCom, acting also on behalf of the MUE-25 project partners. Illustrations Union of the Baltic Cities Commission on Environment (EnvCom). Page 2/20

4 1. INTRODUCTION With the implementation of the strategic programme and the action plan, the management cycle reaches its very core: all the preceding assessment and planning has the overall objective of improving the way the city functions in terms of sustainable development. The implementation is where it shows. The implementation is a demanding task in terms of organisation and coordination of all the parallel actions that will take place. A crucial condition is a solid communication and involvement approach and the organisational setup. Cooperation with and between various stakeholders assures that the different actors buy in to the implementation process. Therefore, implementation is based on the foundation which is a combination of the action plan, the organisational setup and above all communication and involvement. The approval of the action plan by the city council may be a determining success factor, as it legitimises actions and gives them a required priority. In parallel, and for the purpose of being able to measure and report the results, the implementation of the strategic programme and its action plan should be monitored in an appropriate way and fed back to the politicians. It allows for being able to see if actions are implemented with good results. If not, it allows for taking corrective measures while implementation is in progress. In order to be able to engage in monitoring, the actions need to rely on targets based on indicators defined in the strategic programme. Page 4/20

5 2. REFINEMENT OF THE ACTION PLAN With the strategic programme and action plan approved by the city council, an important step has been taken towards improvement of the sustainability performance. The action plan serves as a basis for the implementation of the strategic programme, but needs to be further refined. Outline and segment the objectives and targets to concretise measures and projects to be realised by the relevant departments and stakeholders involved. In order to serve as a good basis for day-to-day work, ensure that the action plan answers the following questions: - What is to be done? (title, short description of measure) - Who is responsible? (person, department or stakeholder, contact details) - Who should support implementation and how (person, department, contact details) - By what time should the measures be completed? (timetable, date of realisation) - Which personnel and financial resources are assigned? (staff, budget) - Is public information legally required? (which information? to whom? through which instruments? when? how often?) - Are green procurement procedures in place in case of a call for tender or purchase by the local government? (yes/no 1 /under development) For the majority of measures, stakeholder involvement will be necessary for realisation. This requires substantial and formal agreements with stakeholders. Describe the measures taken by stakeholders in the same way as the actions worked out by the municipal departments. Concrete measures could also include the training of personnel in specific aspects and/or new legislation. Further information regarding staff training for example, the responsibilities for training and an analysis of training needs is provided in the Organisational Setup section. The heads of the department and the involved stakeholder organisations are responsible for the concretisation of measures. The coordinator is responsible for compiling the information on the refined measures and to document them in the refined action plan. The responsible department documents and completes the refined action plan and makes it available at one spot for all actors involved. It serves as a basis for the monitoring of realisation of activities through the coordinator and responsible persons assigned. Page 5/20

6 3. MONITORING Good management practices include regular monitoring on both a short- and long-term basis. An effective monitoring process provides ongoing, systematic information that strengthens project implementation. The monitoring process provides an opportunity to: a) compare implementation efforts with original goals and targets, b) determine whether sufficient progress is being made toward achieving expected results, and, c) determine whether the time schedule is observed. Monitoring is not an event that occurs at the end of a management cycle, but rather is an ongoing process that helps decision-makers to better understand the effectiveness of the action or system. An effective monitoring and evaluation programme requires collecting and analyzing important data on a periodic basis throughout the management cycle of a project. This process often involves collecting baseline data on existing conditions, reporting on progress toward environmental/sustainability improvements, making connections between actions and intended outcomes, and making mid-course changes in program design. An effective monitoring and data management system records the performance of all institutions with implementation responsibilities. It provides a system of accountability for all responsible parties on how well they are achieving the goals and targets established in the IMS. The responsibility of appropriate application of the monitoring system lies with the responsible persons/ organisations/ authorities assigned to this activity and has to follow the reporting duties as outlined during the organisational setup phase. Implementation together with monitoring show how important it is to work with indicators and SMART targets from the very beginning of the system implementation. The work with indicators and measurable data has to start with the baseline review. Key data based on indicators have to be mapped in addition to analysis and recognition of missing indicators on the occasion of the baseline review of the existing situation. Within the next step of the system, these key data and indicators are used to formulate SMART targets in the strategic programme and as a result will form the basis for the action programme and therefore the basis for implementation processes. Finally, the implementation can be further controlled and monitored, referring to the clearly defined indicators and thus SMART targets. Effectiveness monitoring is thus very much dependent on a baseline recognition and reference to selected indicators. It is important to have a look at the current situation of monitoring to adapt the monitoring system as much as possible to the structures in place and to avoid duplication of work. Several of the EU based legislations require monitoring (e.g., Strategic Environmental Assessment, Clean Air Directive, etc.). Very often, monitoring activities are very dispersed and not linked with each other. It would, however, be very useful if one unit could make use of data collected in another unit. As an example, the monitoring results of the traffic control department could provide useful insights for the health department. The IMS delivers a platform to connect the various data sources. Page 6/20

7 An effective monitoring and reporting system ideally includes the following elements: 1. Clearly articulated targets and a set of indicators to measure performance; 2. A schedule and set of guidelines for all responsible parties to report to each other; 3. An opportunity for responsible parties and stakeholders to periodically meet to coordinate actions and review each other s performance 4. A link between the evaluation reports and relevant statutory planning cycles of the municipality, such as annual budgeting and capital planning, so that the municipality can adjust its plans as based on the actions taken by other sectors. Page 7/20

8 4. COLLECTING DATA In preparing the monitoring setup, it is good to check the following questions: - For which indicators are data currently being collected? - What are key information sources? Are representatives from these information sources already involved in the IMS process? - How valid and accurate are the data? - Are the data easily accessible and available? - Are there any costs associated with acquiring the data? - For those indicators where no data currently exists, which steps should be taken to collect new data? How expensive would a new data collection effort be? Ideally, most monitoring processes include collecting both quantitative and qualitative data. Quantitative data is information that can be counted and measured. Quantitative environmental data focuses on actual environmental improvements, such as the amount of waste reduced or energy saved. Mechanisms for collecting quantitative environmental data are usually programme-specific, such as using water meters to measure actual water consumption. Qualitative data is a more difficult measurement of programme success. It includes assessments of problems encountered, stakeholder satisfaction, and unanticipated benefits. Qualitative data can give a real understanding of the actual impact the actions are making on people s lives. It is usually collected through instruments such as surveys and personal interviews. In order to have a better understanding of the successes and challenges, it is advisable to collect both types of data. For example, to address persistent water shortages, a town may decide to implement a pilot water conservation programme to install low-flow showerheads in residences. A quantitative data collection effort would focus on how much water has actually been saved, while qualitative data would reveal how satisfied consumers were with the performance of the new showerheads. Both types of information are imperative to determine whether the program was successful. Page 8/20

9 5. PRESSURES STATE - IMPACT RESPONSE When applying the analytical framework of pressures state - impact response to monitoring, it becomes obvious that all of the four areas need to be monitored. Ideally, this has already been taken into account when choosing the indicators. If not, the indicators can still be sorted at this point according to the schematic to facilitate the analysis: Monitoring and the PSIR framework Pressures State Impact Responses To take a concrete example, if you want to monitor the effectiveness of an action, say a noise protection wall, you need to measure - whether the wall has been erected (response), - whether the noise level has been reduced as a result of the wall (state), - or if the source of the noise has decreased (independently of this action, maybe due to related measures in the action plan) (pressure), - and finally, if the affected people living there are less disturbed now (impact). In collecting data, it is also important to distinguish between compliance monitoring versus effectiveness monitoring both types of monitoring are important. Compliance monitoring measures whether the implementing institution did what it said it was going to do (e.g., install 5,000 low-flow showerheads, or to use the above example, the noise protection walls have been installed), while effectiveness monitoring measures whether the actions achieved their intended result (e.g., reducing water usage by 20% per household, or the decibels behind the wall are a certain rating lower). Of course, the real measure of success is effectiveness, i.e., how well conditions are improving. However, compliance monitoring is a critical piece of the evaluation process to help determine whether implementing institutions have fulfilled their commitments, and it helps to analyse why goals were not reached where this is the case. Page 9/20

10 6. SYSTEMATIC DATA COLLECTION This system can be as simple as using standardized reporting forms to facilitate the collection and compilation of data up to an entirely computerized data-sharing system. Nevertheless, what counts is not the level of high-tech computer application that is installed to manage your data, but whether the indicators chosen and the items monitored accurately reflect the progress of implementation and allow for an analysis of deviation from targets and goals. Data management Observe Record Set up a system and tools that allow keeping track of changes (based on the indicators and targets, considering PSIR). Set time intervals for measuring Organise the way you store data in a logical way Be sure to collect data on the indicators prior to beginning the implementation of the strategic programme. Ideally, you used the same set of indicators already for the collection of data for the baseline review, upon which the impacts of implementing selected actions will be measured. In practical terms, data collection is less troublesome if it is organised systematically and in a reproducible way, i.e, - Establish overviews of existing data sources in the form of inventories and a metadatabase; - Prepare templates and guidelines on data handling, technical documentation of the data and analytical methods used; - For each dataset and indicator (diagrams, tables and maps), maintain a paper or electronic fact-sheet with description of data source, data quality, methods for data compilation, other relevant information and its graphical draft. Each institution submits information to the responsible coordinator, who is responsible for assuring the system and who compiles this information into a report. The more specifically the coordinator formulates what he/she expects the different departments to monitor, the easier it will be to systematically store and later retrieve this information, to make it accessible to a larger audience and to evaluate the results. Page 10/20

11 Example: A monitoring form for a specific action (Annex 1) A good monitoring and evaluation process engages all stakeholders and is useful to those ultimately responsible for improving the project. Evaluation is also an important public awareness and educational tool. The objective is to use synergies, avoid double work and report as efficiently as possible. Please consult the section organisational setup, which has further information on reporting routines. To monitor the realisation of the action in accordance with the action plan is easier than monitoring their effects. The coordinator needs to receive feedback from the responsible persons regarding the - realisation of the activity - yes/no? - agreed timetable - assigned resources - modifications With this information, the coordinator is able to control the compliance of the implementation process with the action plan and to elaborate one part of the interim report or internal audit report. 7. CORRECTIVE MEASURES A well-organised monitoring system is able to detect deviations from the set direction promptly. The mistake can be analysed immediately, corrective measures taken as soon as possible, and damage or loss minimised. Page 11/20

12 8. COMMUNICATION AND INVOLVEMENT The effectiveness of implementation is very much dependent on the partnerships developed and the involvement and cooperation of various stakeholders. This is the step of actual action, which most often creates lots of challenges, mainly due to the fact that it requires the cooperation of different sorts of groups with various stakes. Planning is usually much less complicated than the actual implementation of the action plan. At this stage, questions about cross-sectoral cooperation and multi-stakeholder involvement and cooperation appear. Is the organisational set-up cross-sectoral enough? Are those to implement working together for a common objective? Is the common objective of sustainability clear? Are departments cooperating with each other and are the relevant stakeholders involved? Are the targets SMART? Are indicators available and measurable? Is the timetable realistic? In order to make things happen, address all these issues in line with the development of the integrated management system in the city. The public needs to know what is ongoing. To inform the public about the implementation of the action plan may play the decisive role as to whether the implementation will be successful or not happen at all. Very often the effectiveness of the implementation depends on citizens' involvement. In this case, combine information about the ongoing implementation processes with the call for cooperation and involvement. The examples are various: waste separation, rational energy use (decreasing energy consumption in households) or watersaving measures, to name just a few. To find out more, please read the section on communication and involvement. Page 12/20

13 9. CHECKLIST Objective Procedures to check and correct activities are a crucial part of every management system also within the Integrated Management System. One of the minimum requirements is the yearly Internal Audit conducted by the coordinator or coordination team and an Internal Auditor. This Internal Auditor needs to be independent from the coordination team and should be a person from another strategic department, a (neighbouring) municipality or an external consultant or verifier. Of overall importance is that the auditor or auditing team has a solid foundation in the expert knowledge necessary to conduct integrated management and sustainability aspects. The internal audit emphasises: - determining whether the direct and indirect environmental/ sustainability/climate change issues and their evaluation are up to date - determining whether the Strategic Programme is up to date - comparing present status and realisation/implementation of the Action Plan(s) - comparing present status and progress towards resp. achievement of environmental /sustainability / mitigation and adaptation targets - checking whether the laws and regulations of relevance to environment /sustainable development and climate change have been updated and are being followed through - checking the management system functions (organisation, documentation, internal and external communication, monitoring and reporting) - checking update, adherence to and implementation of the training plan for employees The following checklist emphasises on the first Internal Audit and includes also questions related to the implementation of the integrated management system, not relevant after the realisation of the first cycle Please note that the checklist for Implementation & Monitoring is the same as for Evaluation & Reporting as it deals with the monitoring and evaluation system. Page 13/20

14 Aspects regarding the process of establishing the monitoring system Data requirements identified 1 Data sources for all indicators identified 2 3 Meta-database (information about data) available 4 5 Contact persons for all data sources contacted and informed about their duties. Monitoring structure and roles are described in organisational set up (see point 14 and 15 in Checklist on Organisational Set Up) Detailed information of authorities holding different data, public functions and services available 6 7 Existing monitoring and evaluation structures (on local level and between local and regional level) analyzed and gaps identified Timeframe and periodicity for all targets and indicators defined Page 14/20

16 16 Template for data transfer available and distributed (spreadsheet, reporting template with meta-information) 17 Tracking of users for feedback and statistics possible Characteristics of monitoring and evaluation system Are trends tracked and evaluated? (direction of development) Compliance with legal requirements can be tracked at all time where applicable Is there any emergency response mechanism of monitoring system? Communication and involvement in the monitoring and evaluation process 21 All relevant stakeholders informed about the ongoing process 22 Suitable monitoring data is available to the public: Permanently in real-time Updated periodically Page 16/20

19 ANNEXES ANNEX 1: EXAMPLE OF A MONITORING FORM FOR A SPECIFIC ACTION Page 19/20

20 Annex 1: Example of a monitoring form for a specific action Example of a monitoring form for a specific action Title of action, number in action plan Summary of action and results Description of target Description of action Data collection information Results Difficulties encountered Lessons learned Recommendations for adaptation of targets and /or actions Summary excerpt from relevant part of Strategic programme Summary excerpt from relevant part of action plan Indicators, reporting requirements, data collection methods Qualitative and quantitative impacts Description of problems encountered both internal and external and how these problems were dealt with What knowledge has been gained? What recommendation is given for further implementation effort? Page 20/20

www.mue25.net www.localmanagement.eu OVERVIEW OF THE INTEGRATED MANAGEMENT SYSTEM ACKNOWLEDGEMENTS Guidance paper on Overview of the Integrated Management System is a product of the Managing Urban Europe-25

INTEGRATED MANAGEMENT - Towards local and regional sustainability - A short introduction to a model, an integrated management system, showing how cities and regions can integrate sustainability aspects

www.mue25.net www.localmanagement.eu TARGET SETTING ACKNOWLEDGEMENTS The is a product of the Managing Urban Europe-25 project. The project was part-funded by the European Commission, DG Environment. The

11 Template for an environmental management system manual according to ISO 14001:2004 The main goal of an environmental management system is to continuously improve the environmental aspects arising from

Public Procurement and Disposal of Public Assets Authority Procurement Performance Measurement System User's Guide August 2008 Public Procurement and Disposal of Public Assets Authority Procurement Performance

Guide for the Development of Results-based Management and Accountability Frameworks August, 2001 Treasury Board Secretariat TABLE OF CONTENTS Section 1. Introduction to the Results-based Management and

Initiative October 2013 / V1 Guidance Note: 3 Developing an Implementation Plan Introduction A key requirement of an application to join CoST is an implementation plan. The implementation plan should respond

1. Introduction The Department of Provincial and Local Government (DPLG) defined performance management as a strategic approach to management, which equips leaders, managers, employees and stakeholders

A guide to evaluating Council Services using quality indicators Securing the future... l Improving services l Enhancing quality of life l Making the best use of public resources Foreword Perth & Kinross

Monitoring Highways England The monitoring framework October 2015 Contents Executive summary 4 Roads reform 4 ORR s role in monitoring Highways England 5 What we will do next 10 1. Overview of this document

Overview This standard is for senior managers in the facilities management environment. It is about monitoring, controlling and conserving energy for the organisation with the aim of reducing cost, and

Assessment Policy 1 Introduction This document has been written by the National Foundation for Educational Research (NFER) to provide policy makers, researchers, teacher educators and practitioners with

Equal Rights and Treatment for Roma in Moldova and Ukraine Project Management Methodology Manual WELCOME TO THE COUNCIL OF EUROPE PROJECT MANAGEMENT METHODOLOGY In July 2001, the Council of Europe launched

GEF/C.7/5 March 7, 1996 MONITORING AND EVALUATION: WORK PROGRAM AND BUDGET RECOMMENDED DRAFT COUNCIL DECISION The Council reviewed document GEF/C.7/5, Monitoring and Evaluation: work program and budget,

Pobal - FINAL The Local and Community Development Programme Strategic Plan Format and Guidance Notes 2011-2013 1 TABLE OF CONTENTS SECTION ONE - ETHOS OF THE ORGANISATION... 4 1.1 Vision, mission and values...

This note provides guidance on how Cornwall Council will provide support for the production of Neighbourhood Plans and Development Orders in accordance with the provisions of the Localism Act. It should

Conducting Formative Research 1 The foundation of any sound sanitation marketing program is formative research. Formative research follows a process and includes a set of tools that can be used to help

Case Study Best Practice Asset Management An example of an Activity Management Plan, published by the Working Group Case Study AMP 01-2014 The Working Group was established by the Road Efficiency Group

Of all the decisions an executive makes, none is as important as the decisions about people, because they determine the performance capacity of the organisation. (Peter Drucker as noted by the Business

QUALITY IN EVERYDAY WORK Quality Guide for the Teacher Education College Version 2.7 Updates: Organisational change 1.1.2009 JAMK s mission and vision 5.1.2010 Planning and development discussion practices

QUALITY IN EVERYDAY WORK Quality Guide for the Teacher Education College Version 2.5 Updates: Organisational change 1.1.2009 JAMK s mission and vision 5.1.2010 Planning and development discussion practices

QC-76-06-353-EN-C EN COUNCIL OF THE EUROPEAN UNION GENERAL SECRETARIAT Handling impact assessments in Council INDICATIVE GUIDANCE FOR WORKING PARTY CHAIRS ISBN 92-824-3284-X,!7IJ2I2-edcieg! kg611572cee_couv.indd

ANNEX E: GLOSSARY OF KEY TERMS IN M&E Source: Development Assistance Committee (DAC). 2002. Glossary of Terms in Evaluation and Results-Based Management. Paris: OECD. This glossary is available in English,

Aneurin Bevan Health Board Draft Communications and Engagement Framework Working with you for a healthier community, Caring for you when you need us, Aiming for excellence in all that we do Author: Head

Government leadership in assuring better quality healthcare in South Africa: policy into practice Authors: Marshall CA (Dr); Msibi EB Office of Standards Compliance, National Department of Health, SOUTH

PROJECT MANAGEMENT PLAN CHECKLIST The project management plan is a comprehensive document that defines each area of your project. The final document will contain all the required plans you need to manage,

EUROPEAN COMMISSION AGRICULTURE DIRECTORATE-GENERAL Guidelines for the mid term evaluation of rural development programmes 2000-2006 supported from the European Agricultural Guidance and Guarantee Fund

5. THAILAND 5.1 Water Resources Management Policies and Actions In Thailand, the Office of Natural Resources and Environmental Policy and Planning issued the State of Environment Report 2004, which has

LYSKRAFT Collaboration Agreement between the municipality of Norrköping and Linköping University, the 5th agreement and for 2014 2016 Background and general prerequisites The municipality of Norrköping

EUROPEAN COMMISSION Better Regulation "Toolbox" This Toolbox complements the Better Regulation Guideline presented in in SWD(2015) 111 It is presented here in the form of a single document and structured

A social marketing approach to behaviour change An e-learning course in using social marketing to change or sustain behaviour About The NSMC Established by Government in 2006, we are the centre of excellence

1 3 March 2011 Appendix I including Annex 1A Description of Work A feasibility study for an LNG filling station infrastructure and test of recommendations Project period: 02.05.2011 31.03.2012 Trans-European

SC21 Manufacturing Excellence Process Overview Prepared by:- The SC21 Performance, Development and Quality (PDQ) Special Interest Group (SIG) Acknowledgement The scoring methodology used in the Management

IT strategy made simple What is an IT strategy? 3 Why do you need an IT strategy? 5 How do you write an IT strategy? 6 step 1 Planning and preparation 7 step 2 Understanding your organisation s IT needs

1. Trustees annual report Accounting and reporting by charities Overview and the purpose of the trustees annual report 1.1. The primary purpose of the trustees annual report (the report) is to ensure that

CHEA Institute for Research and Study of Acceditation and Quality Assurance Accreditation and Accountability: A CHEA Special Report CHEA Occasional Paper Special Report December 2006 CHEA The Council for

Measures to Improve Accessibility of Public Websites in Europe Executive Summary Centre for Excellence in Universal Design Research supported by: 1 Authors of this report This report was compiled and edited

14 Water safety plan review, approval and audit An appropriate body, usually the regulator or their designated agents, should review and approve water safety plans prepared by suppliers or Government agencies.

EIP Water Action Group (AG100) Innovative monitoring technologies and EU Water legislation A white paper Version: July 2015 1 - Introduction This white paper addresses the role and position of water quality