2
How are Projects Rated at the World Bank? Project ratings are based on evaluation criteria that are harmonized across IEG and OPCS Main ratings are: Outcome, Risk to Development Outcome, Bank Performance, and Borrower Performance Evaluation methodology is objectives-based

4
Why do ICR and ICR Review Ratings Differ? Reason #1: Disagreement over project objectives or their weighting Objectives in ICR are not taken from PAD/Financing Agreement ICR does not discuss how any poorly articulated objectives have been interpreted “By” and “through” parts of objectives are treated as the intended outcomes Relative weights given to different objectives in arriving at ICR ratings are not made explicit and justified

6
Why do ICR and ICR Review Ratings Differ? (Cont’d) Reason #3: Differences in treatment of country circumstances In rating Project Outcome, IEG makes no allowance for difficult country context; objectives and design are supposed to take that into account However, difficult country contexts do factor into the Bank Performance rating Project Outcome rating is based on results not effort

7
Why do ICR and ICR Review Ratings Differ (Cont’d) Reason #4: Lack of familiarity with the ratings ICR rates project outcome based only on achievement of objectives, neglecting relevance and efficiency Relevance in ICR may ignore current relevance Harmonized criteria for deriving Bank Performance from its two constituent elements not observed (Ditto for Borrower Performance)

8
How can the disconnect be reduced? Ensure clarity about the objectives being used as the benchmark for evaluation Ensure that the ICR contains evidence on the entire results chain, from outputs to outcomes, including for institutional objectives Explicitly discuss attribution/plausible association, providing contextual information on overlapping government or other donor activities in the sector

9
How can the disconnect be reduced? (Cont’d) Discuss the relevance of project outcomes to the current CAS Acknowledge gaps in achieving the intended outcomes, drawing insightful lessons Acknowledge gaps in M&E, indicating proxy information used to underpin the ICR’s judgments

10
Even an unsatisfactory project with poor M&E can win an IEG Good Practice ICR Quality Award! Thank you