Consolidated Report CR PL 0601

Consolidated Report No.
CR/PL/06001
Consolidated Report
Country: POLAND
Sectors covered by the Report: Regional Development Public Administration Development Internal Market Agriculture Justice and Home Affaires Environment and Transport
Author: ECOTEC Consortium Date: 16th May 2006
TABLE OF CONTENTS
PREFACE..........................................................................................................................2 GLOSSARY OF ACRONYMS........................................................................................3 SUMMARY........................................................................................................................5 INTRODUCTION ..........................................................................................................20 GENERAL BACKGROUND...............................................................................................20 PROGRESS OF IMPLEMENTATION OF THE 2005 AND 2006 ANNUAL EVALUATION PLANS..........................................................................................................................................22 DISSENTING VIEWS.......................................................................................................25 RESULTS OF EVALUATION......................................................................................28 PUBLIC ADMINISTRATION DEVELOPMENT....................................................................28 REGIONAL DEVELOPMENT............................................................................................30 INTERNAL MARKET ......................................................................................................34 JUSTICE AND HOME AFFAIRS .......................................................................................36 AGRICULTURE ..............................................................................................................39 TRANSPORT AND ENVIRONMENT .................................................................................41 THEMATIC REPORTS ....................................................................................................43 REPORTS OF THE SHORT TERM TECHNICAL EXPERTS .................................................47 PERFORMANCE RATINGS........................................................................................49 CONCLUSIONS .............................................................................................................52 PUBLIC ADMINISTRATION DEVELOPMENT....................................................................52 REGIONAL DEVELOPMENT ...........................................................................................52 INTERNAL MARKET ......................................................................................................54 JUSTICE AND HOME AFFAIRES .....................................................................................54 AGRICULTURE...............................................................................................................55 TRANSPORT AND ENVIRONMENT..................................................................................56 RECOMMENDATIONS................................................................................................57 RECOMMENDATIONS PRESENTED IN PARTICULAR IE REPORTS....................................57 ANNEXES........................................................................................................................64
Consolidated Evaluation Report No.. CR/PL/06001. 16th May 2006
PREFACE
This Consolidated Report covers Phare assistance provided to the Regional Development, Public Administration, Internal Market, Justice and Home Affairs, Transport and Environment and Agriculture sectors in Poland and being the subject of the Interim Evaluation process between 1 st November 2005 and 25th April 2006. It also covers Thematic/Ad Hoc evaluations conducted in the reporting period (including evaluation of twinning projects implemented within the framework of Transition Facility programme). The cut-off date of this report is 25th April 2006. This Consolidated Report has been prepared by the ECOTEC Consortium 1. The findings are based on the results of the Interim Evaluations conducted during the reporting period and examining the progress of the programmes towards the objectives stated in the formal programming documents, i.e. Financing Memoranda, Project Fiches, etc. The report is intended to provide management information on the programmes/ projects for the benefit of the Sectoral Monitoring Sub-Committees (SMSC), Joint Monitoring Committee (JMC) and other involved parties.
The author of the Report is Mr Tomasz Skierniewski.

2
GLOSSARY OF ACRONYMS
Acronym
AEP AGR AMA AP CAP CBC CFCU EAGGF EDIS ENV ESC EU FV HRD HS HU IE INT IT JE NAC JHA JMC JS NAC NDP NPAA NPPM PAD PAO PIFC
Description
Annual Evaluation Plan Agriculture Agricultural Market Agency Accession Partnership Common Agricultural Policy Cross Border Co-operation Central Finance and Contracts Unit European Agricultural Guidance and Guarantee Fund Extended Decentralised Implementation System Environment Economic and Social Cohesion European Union Final Version Human Resources Development Highly Satisfactory Highly Unsatisfactory Interim Evaluation Internal Market Information Technology Evaluation Unit of the National Aid Co-ordinator Services (abbreviation of the Polish: Jednostka Ewaluacyjna sub NAC) Justice and Home Affairs Joint Monitoring Committee Just Satisfactory National Aid Co-ordinator National Development Plan National Programme for the Adoption of the Acquis National Programme for Preparation for Membership of the European Union Public Administration Development Programme Authorising Officer Public Internal Financial Control
Consolidated Evaluation Report No.. CR/PL/06001. 16th May 2006 3
REG S SF SIPF SME SMSC SPF TF TRA UKIE
Regional Development Satisfactory Structural Funds Small Infrastructure Project Fund Small and Medium-sized Enterprise Sectoral Monitoring Sub Committee Small Project Fund Transition Facility Transport Office of the Committee (abbreviation of the Polish: Europejskiej) Unsatisfactory Voivodship Labour Office for European Integration Urzd Komitetu Integracji
US VLO
SUMMARY
Consolidated Report: CR/PL/06001 This Consolidated Report summarises results of the interim evaluation conducted and ongoing in the period 1st November 2005 25th April 2006. The cut-off date of this report is 25th April 2006. This consolidated Report covers Phare assistance provided to the following monitoring sectors: Public Administration Development; Regional Development; Internal Market; Justice and Home Affairs; Agriculture; and
Environment and Transport. This report also covers Thematic/Ad Hoc evaluations conducted in the reporting period (including evaluation of twinning projects implemented within the framework of Transition Facility programme). The following tables present comparison between stipulations of the 2005 AEP and 2006 AEP and their respective implementation. Table 1. Progress of implementation of the Annual Evaluation Plan for 2005. (as on 25th April 2006)
Evaluation progress number of IE reports Sectors/Type of the report Transport & Environment Agriculture Internal Market Public Administration Development Justice and Home Affairs Regional Development Summary sectoral report (PAD) Thematic/Ad Hoc reports Total for 2005 AEP ESC CBC 5 Planned in 2005 AEP 1 2 2 3 2 3 2 1 4 20 0 On-going 0 0 0 0 0 0 0 0 2 2 5 Completed 1 2 2 3 3 3 2 1 2 18
Table 2. Progress of implementation of the Annual Evaluation Plan for 2005. (as on 25th April 2006)
Evaluation progress number of IE reports Sectors/Type of the report Planned in 2006 AEP On-going Completed
Transport & Environment Agriculture Internal Market Public Administration Development Justice and Home Affairs Regional Development Thematic/Ad Hoc reports Total for 2006 AEP ESC CBC 4
1 1 1 2 2 2 2 5 16 1
0 1 1 2 1 1 0 3 9 0
0 0 0 0 0 0 0 0 0
Within the framework of 2005 AEP only two Thematic/ Ad Hoc reports are still ongoing. Of these two, report THE/PL/05015, Implementation of twinning projects financed under the Transition Facility programme one following the request of the JE NAC was commenced with the Kick-off Meeting on 14th February 2006 and evaluates the twinning projects implemented under the Transition Facility instrument. The process of production of this report progresses in accordance with the agreed timelines. The remaining Thematic/ Ad Hoc report, THE/PL/05012, Twinning projects as an instrument preparing for the utilisation of Structural Funds, focused on analysing the twinning as an instrument for the Institution Building is in the drafting phase as it was delayed by the very limited rate of responses to the questionnaire research and slow performance of the employed Short Term Technical Specialist expected to produce the crucial element of the report.
Except for one Thematic Report there are no major derivations from the plan evaluation established by the 2005 AEP. There were some delays noted at various stages of production of particular reports but finally these problems were overcome and with the above mentioned exception for two Thematic/Ad Hoc report all activities planned under 2005 AEP are completed. Implementation of the 2006 AEP progresses accordingly to the agreed timelines and there are no derivations from the plan. There are no significant delays in submission of the draft reports.
This Consolidated Evaluation Report, CR/PL/06001, covers the results of the Interim Evaluations (IE) carried out in the period between 1 st November 2005 and 25th April 2006 and presents the implementation status of the Interim Evaluation of Phare programme in Poland as on 25th April 2006 (the cut-off date of this Consolidated Report). In this reporting period, according to the Annual Evaluation Plans for 2005 (2005 AEP) and for 2006 (2006 AEP), the IE process covered selected Phare programmes from the six sectors: Public Administration Development (1 IE report IE/PL/PAD/06002)2, Regional Development (3 reports: 2 in sub-sector ESC (IE/PL/REG/05013 and IE/PL/REG/06001)3 and 1 in CBC IE/PL/CBC/050144), Internal Market (2 reports IE/PL/INT/05017 and IE/PL/INT/06004)5, Justice and Home Affairs (2 reports IE/PL/JHA/05008 and IE/PL/JHA/05018)6, Agriculture (2 reports IE/PL/AGR/05010 and IE/PL/AGR/05020)7 and Transport and Environment (1 report IE/PL/TRA&ENV/05019)8
The following tables present sectors and projects covered by the IE reports carried out within the reporting period under the Annual Evaluation Plan for 2005.
2 3
On 7th April 2006 draft version of the report was submitted to the JEN AC. Report IE/PL/REG/05013 is already accepted as FV (on 23 rd March 2006), for the IE/PL/REG/06001report draft version has been submitted to JE NAC on 10th April 2006. 4 Accepted as FV (on 23rd March 2006). 5 IE/PL/INT/05017 is already aaccepted as FV (13th February 2006)), the IE/PL/INT/06004e has been submitted to JE NAC as draft version on 31st March 2006 and formally accepted by JE NAC on 13 th April 2006 and distributed to stakeholders for comments.. 6 Both accepted as FVs (IE/PL/JHA/05008 on 16th January 2006 and IE/PL/JHA/05018 on 17th February 2006). 7 Both accepted as FVs (IE/PL/AGR/05010 13th January 2006 and IE/PL/AGR/05020 on 11th April 2006). 8 On 14th April 2006 the report was formally accepted by JE NAC as FV. Consolidated Evaluation Report No.. CR/PL/06001. 16th May 2006 7
Table 3. Sectors and projects covered by the IE reports carried out between 10th November 2005 and 25th April 2006 and produced under the 2005 AEP
PL0106.07.01 Development Swietokrzyski National Park PL0106.07.03 Tourism development Sandomierz 2002/000-580.06.29 Renovation of a post-industrial area 2002/000-605.06.08 Tourism development 2003/004-379/5/34 Industrial centres Starachowice and Ostrowiec PL0106.01.01 Southern Bypass of Torun PL0106.01.02 Completion of road 62 in Wloclawek PL0106.01.05 Industrial park Solec Kujawski 2002/000-605.06.01 SME development in Bydgoszcz 2002/000-605.06.02 Business incubator Solec Kujawski 2003/004-379/5/8 Investment areas Ciechocinek 2003/004-379/5/9 Vistula Park Swiecie 2002/000-580.06.33 SME Development in Koszalin 2002/000-580.06.34 SME Development in Bialogard 2002/000-605.06.09 SME Development in Drawskie 2003/004-379/5/40 Tourism Development in Bialogard 2003/004-379/5/41 Economic development Szczecinek 2002/000-580.06.06 Economic development of Poniatow 2002/000-580.06.07 Industrial route in Wroclaw 2002/000-580.06.08 Tourism development in Podgorzyn 2003/004-379/5/5 SME Development Bielawa 2003/004-379/5/6 Environmental protection Karpacz 2003/004-379/5/7 SME Development Glogow 2002/000-580.06.11 Investor friendly towns 2002/000-580.06.12 SME development in Gorzowski 2003/004-379/5/15 Investor friendly towns - phase II 2002/000-580.06.18 Tourism development in Opole 2002/000-580.06.19 Development of investment in Glogowek 2002/000-605.06.06 Economic development in Kolonowskie 2002/000-605.06.07 Tourism and SME Development in Ozimek 2003/004-379/5/23 Development of industry Bierawa
Regional Development
Economic and Social Cohesion
Due to a large number of projects originally planned to be covered by this report, the following projects: 2002/000-580.06.26 Improved investment attractiveness in Lebork 2002/000-580.06.27 Increased investment attractiveness of Slupsk 2002/000-580.06.28 Tourism development in the Gdansk bay 2003/004-379/5/31 Pomeranian technology park 2003/004-379/5/32 Tourism development Vistula Spit 2002/000-580.06.14 Economic development of Kety 2002/000-580.06.15 Development of Dobczyce industrial park 2002/000-580.06.16 Economic Development of Tarnow 2002/000-580.06.17 Economic development of Brzesko 2002/000-605.06.05 SME development in Nowy Sacz 2003/004-379/5/17 Investment development Niepolomice 2003/004-379/5/18 Nowe Dwory Urban Entreprise Zone Oswiecim 2003/004-379/5/19 SME Development Ciechanowski and Raciaz 2003/004-379/5/20 Economic Development Ostrow and Ostroleka 2003/004-379/5/21 SME Development Ostrow and Wyszkow 2003/004-379/5/22 SME Development Nasielsk 2003/004-379/5/38 Nowy Tomysl by-pass 2003/004-379/5/39 Investment and tourist development Leszczynski form pomorskie, maopolskie, mazowieckie and wielkopolskie voivodships become the subject of a separate report recognized as an addendum to the report IE/PL/REG/05013. This report at the cut-off date of this Consolidated Report was at drafting stage, and draft is planned to be submitted to the JE NAC in the first week of May 2006. Consolidated Evaluation Report No.. CR/PL/06001. 16th May 2006 8
Report IE/PL/050139
CrossBorder Cooperation
Internal Market
Report: IE/PL/INT/05017
Report IE/PL/CBC/05014
2002/000-606 CBC 2002 Poland Germany 2003/005-708 CBC 2003 Poland Germany
2003/005-710/01.02 Alleviation of social effects of steel restructuring 2002/000-580.02.03 Improve public procurement rules and practices 2003/004-379/01.02 Public procurement mechanisms and practices 2003/004-379/01.10 Strengthening the consumer protection policy 2002/000-605.02.01 Market surveillance 2003/005-710.01.01 Modernization of communicable diseases surveillance and control system 2002/000-605.03.05 2003/005-710.03.08 2002/000-580.03.01 policy 2002/000-580.03.02 2002/000-605.03.04 and economic crime 2003/005-710.03.01 2003/005-710.03.05 2003/005-710.03.06 Improvement of the judicial system Improving Justice system Twinning for border management and visa Twinning for asylum administration Twinning for the fight against organized Twinning for border services Twinning Fight against organised crime Fight against drugs
Justice and Home Affairs
Report IE/PL/JHA/05017
Agriculture
Transport and Environment
PL0104.08 IACS and Animal Identification and Registration System; 2002/000-580.04.02 Implementation of milk quota system; 2002/000-580.04.03 Preparation of AMA as paying agency; 2002/000-580.04.04 Institution Building for the Financial Instrument for Fisheries Guidance; 2002/000-196.04.01 Integrated information system for seed certification and marketing; 2002/000-605.04.02 Preparation for EAGGF 2002/000-605.04.01 National veterinary reference laboratory 2003/000-379.04.01 Strengthening Veterinary Administration 2003/005-710.04.02 The Reference Laboratory in the National Veterinary Research Institute (NVRI) in Puawy 2002/000-580.04.01 TSE control in Poland 2003/005-710.04.03 TSE control in Poland Part II 2003/005-710.04.04 Eradication of rabies in Poland 2003/005-710.04.05 Improvement of the LPIS system drawing on the GIS technology 2003/005-710.04.01 Phytosanitary and Seed administration 2003/005-710.04.06 Implementation of rural development measures financed from the EAGGF 2002/000-580.02.01 Strengthen the food control administration 2003/000-379.04.02 Strengthening the food control administration 2003/004-379.01.09 Improvement of the managing structures implementing the Cohesion Fund and ERDF in the transport sector 2003/005-710.05.02 Continuation of implementation of the EU Directive 2000/60/EC (WFD) 2002/000-632.07.01 Creation of a Central System of Radiological Monitoring and Radiation Safety of the wierk Nuclear Centre 2002/000-632.07.02 Reduction of occupational exposure and radioactive waste arising from the operation of the Maria research reactor through actions taken at the source 2003/5812.05.01 Upgrading of the heat exchangers and ionexchangers at the MARIA research reactor to reduce the possible radioactive release into the the environment
Table 4. Sectors and projects covered by the IE reports carried out between 10th November 2005 and 25th April 2006 and produced under the 2006 AEP. Sector
Report
Report IE/PL/TRA&ENV/05019 IE/PL/PAD/06002
Report IE/PL/AGR/05020
Programmes/projects covered
PL2002/000-580.01.08 Preparation project pipeline for ERDF PL2003/004-379/01.07 Improving ESF PL2003/004-379/01.08 Implementation of IROP on central and regional level PL2003/005-710.01.05 Preparing Interreg III PL2003/005-710.01.06 ERDF project pipeline preparation PL2003/004-379/01.01 NGOs for sustainable development
10
Public Administration Development
Economic and Social Cohesion
2002/000-580.06.01 Sectoral HRD 2002/000-580.06.02 SME and Innovation sectoral programme 2002/000-580.06.03 TA for ESC (30.03.2006) 2002/000-580.06.05 Regional support programme for SMEs 2003/004-379/5.1 Sectoral HRD 2003/004-379/5.2 SME and Innovation sectoral programme 2003/004-379/5.3 Regional HRD 2003/004-379/5.4 Regional support programme for SMEs 2003/005-710/01.02 Alleviation of social effects of steel restructuring 2002/000-580.02.03 Improve public procurement rules and practices 2003/004-379/01.02 Public procurement mechanisms and practices 2003/004-379/01.10 Strengthening the consumer protection policy 2002/000-605.02.01 Market surveillance 2003/005-710.01.01 Modernization of communicable diseases surveillance and control system 2003/005-710/01.02 Alleviation of social effects of steel restructuring 2003/004-379/01.02 Public procurement mechanisms and practices
Internal Market
IE/PL/INT/06004 Report IE/PL/JHA/06005 IE/PL/AGR/06008
IE/PL/REG/06001
PL2003/004-379/03.01 Migration and asylum system infrastructure development

PL2003/005-710.03.06 Fight against drugs - continuation PL2003/005-710.03.07 Fight against crime IV PL2003/005-710.03.08 Support for the justice system PL2003/004-379/03.02 Eastern border Small Infrastructure Project Fund (SIPF) PL2003/005-710.06.01 Business Related Infrastructure Project Fund (BRIPF) PL2003/005-710.06.02 Small Project Fund 2003/004-379.04.01 Strengthening veterinary administration 2003/005-710.04.01 Phytosanitary and Seed administration 2003/005-710.02.01 Implementation of Food Safety Strategy
Agriculture
11
Sectoral evaluation results
Table 5. Sectoral rating and conclusions as presented in the IE reports produced between 10th November 2005 and 25th April 2006.
Sector Performance rating Conclusions
The assistance provided to the Public Administration sector under the 2002 and 2003 Phare programmes addresses the broad range of sectoral priorities related to EU accession. To some extent, the design of the assistance was based upon the achievements of the previous Phare programmes, and starts in places where the past programmes have stopped. In this sense it constitutes a well-developed and coherent approach to sectoral needs. The objectives of the Phare projects are in line with and support the objectives of the Accession Partnership (AP) and the National Programme for the Adoption of Acquis (NPAA). In general, most projects are being managed properly and in accordance with Phare rules, but at times implementation structures do not work efficiently and effectively, and implementation process is often delayed (particularly in the case of 2003/005-710.01.05, 2003/005-379.01.08, 2003/005710.01.06). Effectiveness also is reduced by the late commencement of the contracting procedures (2003/004-379/01.07), which meant that not all measures were contracted before the expiry of the contracting period. The majority of the projects are expected to achieve the majority of their objectives, which will have a positive impact on preparing beneficiary institutions to implement and manage structural and cohesion funds. However, in some cases the results of the project are not as useful as they might be if all activities had started according to the schedule (2003/005379.01.08, 2003/005-710.01.06). Sustainability of the results achieved should be in general satisfactory. The importance of supporting and strengthening NGO sector by 2003/004-379/01.01 project as a partner for Public Administration sector should also be underlined. This project should have positive and sustainable effects.
Satisfactory
12
The assistance provided to the Regional Development sector under the Phare 2001 ESC, Phare 2002 ESC and Phare 2002 ESC programmes addresses the sectors main priorities as laid down by the National Strategy of Regional Development 2001 2006 (NSRD). The objectives of projects implemented are also in line with 2001 Accession Partnership with Poland (APP) in particular with the Economic and Social Cohesion (ESC) priority. The evaluated Phare 2001 ESC, Phare 2002 ESC and Phare 2003 ESC interventions in the Regional Development Sector investments projects constitute a coherent, well structured answer to the above mentioned sector priorities and needs. Projects are managed properly and in accordance with Phare rules. Implementation structures with some exceptions (last minute contracting of Phare 2001 projects) work efficiently and effectively. Most of the evaluated projects are expected to achieve their objectives and to have positive, expected impact on socio-economical development of the regions. The results infrastructure objects - will be sustainable. Also, the lessons learned and experience gained will facilitate the successful absorption of Structural Funds by beneficiary institutions. The assistance provided to the SME and HRD development under the 2002 and 2003 programmes addresses the broad range of the sectors main priorities as related to the process of accession and as related to the needs of the target groups. Therefore in general the assistance is highly relevant, although this statement masks considerable difference between HRD and SMEs projects. For the latter, the relevance (in terms of actual demand from SMEs) was significantly overestimated. The objectives of the Phare projects under the evaluation are in line with and support the objectives of the National Regional Development Strategy, National Human Resources Development Strategy as well as Accession Partnership and the National Programme for the Adoption of Acquis. The Active Labour Market Policies (ALMP) measures proves to be effective in supporting unemployed, however, they will have rather very limited impact on the higher level. The grant schemes proved to be effective way to implement these measures, as usually they are very close to the beneficiaries and are able to shape the program according to their specific situation. To much extend the assistance provided under 2002 and 2003 programmes bases upon the achievements of the previous Phare programmes, in particular using methodologies developed (e.g. Individual Action Plans). Regional and sectoral SME programmes with some modifications practically repeat the schemes developed under the previous Phare projects. The weak point of SMEs programs were the consulting grant components. With one exclusion10 there is very small interest in applying for this kind of support. As a consequence, a significant part of funds initially allocated for consulting grants had to be re-allocated to the investment grants. Unfortunately, not all efforts to re-allocate funds have been successful. For Phare 2003 SME projects, in total 6.1 M of respective allocations remained unused. Projects are managed properly and in accordance with Phare rules. Implementation structures work efficiently and effectively. The cooperation among the stakeholders including the ministries, IA, RIFs, and grant beneficiaries is in general smooth and productive. Also, in many case for grant beneficiaries under HRD projects, the implementation of the project is viewed as a useful exercise preparing to the implementation of other projects financed with ESF funds. Thus, the conclusion is that the overall picture of the intervention is positive with some lessons worth to be remembered. These are in particular related to two issues: the role of Non-governmental Organisations (NGOs) and Powiat Labour Officces (PLOs) in the implementation of ALMP measures and an adequate SMEs needs assessment especially with regard to the consulting grants.
10
Introduction to quality consulting grants under 2002/000-580.06.05 Consolidated Evaluation Report No.. CR/PL/06001. 16th May 2006 13
Satisfactory
ESC
Internal Market
Satisfactory
Highly Satisfactory
The assistance provided to the Cross-Border Co-operation sector under the 2002 and 2003 (Poland Germany) programmes addresses the broad range of the sectors main priorities. All these programmes are, to a large extent, based upon the achievements of the previous Phare programmes and constitute a well-developed and coherent approach to the sectors needs. The objectives of the Phare projects under the evaluation are in line with and support the objectives of the Accession Partnership and the National Programme for the Adoption of Acquis. Projects are managed well and in accordance with Phare rules. Implementation structures work efficiently and effectively, although implementation process is sometime delayed by time-consuming procedures. Most of projects (with exception for 2002/000-606.21) are expected to achieve their objective and are likely to have positive and expected impact on sector performance. Sustainability of results produced should be relatively high; however, sustainability of some activities is depended on continued efforts and stable policy on both sides of the border. The assistance provided to the Internal Market sector under the 2002 and 2003 projects covered within this interim evaluation report is particularly relevant to sector needs (with the exception of 2003/005-710.01.02). The objectives of the Phare projects under evaluation are in line with and support the objectives of the NPPM and AP, and are coherent with the relevant government strategies. Projects are managed relatively well and in accordance with Phare rules. However, for most of Phare 2003 projects there is a risk that contracting will not be finished within the contracting expiry date. At this stage it is not possible to accurately assess the Phare 2003 projects in terms of their impact and sustainability, however expected impact is satisfactory. The impact and sustainability of the Phare 2002 projects is also satisfactory. Assistance provided to the Justice and Home Affairs sector under 2001, 2002 and 2003 infrastructure projects covered by the interim evaluation process is highly relevant to the sector needs. To a large extent the assistance provided under 2001 and 2002 programmes is based upon the achievements of the previous Phare programmes, and starts in places where the past programmes stopped and constitutes a well developed and coherent approach to the sectors needs (e.g. PL0103.05, 2002/000580.03.07, 2002/000-605.03.02). On the other hand, one project deals with new issues and challenges which have not been covered by previous Phare assistance (2002/000-580.03.04 the Puszcza Biaowieska Euroregion is for the first time implementing an SPF project). The objectives of projects implemented are in line with and support the priorities of the AP and NPPM, and are coherent with the relevant government strategies. Three projects (2002/000-580.03.06, 2002/000-605.03.03, 2003/005-710.03.07) are also in compliance with regional development strategy. Implementation structures work efficiently and effectively, although the implementation process is on occasions delayed by the time-consuming exchange of documents, complicated procedures and complex relation between various parties involved in the implementation process. Implemented projects are expected to achieve their objectives and to have positive, expected impact on the sector. The results mostly pieces of infrastructure - will be sustainable. Also, mostly at the regional and local level of beneficiaries, the lessons learned and experience gained prepared them well for successful absorption of the Structural Funds. The assistance provided to the Justice and Home Affairs sector under the 2002 and 2003 Phare Institution Building projects addresses the broad range of sectoral priorities related to EU accession. To some extent, the design of the assistance was based upon the achievements of previous Phare programmes, and starts in places where the past programmes have stopped. In this sense, it constitutes a well developed and coherent approach to sectoral needs. The objectives of the Phare projects are in line
Satisfactory
CBC
14
Agriculture
Satisfactory
Satisfactory
with, and support the objectives of, the Accession Partnership and the National Programme for the Adoption of Acquis. All projects are being managed properly and in accordance with Phare rules and implementation structures work efficiently and effectively in almost all cases. The majority of evaluated projects have already achieved or are expected to achieve their objectives, which will have a positive impact on preparing beneficiary institutions to work in line with the EU standards and requirements. Sustainability of the results should be highly satisfactory. Some of the evaluated projects can be identified as good practice in the project implementation process (2002/000-580.03.01, 2003/005710.03.01, 2003/005-710.03.06). The assistance provided to the Agriculture sector under Phare 2001 and 2002 programmes addresses the sectors main priorities as related to the process of accession. All the evaluated projects are based upon the achievements of the previous Phare programmes, and starts in places where the past programmes stopped and constitutes a well developed and coherent approach to the sectors needs. The objectives of the Phare projects under the evaluation are in line with and support the objectives of the Accession Partnership and the National Programme for the Adoption of Acquis. Projects are managed in accordance with Phare rules and - with some exceptions (PL0104.08 lack of personal continuity in the project management) properly. In general implementation structures work efficiently and effectively, although the implementation process has been significantly delayed by the time-consuming preparation of twinning covenant (PL0104.08)11 or long process of modification of the PF and preparation of tender documentation and related exchange of documents (2002/000-196.04.01). In general implementation structures work efficiently and effectively, although the implementation process has been delayed by late contracting and the need to coordinate with preceding projects, which are delayed, (e.g. 2003/005-710.04.05, 2003/005710.04.06) Most of the evaluated projects have achieved or are on the way to achieve fully their immediate objectives and are likely to have a positive impact on the sectors performance. For other three projects the achievement of all immediate objectives is seriously threatened, delayed and/or limited in the scope (PL0104.08, 2002/000-196.04.01, PL2002/000-605.04.02). Accordingly, the impact of these projects will be limited. The overall impact of all evaluated projects on the sector performance is therefore expected to be satisfactory. Sustainability of results produced should be satisfactory, however, it is depended on commitment of the Polish authorities to provide the required financial resources and to limit turnover of highly trained staff. Also, in one case (2003/005-710.04.04) sustainability manifestly depends on the continuation of activities and on the factor s which are beyond the influence of the Polish veterinary services. Although the overall picture of the evaluated intervention could be assessed as a positive one, it should be however stressed, that this assessment masks significant differences in the performance of evaluated projects: from ones performing very well and likely to have a positive impact on the sector, to the ones poorly performing with limited impact expected. Also, the loose of 7.7M under 2002/000-580.04.01 slightly negatively affects this picture. The assistance provided to the environment and transport sectors under the 2002 and 2003 programmes addresses the broad range of the sectors main priorities. Project No 2003/005-710.05.02 is based upon the achievements of the previous Phare programmes (especially project No 2002/IB/EN/01) and constitute a well-developed and coherent approach to the sectors needs. The objectives of the Phare projects 2003/004-379/01.09 and 2003/005-710.05.02 are in line with and support the objectives of the Accession Partnership and the National Programme for the Adoption of
11
In the phase of preparation of the Twinning Covenant the implementation of this project was temporarily suspended by the EC what temporarily frozen all the activities. Obviously, this contributed to the delay. Consolidated Evaluation Report No.. CR/PL/06001. 16th May 2006 15
Acquis. Nuclear Safety projects properly implement the recommendations contained in the Council report on Nuclear safety in the context of Enlargement. Projects are managed well (except project 2002/632.07.02) and in accordance with Phare rules. Implementation structures work efficiently and effectively (except project 2002/632.07.02), although implementation process is sometimes delayed by time-consuming procedures. All the projects (except for project 2002/632.07.02) are expected to achieve their objective and are likely to have positive and expected impact on the sectors performance. Sustainability of results produced should be satisfactory or just satisfactory (in the case of project 2002/632.07.02)
Thematic report THE/PL/05015 Implementation of twinning projects financed under the Transition Facility programme12 was dedicated to the Institution Building projects implemented under the Transition Facility instrument and made comparison between the two tools: Phare and Transition Facility programme. It also evaluated the process of implementation of the Transition Facility projects. This evaluation concentrated mostly on Twinning and Twinning Light projects which by the cut-off date of the report (23 rd March 2006) were the only on-going activities under the Transition Facility scheme. The THE/PL/05015 report covers the Transition Facility projects implemented under the TF 2004 and TF 2005 editions. The following TF 2004 projects are covered by the report: PL04/IB/AG02 (2004/016-829.01.04) EU Multisector training programme strengthening Administration responsible for phytosanitary issues PL04/IB/SO01 (2004/016-829.01.04) EU integration multi-sector training programme - medicinal products for human use PL04/IB/SO03 (2004/016-829.01.06) Preparation of internal procedures and instruments of the Polish health insurance system for the application of regulations resulting from the co-ordination of social security systems -VITAPOL PL04/IB/FI01 (2004/016-829.01.09) Strengthening of the protection of the EU financial interests PL04/IB/EN01 (2004/016-829.02.01) Preparation for implementation of the legislative package REACH PL04/IB/OT03 (2004/016-829.02.02) Strengthening the protection of intellectual and industrial property rights PL04/IB/FI02 (2004/016-829.02.03) Competition protection PL04/IB/OT04; (2004/016-829.02.04) Consumer protection system PL04/IB/FI03 (2004/016-829.02.05) Strengthening the Polish Customs Service PL/04/IB/EC01 (2004/016-829.02.06) Strengthening Conformity Assessment PL04/IB/EN02 (2004/016-829.03.02) Management System on Drinking Water Monitoring in Chief Sanitary Inspectorate PL04/IB/EN03 (2004/016-829.03.03) Natura 2000; Elaboration of plans for renaturalization of natural habitats and habitats of fauna and flora species in Natura 2000 sites and elaboration of management plans for certain species in Birds Directive and Habitats Directive PL04/IB/AG03 (2004/016-829.04.01) Strengthening veterinary administration
12
Draft report was submitted to the JE NAC on 14th April 2006. Consolidated Evaluation Report No.. CR/PL/06001. 16th May 2006 16
PL04/IB/AG04 (2004/016-829.04.02) Strengthening of Institutions Involved in Rural Development Measures post 2006 PL04/IB/AG05 (2004/016-829.04.03) Institutional Building for the Design and Implementation of the Financial Instrument for Fisheries Guidance (2007 2013) PL04/IB/JH02 (2004/016-829.05.02) Strengthening of the process of implementation of the anticorruption activities in Poland PL04/IB/JH03 (2004/016-829.05.03) Inter-agency co-operation in the fight against organised crime PL04/IB/AG01TL (Multisector) Institutional and organisation reinforcing of units responsible for ex-post control of expenditures from EAGGF Guarantee section for intervention activities according to CMOs regulations PL04/IB/JH01TL (2004/016-829.05.01) Support for regional and local communities to prevent drug addiction on the local level PL2004/IB/JH/04/TL (2004/016-829.05.04) Strengthening the Polish justice system PL04/IB/OT02TL Strengthening the system of professional qualifications PL2004/IB/TE/01/TL Strengthening URTiP in monitoring and stimulating development of postal market PL2004/IB/TR/01/TL (Multisector)Market surveillance on marine equipment and adjustment of hydrographic activities carried in Poland to IHO S-44 This Thematic Evaluation also covers TF 2005 assistance under the following projects: PL2005/IB/AG/05 Improving the control of food safety in the production of plant crops PL2005/IB/AG/06 Strengthened food safety control of irradiated foodstuffs PL2005/IB/AG/07 Strengthening of the veterinary administration, phase II PL2005/IB/EC/01 Support to Small and Medium Enterprises (SMEs) for the implementation of the New and Global Approach Directives PL2005/IB/EN/01 Evaluation of existing active substances and registration and surveillance of biocidal products PL2005/IB/EN/02 Capacity building in the field of environment health PL2005/IB/EN/03 Extension of the sanitary supervision system in the area of water quality. PL2005/IB/FI/01 Improving the quality of operation of Tax Administration units PL2005/IB/FI/02 Strengthening the Polish Customs Service PL2005/IB/JH/01 Enhancing anticorruption activities in Poland PL2005/IB/JH/02 Strengthening of the protection of the EU financial interests PL2005/IB/SO/01 Strengthening of State supervision and monitoring system of exposure to electromagnetic fields PL2005/IB/SO/02 Transparency of the National Health System drug reimbursement decisions PL2005/IB/TR/01 Expanding the administrative capacity to implement EU rail market regulations PL2005/IB/AG/01/TL (Multi-sector project) Quality management strategy in the area of plant protection and seeds PL2005/IB/AG/02/TL (Multi-sector project) System of supervision over the coexistence of genetically modified crops with conventional and organic farming PL2005/IB/AG/03/TL (Multi-sector project) Strengthening of marketing quality control of fruit and vegetables
PL2005/IB/AG/04/TL (Multi-sector project) Supervision authorities and certifying bodies work in organic farming PL2005/IB/TE/01/TL Monitoring and stimulating the development of the telecommunication market PL2005/IB/EN/04/TL Strengthening the environment administration through information technology systems This Thematic Report focuses on implementation of 2004 and 2005 twinning projects financed under the Transition Facility programme especially on relevance of their objectives to the evolving needs and priorities at both sector and beneficiary level, efficiency of the administrative structures originally designed to implement the Phare programme and now being utilised for the implementation of the Transition Facility funded projects. On the whole, the evaluated projects are highly relevant to Polands current needs within the sector. Moreover, at the operational level they correspond well with the operational needs of the main beneficiaries and its mandated bodies. In most of the projects the objectives and the activities have been defined on the basis of research and analysis conducted in the beneficiary institutions. With reference to the majority of projects being under implementation their relevance is verified through gathering the feedback from participants and recipients of the twinning activities e.g. trainings, seminars, expert missions. Taking into consideration quite early stage of the TF 2004 twinnings realisation the efficiency of the implementation and management system can be assessed as satisfactory. The administrative structures of TF programme implementation work properly. The institutions involved into implementation co-operate well. The experience gained by these institutions during the realisation of Phare programme is useful for implementation of the TF funded projects. The operational contacts agreed in the previous years strengthen the co-operation. The formal/ official way of ex-changing information and documents was limited to a large extend and replaced by working relations based cooperation between institutions involved. However the efficiency of project implementation with the Ministry of Finance is limited due to time-consuming and too official (according to the CFCU and the UKIE staff) way of ex-changing of documentation and information. The co-operation between the CFCU and the twinning beneficiaries is satisfactory. The main element which negatively affects the implementation of the twinning activities is insufficient time devoted by the Polish side (project beneficiaries). Such situation is caused by insufficient number of staff in the beneficiaries institutions. Moreover, the Polish staff is not able to devote to twinning projects activities an appropriate amount of time due to other obligations and duties. On the other hand lack of time and insufficient number of staff in most cases are compensated by great commitment of the Polish side in the twinning. The main financial problem arising at the beginning of the twinning implementation was delayed delivery of TF co-financing. The twinning partners were obliged to use their own budgets to finance
the initial activities. During the course of evaluation no large problems with Polish cofinancing were identified. The local financial resources have been provided and are being utilised. Only in one project 2004/016-829.03.03 Natura 2000 the beneficiary did not receive the financing. All the 2004 twinnings for which the covenants have been signed are under implementation. Two covenants will be signed soon. Generally the effectiveness of the implemented projects is satisfactory. The activities are being run according to the schedule and the first mandatory results have been achieved. The majority of twinnings are expected to achieve the majority of the expected immediate objectives. The prognosis for impact and sustainability is generally rather good even considering the fact that the all evaluated twinnings are at an early stage of implementation where our assessment is based more on prediction than hard evidence. The Report concludes that the implementation of the twinning projects under the Transition Facility instrument in Poland progresses well and should be rated as Satisfactory.
19
INTRODUCTION
General background
The Contract Strengthening the Evaluation Capacities Technical Assistance under 2003/005-710.01.07 (the Contract) entered into force on 21st December 2004. The Contractor (the ECOTEC Consortium) commenced its activities immediately after the Contract signature. The previous Consolidated Evaluation Report, CR/PL/05002, covered the results of the Interim Evaluations (IE) carried out in the period between 1st April 2005 and 10th November 2005. This Consolidated Evaluation Report, CR/PL/05002, covers the results of the Interim Evaluations (IE) carried out in the period between 1 st November 2005 and 25th April 2006 and presents the implementation status of the Interim Evaluation of Phare programme in Poland as on 25th April 2006 (the cut-off date of this Consolidated Report). This report also covers Thematic/Ad Hoc evaluations conducted in the reporting period (including evaluation of twinning projects implemented within the framework of Transition Facility programme). During the reporting period the Contractor carried out activities planned under the two Annual Evaluation Plans: second part of the 2005 AEP and first part of 2006 AEP. Annual Evaluation Plan for 2005 covers evaluations commenced before 31 st December 2005. The completion of these evaluations (submission and acceptance of the Final Versions of the evaluation reports) however continues in 2006. The 2005 AEP had been prepared using information provided by UKIE in meetings held in December 2004 and January 2005. It was accepted in February 2005. The 2006 AEP has been drafted using information provided by UKIE in meetings held in December 2005 and the evaluation priorities for 2006 as approved by the project Steering Group in its meeting in December 2005. It was submitted to JE NAC on 3 rd January 2006 and was finally approved on 1 March 2006 following incorporation of comments presented by JE NAC on 10th January 2006. In this period, according to the Annual Evaluation Plans for 2005 (2005 AEP) and for 2006 (2006 AEP), the IE process covered selected Phare programmes from the six sectors evaluated within the framework of 11 IE reports. Eight IE reports produced under the 2005 AEP covered the following sectors:
20
Regional Development (2 reports: IE/PL/REG/05013 in sub-sector ESC 13 and IE/PL/CBC/05014 in CBC14), Internal Market (IE/PL/INT/05017 report)15, Justice and Home Affairs (2 reports, IE/PL/JHA/05008 and IE/PL/JHA/05018)16, Agriculture (2 reports IE/PL/AGR/05010 and IE/PL/AGR/05020)17 and Transport and Environment (IE/PL/TRA&ENV/05019 report)18.
The IE reports produced under 2006 AEP covered the following sectors: Public Administration Development (1 IE report)19, Regional Development (1 report in sub-sector ESC20), Internal Market (1 report)21,
The results of all the IE processes carried out in the reporting period are taken into account in this Consolidated Evaluation Report even if the IE process at the cut-off date of this report was not completed and the Final Version (FV) of the IE report was not yet accepted.
13 14
The report, with cut-off date 3rd October 2005, was accepted as FV on 23rd March 2006,. The report, with cut-off date on 30th September 2005 was accepted as FV on 23rd March 2006. 15 The report with cut-off date 30th October 2005, was accepted as FV on 13th March 2006. 16 Both accepted as FVs: IE/PL/JHA/05008 (with cut-off date on 30 th June 2005) was accepted on 16th January 2006, and IE/PL/JHA/05018 (with cut-off date 30th November 2005) on 24th February 2006. 17 Both accepted as FVs: IE/PL/AGR/05010 (with cut-off date on 15 th July 2005) was accepted on 13 th January 2006, and IE/PL/AGR/05020 (with cut-off date on 9 th December 2005) was formally accepted by JE NAC on 11 th April 2006. 18 Report (with cut-off date 30th December 2005) was formally accepted by the JE NAC as FV on 14 th April 2006. 19 On 7th April 2006 draft version of the report (with cut-off date 21st March 2006) was submitted to the JE NAC. 20 The draft version of the report (with cut-off date 20 th February 2006) has been submitted to JE NAC on 10 th April 2006. 21 The report (with cut-off date 31 st March 2006) has been submitted to JE NAC as draft version on 31 st March 2006 and formally accepted by JE NAC on 13th April 2006 and distributed to stakeholders for comments.. Consolidated Evaluation Report No.. CR/PL/06001. 16th May 2006 21
Progress of implementation of the 2005 and 2006 Annual Evaluation Plans

The 2005 and 2006 Annual Evaluation Plans (2005 AEP and 2006 AEP) summarise evaluation activities conducted in 2005 and 2006. 2005 AEP has been developed by the ECOTEC Consortium in early January 2005 following extensive liaison with our counterparts within UKIE. The 2005 AEP was approved by the contracts Steering Group and then accepted by the Members of the Joint Monitoring Committee. It constitutes the Work Programme for our consortium throughout 2005. According to the 2005 AEP, the Interim Evaluation (IE) process of the Phare programme conducted in 2005 in Poland should be implemented through the framework of 15 standard IE reports, one Summary sectoral IE report, and 4 Thematic/Ad Hoc reports. The 2005 AEP also includes evaluations of Phare programmes originally intended to be subjected to interim evaluation in 2004. Delays to the contracting of the External Evaluation Body meant however that the ECOTEC Consortiums contract did not occur until 21st December 2004, with actual evaluation report writing scheduled to start in February 2005. This document should therefore be viewed as an amalgamation of the 2004 and 2005 AEPs, though all activities took place in 2005. It should be stressed out that at the cut-off date of this Consolidated Report all these activities were on various stages of implementation.
Table 6. comparison between stipulations of the 2005 AEP and its implementation.
Evaluation progress number of IE reports Sectors/Type of the report Planned in 2005 AEP On-going Planned to be Completed completed
Transport & Environment Agriculture Internal Market Public Administration Development Justice and Home Affairs
22 23
1 2 2 3 2
0 0 0 0 0
1 2 2 3 2
122 223 224 325 226
FV or the report accepted by JE NAC on 13th April 2006. For the first report the evaluation process is completed, and the debriefing meeting took place on 7 th February 2006. For the second report, the FV of the report was accepted by JEN AC on 11 th April 2006 24 For both reports the evaluation process is completed, and the debriefing meetings took place on 4 th October 2005 and st 1 March 2006. 25 Debriefings for all these evaluations were organised on: 6 th September 2005 (for two first evaluations) and on 19 th December 2005 Consolidated Evaluation Report No.. CR/PL/06001. 16th May 2006 22
Regional Development Summary sectoral report (PAD)
ESC CBC
3 2 1 4 20
0 0 0 2 2
3 2 1 3 19
327 228 129 230 18
Thematic/Ad Hoc reports Total
Within the framework of 2005 AEP only two Thematic/ Ad Hoc reports are still ongoing. Of these two, one following the request of the JEN AC was commenced with the Kick-off Meeting on 14th February 2006 and evaluates the twinning projects implemented under the Transition Facility instrument. The process of production of this report progresses in accordance with the agreed timelines and the draft version of the report was submitted to the JEN AC on 11th April 2006. The remaining Thematic/ Ad Hoc report, focused on analysing the twinning as an instrument for the Institution Building is in the drafting phase as it was delayed by the very limited rate of responses to the questionnaire research and slow performance of the employed Short Term Technical Specialist expected to produce the crucial element of the report.
Except for one Thematic Report there are no major derivations from the plan evaluation established by the 2005 AEP. There were some delays noted at various stages of production of particular reports but finally these problems were overcome and with the above mentioned exception for two Thematic/Ad Hoc report all activities planned under 2005 AEP are completed. 2006 AEP, basing on evaluation priorities prepared by JEN AC in early December 2005, has been developed by the ECOTEC Consortium at the end of December 2005. It was approved by the contracts Steering Group and then accepted by the Members of the Joint Monitoring Committee. It constitutes the Work Programme for our consortium throughout 2006.
26 27
Both evaluations are completed with debriefing meetings organised on 25 th January 2006 and 24th February 2006. All these evaluations are completed w9ith debriefing meetings organised on: 2 nd August 2005, 23rd September 2005 and 1st March 2006. 28 Both evaluations are completed with debriefing meetings organised on: 21 st September 2005 and 1st March 2006. 29 Completed. FV accepted on 12 th October 2005. No debriefing meeting was organised for this report due to its different character (report summarising three previously prepared reports). 30 FV of these reports were formally accepted by JE NAC on 5 th July 2005 and 20th March 2006 Consolidated Evaluation Report No.. CR/PL/06001. 16th May 2006 23
Table 7. Comparison between stipulations of the 2006 AEP and its implementation.
Evaluation progress number of IE reports Sectors/Type of the report Planned in 2005 AEP On-going Completed
Transport & Environment Agriculture Internal Market Public Administration Development Justice and Home Affairs Regional Development Thematic/Ad Hoc reports Total ESC CBC 4
131 132 134 236 238 240 242 543 16 1
0 133 135 237 139 141 0 344 9 0
0 0 0 0 0 0 0 0 0
Implementation of the 2006 AEP progresses accordingly to the agreed timelines and there are no derivations from the plan. There are no delays in submission of the draft reports.
In general it should be stated that implementation of the 2005 AEP is going to be completed soon with the formal completion of the two on-going Thematic reports. The implementation of the 2006 AEP progresses well and without any major delay which could create any risk for timely completion of activities foreseen under this Annual Evaluation Plan.
31 32
According to 2006 AEP evaluation of this sector should start in June 2006 Kick-off Meeting took place on 6th April 2006 and the IE report is in the drafting phase. 33 Planned to be completed by 28th June 2006 34 Kick-off Meeting took place on 28 th February 2006, draft version of the report was submitted to JE NAC on 31 st March 2006 35 Planned to be completed by 28th April 2006. By the cut off date of this report comments on draft version of the report were not received from JE NAC. 36 For IE/PL/PAD/06002 report the draft version was submitted to the JE NAC on 7 th April 2006, for the second reportIE/PL/PAD/06007, the Kick-off Meeting took place on 6th April 2006 and the report is in drafting phase. 37 The IE/PL/PAD/06002 report is planned to be completed by 12 th May 2006 and the IE/PL/PAD/06007 report by 28 th June 2006. 38 For IE/PL/JHA/06005 report the Kick-off Meeting took place on 28 th February 2006 and the report is in the drafting phase (draft due to the JE NAC on 12th May 2006), commencement of the second report (IE/PL/JHA/06010) is planned on 18th May 2006. 39 Planned to be completed by 9th June 2006. 40 Draft report for IE/PL/REG/06001 was submitted to JE NAC on 27 th March 2006, commencement of the second report (IE/PL/REG/06014) is planned in July 2006. 41 Delayed draft version submitted to JE NAC on 10 th April 2006. Report was originally planned to be completed by 20th April 2006. 42 Commencement of these reports is planned on 23rd May 2006 and in July 2006. 43 Three reports are in the drafting phase, commencement of the remaining two is planned on 23 rd May 2006 and in July 2006. 44 Due to be completed by: 19th May 2006, 30th May 2006 and 7th July 2006 Consolidated Evaluation Report No.. CR/PL/06001. 16th May 2006 24
In January 2006, after the draft Annual Evaluation Plan for 2006 was submitted to JE NAC, the Contractor was informed that JE NAC had produced a new version of the Polish IE Manual. This new Manual introduced some procedural changes (including the introduction of pre-Kick-off Meetings and a requirement of preparation of special methodological notes for the pre-Kick-off Meeting) as well as lengthening the time period envisaged for the provision of documents by institutions involved in the implementation of evaluated projects to the Evaluators and lengthening the time period envisaged for acceptance of the draft version of the report by JE NAC. Both of these time periods were extended by 5 working days in total adding an additional 10 working days to the timelines planned in the 2006 AEP.
Dissenting views
Immediately after the draft IE reports are accepted by NAC Evaluation Unit, they are according to the stipulations of the Polish IE Manual, section 2.2.2.3 Preparation of the draft Interim Evaluation Report) transmitted via e-mail to the relevant ministerial departments/units responsible for direct implementation of a given programme as well as participants of the kick-off meeting for their comments. Remarks on draft reports can be provided by the relevant ministerial departments/units responsible for direct implementation of a given programme as well as participants of the kick-off meeting to External Evaluation Body in written form normally within 10 working days from transmission of the draft report. In some cases NAC Evaluation Unit extended the time for presenting remarks to 15 working days.
Comments and corrections referring to the factual situation of the projects implementation are always taken into account and incorporated into the draft final version of the IE report. When possible and if remarks, comments and corrections referring to the opinions and assessments presented by the Evaluators are well explained and justified these remarks were also incorporated into the revised version of the IE report. However in the situation when the remarks were not properly justified they were not incorporated into the main body of the IE report, but they were presented together with the Evaluators explanation why they were not incorporated in a special Annex, Dissenting Views.
In most cases the remarks presented in the Dissenting Views refer to the opinions and format and style of presentation of information in the IE report. Quite a large group of dissenting views refers to wrong understanding of formal procedures and regulations of the Manual of the Interim Evaluation of Phare and Transition Facility programmes ibn Poland. Sometimes remarks and comments refer to ratings presented in the report and in
25
some very rare cases have the form of a short statement that the rating should be changed from 0 to +1 that the overall rating should be highly satisfactory.
Analysing comments received during the consultation period for these IE reports which are constitute the factual basis for this Consolidated Report 45, it is visible that the reports were carefully analysed and utilised. It is clearly confirmed by the detailed and in-depth comments presented by the stakeholders invited to present their comments, corrections and remarks on the draft version of the reports. Statistically, in eight completed IE reports there were in total 62 dissenting views submitted by 8 commenting parties (comments presented on the same report by the different departments of the same institution were counted as provided by one partner). Dissenting views were noted only for three IE reports produced within the reporting period: IE/PL/JHA/05008, IE/PL/AGR/05010 and IE/PL/INT/05017. For other reports there were no dissenting views and all comments presented by stakeholders were agreed and incorporated by the Evaluators. It is worth to state that the number of dissenting views on particular reports varied between 13 (IE/PL/INT/05017) and 35 (on IE/PL/AGR/05010). In the case of the IE/PL/AGR/05010 report all these comments were presented by two beneficiary institutions, of which one provided 5 dissenting views. The remaining 30 comments and remarks were produced by two departments of the same beneficiary institutions and very often were of exactly the same nature and referred to the same elements of the report.
The largest number of dissenting views was provided by beneficiaries (48 dissenting views), then by Implementing Agencies (13 dissenting views) and PAO services (the remaining 1 dissenting view). The huge number of dissenting views provided by beneficiaries reflects the fact that on the IE/PL/AGR/05010 report one beneficiary (Agency for Restructuring and Modernisation of Agriculture) submitted 30 dissenting views.
When statistically analysing the subject of the dissenting views it should be stated that there are three main subjects which are predominantly present in the dissenting views: these are comments presenting different understanding/interpretation of agreed facts (26), comments referring to format and style of presentation (14) and comments questioning IE procedures defined by the Polish IE Manual (13). The number of dissenting views submitted on these three subjects (47) constitutes 76% of all dissenting views submitted during the reporting period.
Table 8. Dispersion of dissenting views by their subject.

45
The following eight IE reports were completed within the reporting period of this Consolidated Report (between 1 st November 2005 and 25th April 2006) : IE/PL/ JHA/05008, IE/PL/AGR/05010, IE/REG/05013, IE/PL/CBC/05014, IE/PL/INT/05017, IE/PL/JHA/05018, IE/PL/TRA&ENV/05019 and IE/PL/AGR/05020. Consolidated Evaluation Report No.. CR/PL/06001. 16th May 2006 26
Subject of dissenting view

Different understanding/interpretation of agreed facts Format/style of presentation IE procedures defined by the Polish IE Manual Rating Others
Number 20 14 13 10 5
Percentage 32 23 21 16 8 100
Total
62
Figure 1. Dispersion of dissenting views by their subject

Subjects of the dissenting view s
Different understanding/interpretation of agreed facts Format/style of presentation IE procedures defined by the Polish IE Manual Rating Others
27
RESULTS OF EVALUATION
Selected programmes from the monitoring sector Public Administration Development are the subject of one Interim Evaluation (IE) report: IE/PL/PAD/0600246. IE Report covering the following Phare projects: 2002/000580.01.08 Preparation of the project pipeline for European Regional Development Fund (ERDF), 2003/004-379/01.07 Improving European Social Fund (ESF) management and implementation, 2003/004-379/01.08 Implementation of Integrated Regional Operational Programme (IROP) on central and regional level, 2003/005-710.01.05 Preparation to implementation of the Community Initiative INTERREG III in Poland, with specific attention to the Eastern Border, 2003/005-710.01.06 Preparation of the project pipeline for ERDF, 2003/004-379/01.01 NGOs for sustainable development.
The results of the Interim Evaluation of the Phare programmes providing support to the Public Administration Development sector are summarised in the following Table: Table 9. Results of evaluations of projects from Public Administration Development sector
(carried out in period between 10th November 2005 and 25th April 2006).
Relevance On the whole, the evaluated projects are highly relevant to Polands current needs within the sector. They fit in well with the overall strategic aims and objectives of key strategy documents such as the AP and Polish National Programme of the Preparation for Membership in the European Union (NPPM). Moreover, at an operational level they correspond well with the operational needs of the Ministry of Regional Development and its mandated bodies. However, relevance is, in the case of 2002/000-580.01.08, 2003/005-710.01.05 and 2003/005379.01.8, adversely affected by project design weaknesses, e.g. the time lag between project design and implementation has affected relevance, with some of needs of beneficiaries changed in meantime. Also the delayed implementation of 2003/005-710.01.06 caused the need of change the target group of beneficiaries. The efficiency of the evaluated projects can in general be assessed as good. Efficiency was however at times threatened by serious delays with contracting (2003/005-710.01.05). The beneficiaries have at times delayed the preparation of tender documentation until the last moment, which has resulted in failure to contract Also, the new Polish Public Procurement Law has blocked contracting procedures for many months and made it impossible to appoint a contractor before the contracting expiry date (2003/004-379.01.07). However, efficiency was, despite these problems, generally good because of the highly committed staff within beneficiary institutions who were determined to overcome any implementation problems. Co-operation between the beneficiary institutions and the twinning partners are very good (2003/004-379.01.07, 2003/005-379.01.08). The effectiveness of the evaluated projects has generally been high. The majority of projects are expected to achieve the majority of the immediate objectives. Whilst the effectiveness of the projects as a whole is good, the effectiveness of the administration in maximising the use of Phare funding has in a number of cases been lower. This has meant that some of project contracts have been funded through Polish national financing as opposed to Phare because of an inability to complete Phare tender procedures within the required timeframes (2003/004-379/01.07). In some case, the projects are unlikely to develop their full potential (2003/005-710.01.05, 2003/005-
Efficiency
Effectiveness
46
Draft version of the report (with cut-off date 21 st March 2006) submitted to the JE NAC on 7 th April 2006 and by the cut-off date of this report no formal approval was received from JE NAC Consolidated Evaluation Report No.. CR/PL/06001. 16th May 2006 28
Impact
Sustainability
379.01.08, 2003/005-710.01.06) due to the fact that their implementation is delayed. The prognosis for impact is generally rather positive. There is an important problem some evaluated projects are implemented too late to achieve significant impact on supported issues (2003/005-710.01.05, 2003/005-379.01.08). Despite these limitations, the majority of the projects will have a positive impact on the institutional development of the MRD and its mandated bodies. Increased staff skills and competencies, the development of new procedures and tools are all practical examples of the likely positive impact of some projects (2003/004-379/01.07, 2003/005379.01.08, partially 2003/005-710.01.05). It should be also underline the importance of supporting and strengthening NGO sector by 2003/004-379/01.01 project as a partner for Public Administration sector. Preparation of project pipeline under 2002/000-580.01.08, 2003/005379.01.08 and 2003/005-710.01.06 will also have beneficial impact on the sector, but limited by too late or too early implementation. The sustainability of the results of programmes under evaluation is likely to be good reflecting a strong commitment within the staff of the Ministry of Regional Development and its mandated bodies to permanently embed the positive effects and impact of the projects under evaluation into their institutional procedures and culture (2003/004-379/01.07, 2003/005-710.01.05, 2003/005379.01.08). Also the project addressed at the NGO sector (2003/004-379/01.01) will have positive and sustainable effects. The results of the project pipelines under 2002/000-580.01.08, 2003/005379.01.08 and 2003/005-710.01.06 will be also sustainable. However due to poor timing of the implementation their sustainability is reduced.
The overall ratings of the implementation of the assistance provided to the sector and covered by the IE processes conducted in the reporting period are presented in the following Table: Table 10. Overall rating of evaluated projects from the PAD sector
(as on 25th April 2005)
Criterion Sustainability Effectiveness Relevance Efficiency Impact Descriptive rate Rate explanation
Total for the Sector:
The assistance is in general relevant to sector needs and is being implemented satisfactorily in accordance with Phare rules, but sometimes implementation structures have not worked efficiently and effectively. Satisfactory The implementation process is sometimes delayed. The majority of the projects are expected to achieve most of their objective, which will have a positive impact. Sustainability of the results achieved should be satisfactory.
29
Evaluation of the selected programmes from the monitoring sector Regional Development was conducted within the framework of activities addressing two main subsectors: Economic and Social Cohesion (ESC) and Cross-Border Cooperation (CBC). The results of the evaluation in these two sub-sectors are presented separately. Economic and Social Cohesion Evaluation of the selected programmes from the sub-sector Regional Development was conducted within the framework of two IE Report IE/PL/REG/0501347 conducted under 2005 AEP covers Phare 2001 ESC, Phare 2002 ESC and Phare 2003 ESC assistance to the regional development sector investment projects in the following voivodships: Dolnolskie, KujawskoPomorskie, Lubuskie, Opolskie and Zachodniopomorskie. IE/PL/REG/0600148 conducted under 2006 AEP covers Phare assistance under the following programmes/projects: 2002/000-580.06.01 Sectoral HRD, 2002/000-580.06.02 SME and Innovation sectoral programme, 2002/000580.06.03 TA for ESC (30.03.2006), 2002/000-580.06.05 Regional support programme for SMEs, 2003/004-379/5.1 Sectoral HRD, 2003/004-379/5.2 SME and Innovation sectoral programme, 2003/004-379/5.3 Regional HRD, 2003/004379/5.4 Regional support programme for SMEs.
The results of the Interim Evaluation of the Phare programmes providing support to the Regional Development sector are summarised in the following Table: Table 11. Results of evaluations of projects from Regional Development ESC sector
Relevance All evaluated infrastructure projects properly address sectors needs and respond to both to national strategies towards the sector and accession related priorities, and their relevance is very high. Projects design is based on NPAA and AP priorities and is in line with the governmental strategy. Beneficiaries identify project objectives as their own and therefore the project ownership feeling is in general high. In particular projects meet regional needs related to the undeveloped road network and environmental infrastructure what is undoubtedly one of the most urgent problems related to the economic and social cohesion for almost all regions and especially for rural areas. The HRD projects target the groups which are in particularly difficult situation on the labour market and therefore they are highly relevant. The assistance is built to much extent on the methodology and approach developed on the achievement of the previous editions of the Phare HRD projects (e.g. the measure 1 of 2002/000-580-06.01 and of 2003/004-379/05.01 continues PL01.06.09.01-01-02). Due to the overestimated demand for the consulting services, the
47
The IE process is completed. Report with cut-off date 3 rd October 2005 was formally accepted by JE NAC on 23 rd March 2006. 48 Draft report (with cut-off date 20th February 2006) was submitted to JE NAC on 10th April 2006, formally approved and distributed to the stakeholders for comments. Consolidated Evaluation Report No.. CR/PL/06001. 16th May 2006 30
structure of the assistance under particular projects SME projects does not fit very well to real SMEs needs, as the interest of potential beneficiaries in consulting grants was significantly limited, and the interest in investment grants significantly exceeded the projects scope. Thus the overall relevance of the assistance may be described as satisfactory. Effectiveness The effectiveness of the evaluated infrastructure projects is in general satisfactory and the assumed operational aims are being successfully achieved, benefits being delivered to final beneficiaries. As the particular projects being completed, produced results will be supporting the achievement of the assumed immediate objectives. However the effective implementation of Phare 2001 ESC projects have been seriously threatened by financial liquidity problems The effectiveness of the evaluated SME and HRD oriented projects is generally high, although differentiated. Services delivered to unemployed are very highly assessed and was effective in influencing beneficiaries employability. The objectives of SME projects related to the consulting grants will be achieved only in a very limited scope, as overall, due to the very low demand, most of the outputs expected for the consulting grant schemes were not produced as planned (except the consulting grants under the Introduction to quality scheme. On the other hand, the investment grants schemes proved to be a highly effective tools in improving the overall market position of beneficiary SMEs and in supporting the implementation of new technologies Efficiency In principle, evaluated infrastructure projects are implemented efficiently, and with minor exclusions there is no problem with the beneficiary identification with project objectives and goals. All the parties and structures involved in the implementation of evaluated projects work and cooperate well. Projects implementation runs smoothly and will produce expected outputs. In the case of ESC projects, the efficiency of the projects implementation was negatively affected by the number of factors. The poor quality of tender documentation submitted by the beneficiaries affected mostly the implementation of projects within Phare 2001 ESC programme causing severe delays which resulted in extensions of disbursement periods and last minute contracting. As a consequence, also the implementation of the projects is delayed when compared to the initial schedule. With respect to the timeliness of the contracting situation improved under Phare 2002 ESC and especially under Phare 2003 ESC. However Phare 2002 was affected by the changes of the implementation system and related changes of the format of demanded documentation. The efficiency of implementation of all projects was affected by complicated and requiring extensive human resources (esp. beneficiaries) monitoring system. Numerous re-allocation of Phare funds resulting from savings which occur as a result of the contracting process enabled efficient use of the available funds, adding thus to the overall efficiency of project implementation All the SME and HRD oriented projects are implemented smoothly, efficiently and flexibly. The monitoring system works effectively. The TA support received by the IA and beneficiaries was adequate. The overall efficiency of projects implementation was increased by flexible management, by numerous re-allocations which enabled efficient, following real demand, use of funds. However, in the case of two 2003 SMEs projects, not all Phare funds had been contracted (in total 6.1 M remained unused) what negatively affects the overall efficiency. Impact Implemented infrastructure projects are expected to achieve their immediate objectives, which are properly formulated and support achievement of wider objectives of the assistance provided and will have positive and expected impact on the sector. Both HRD and SME projects have (for the projects which are completed) or will have some positive impact, but on a micro-level (individual and local), may be regional in some cases. HRD projects have or will have a positive impact on individuals related to their position on the labour market, whereas SMEs projects have or will have the impact on the SMEs standing Sustainability The evaluated projects are expected to produce sustainable results, although overall sustainability is reduced by not sufficient use of Phare experience for the preparation of SF implementation system. Also, sustainability esp. in HRD sub-sector depends on macroeconomical conditions and on the inflow of funds to finance initiatives of labour market institutions which were initiated under evaluated projects. In the case of ESC programmes ,. the evaluated projects are expected to produce sustainable results. The overall sustainability of the projects results is increased by the fact of using be beneficiaries the lessons learned and experience gained during projects implementation for SF absorption.
31
One may expect that in general effects of investments in SMEs supported under the grant schemes should be sustainable provided the national economy will keep growing. To some extend this also applies to the effects of some consulting grant schemes (where achieved, like e.g. Introduction of Quality under 2002/000-580.06.02). The sustainability of the effects of HRD projects which in general are related to the employability of individuals depends on many socio-economical factors and cannot be neither assessed nor reasonably predicted at this stage. The effects of the investments in business supporting infrastructure supported by regional projects (2002/000-580.06.05 and 2003/004-379.05.04) are likely to be sustainable, provided the appropriate funds will be provided for the maintenance
The overall ratings of the implementation of the assistance provided to the sector and covered by the IE processes conducted in the reporting period are presented in the following Table: Table 12. Overall rating of evaluated projects from the REG/ESC sector
Criterion Sustainability Effectiveness Relevance Efficiency Impact Descriptive rate Rate explanation
(as on 25th April 2005)
Total for the sector
+2
+1
+1
+1
+1
Satisfactory
Assistance provided under the infrastructure investment projects is highly relevant to the sector needs. Although in general the implementation runs smoothly, it is marked with serious problems with timeliness, esp. in the contracting phase and permanent problems with the financial liquidity. The effective use of savings adds to the overall efficiency of the intervention. Projects are either meeting or are expected to meet their immediate objectives, however this is likely to be delayed in some cases. Projects effects when produced are likely to be sustainable. Provided the performance of the national economy will be good, one might justifiably expect that projects will have reasonable impact on regional and local socio-economical situations, but this could be definitely confirmed only some time after the projects are completed. The assistance supporting development of SMEs and HRD sub-sector, is highly relevant to the sector of the regional development. It meets the real, existing needs in two key sub sectors: HRD an SME. The projects are managed efficiently and flexibly what is of crucial importance for the efficient use of funds and adjusting projects to the changing circumstances. With the exception of the consulting grant schemes, all the expected effects are likely to be achieved supporting the achievement of the immediate objectives. The beneficiaries level and local impacts may be reasonable, although it is too early stage to make the definite assessment. Some of the effects are likely to be sustainable.
32
Cross-Border Cooperation Evaluation of the selected programmes from the sub-sector Cross-Border Co-operation was conducted within the framework of one IE Report: IE/PL/CBC/0501449 conducted under 2005 AEP covers: 2002/000-606 CBC 2002
Poland Germany and 2003/005-708 CBC 2003 Poland Germany.
The results of the Interim Evaluation of the Phare programmes providing support to the sector are summarised in the following Table: Table 13. Results of evaluations of projects from Regional Development CBC sector
Relevance All evaluated projects properly address sectors needs and respond to accession related priorities, and their relevance is very high. Wider and immediate objectives, as identified through the process of bi- and multi-lateral international consultations, are addressing fields of crucial importance for the border areas development Project design indirectly reflects NPAA and AP priorities and is in line with the governmental strategy. Beneficiaries identify project objectives as their own and therefore the project ownership feeling is particularly strong.
Effectiveness For Polish German CBC projects, most of the evaluated projects within Phare 2002 were implemented effectively and are completed or at the final stage of implementation. For eight of them the disbursement periods were extended by 3.0 11.5 months. Phare 2003 projects are implemented properly and most of them are contracted. Notwithstanding some mentioned above problems, the effectiveness of the evaluated projects in general is satisfactory and implementation structures work well and Phare procedures are properly used. Efficiency Impact For Polish German CBC programmes, with exception for 2002/000-606.21 TA, the projects should achieve their immediate objectives. Implemented projects are expected to achieve their immediate objectives, which are properly formulated and support achievement of wider objectives of the assistance provided and will have positive and expected impact on the sector.
Sustainability All the evaluated projects are expected to produce sustainable results and particularly sustainability of the infrastructure projects should be very high. However sustainability of projects addressing people-topeople and business-to-business relations depends on continued efforts and stable policy on both sides of the border.
The overall ratings of the implementation of the assistance provided to the sector and covered by the IE processes conducted in the reporting period are presented in the following Table:
The IE process is completed. The report (with cut-off date 30 th September 2005) was formally accepted by JE NAC as FV on 23rd March 2006.
49
Table 14.
th
Overall rating of evaluated projects from the REG/CBC sector

Criterion Sustainability Effectiveness
(as on 25 April 2005)
Relevance
Efficiency
Impact
Descriptive rate
Rate explanation
Total for the +2 +1 +1 +1 +2 sector
Satisfactory
Polish German CBC projects should have a positive impact on the sector and results are expected to be sustainable. Rating negatively affected by last-day contracting of many projects, extension of disbursement period for eight projects, a lack of TA because of cancelling a tender and permanent problems with payments.
Internal Market
Evaluation of the selected programmes from the monitoring sector Internal Market was conducted within the framework of the following IE Reports: IE/PL/INT/0501750 conducted under 2005 AEP covers: 2002/000-580.02.03 Improve public procurement rules and practices, 2002/000-605.02.01 Market surveillance, 2003/005-710.01.01 Communicable diseases, 2003/005-710.01.02 Alleviation of social costs of steel sector restructuring Initiative III, 2003/004379/01.10 Strengthening the consumer protection policy, 2003/004-379/01.02 Public procurement mechanism and practices. IE/PL/INT/0600451 conducted under 2006 AEP covering Phare assistance under the following projects: 2003/005-710.01.02 Alleviation of social costs of steel sector restructuring Initiative III and 2003/004-379/01.02 Public procurement mechanism and practices.
The results of the Interim Evaluation of the Phare programmes providing support to the Internal Market sector are summarised in the following Table: Table 15.
Relevance
Results of evaluations of projects from Internal Market sector

Almost all evaluated projects properly address the sector and beneficiarys needs, and respond to accession related priorities, and their relevance is very high. Project design is based on NPPM and AP priorities, and is in line with the governmental strategies. Beneficiaries identify project objectives as their own and therefore project ownership is particularly strong. There are question marks as to the relevance of 2003/005-710.01.02 due to positive changes in steel sector (production grows up). The efficiency of the evaluated projects is satisfactory. However for the most of Phare 2003
Efficiency
50
The IE process is completed. The report (with cut-off date 30 th October 2005) was formally accepted by JE NAC as FV on 13th February 2006.
51
Draft version of the report (with cut-off date 31 st March 2006) was submitted to the JE NAC on 31 st March 2006. It was formally approved and on 12th April 2006 distributed to stakeholders for comments. Consolidated Evaluation Report No.. CR/PL/06001. 16th May 2006 34
Effectiveness
Impact
Sustainability
projects there is a risk that contracting will not be finished within the contracting expiry date (especially 2003/004-379.01.02). In two projects (2003/004-379/01.10 and 2003/005-710.01.01) two tenders have been cancelled. Direct agreements will be signed instead. Only in 2003/005710.01.02 there will be no problem with contracting. The project 2003/004-379/01.10 needs support new workplaces at the department responsible for implementation of Phare assistance. Generally projects are implemented effectively and project implementation progresses well, and should produce expected results. However, late contracting could make impossible to achieve some projects objectives. For 2003/005-710.01.02 it is known, that it will achieve only half of its immediate objectives Phare 2002 projects has achieved all its objectives and have positive impact: Market Surveillance System is operational, different institutions committed with the PPL strengthened. It is expected, that Phare 2003 projects will also have a positive impact on the sector. However, lack of databases of people, who take part in projects activities, will make impossible to asses impact in the future. Sustainability of evaluated projects is or is expected to be high. Sustainability of impact of 2002/000-580.02.03 is lower due to expected changes in the PPL. There will be continuity in the benefits identified.
The overall ratings of the implementation of the assistance provided to the sector and covered by the IE processes conducted in the reporting period are presented in the following Table: Table 16.
th
Overall rating of evaluated projects from the INT sector

Relevance
Efficiency
Impact
Descriptive rate
Rate explanation
Satisfactory
Most of the assistance is particularly relevant to the sectors needs (with the exception of 2003/005-710.01.02). Projects management system operates relatively well. The overall rating is adversely affected by the large number of Phare 2003 projects, which are at the early stage of implementation. In the case of 2003/005-710.01.02 the Implementing Agency presented a very high level of initiative and competence adopting the shape of the project to the rapidly changing situation in the sector. The overall impact and sustainability is likely to be positive
35

Evaluation of the selected programmes from the monitoring sector Justice and Home Affairs was conducted within the framework of two IE Reports (both conducted under 2005 AEP): IE/PL/JHA/0500852 covering: PL0103.04 Terespol railway border crossing stage II; PL0103.05 Road Border Crossing in Hrebenne; 2002/000-196.03.01 State Border Protection System II; 2002/000-580.03.03 Sea border protection system; 2002/000-580.03.04 Eastern border small projects fund; 2002/000580.03.05 Eastern border SIPF; 2002/000-580.03.06 Border crossing GoldapGusiew; 2002/000-580.03.07 Fight against crime III; 2002/000-605.03.01 Migration and asylum policy; 2002/000-605.03.02 Extension of Hrebenne border crossing; 2002/000-605.03.03 Construction of Grzechotki-Mamonowo crossing; 2003/004-379.03.01 Migration and asylum infrastructure; 2003/004-379.03.02 Eastern Border SIPF; 2003/005-710.03.02 Future external EU border investment; 2003/005-710.03.03 Road Border Crossing Hrebenne; 2003/005710.03.04 Road Border Crossing Grzechotki-Mamonowo; and 2003/005710.03.07 Fight against crime. IE/PL/JHA/0501853 covering Phare assistance under the following projects: 2002/000-580.03.01 Twinning for border management and visa policy, 2002/000580.03.02 Twinning for asylum administration, 2002/000-605.03.04 Twinning for the fight against organized and economic crime, 2002/000-605.03.05 Improvement of the Judicial system, 2003/005-710.03.01 Twinning for Border Services, 2003/005-710.03.05 Twinning - Fight against organised crime, 2003/005-710.03.06 Fight against drugs continuation, 2003/005-710.03.08 Support for the Justice system.
The results of the Interim Evaluation of the Phare programmes providing support to the sector are summarised in the following Table: Table 17. Results of evaluations of projects from Justice and Home Affairs sector
Relevance All evaluated investment projects properly address sector and beneficiary needs and their relevance is very high. The projects were designed on the basis of AP and NPPM priorities and are in line with government strategy. The wider and immediate objectives of several projects are also in compliance with regional strategies. Beneficiaries identify project objectives as their own and therefore project ownership is particularly strong. On the whole, the evaluated IB projects are highly relevant to Polands current needs within the
The IE process is completed. The report (with cut-off date 30 th June 2005) was formally accepted by JE NAC as FV on 16th January 2006..
53
52
The IE process is completed. The report (with cut-off date 30 th November 2005) was formally accepted by JE NAC on 17th February 2006. Consolidated Evaluation Report No.. CR/PL/06001. 16th May 2006 36
Efficiency
Effectiveness
Impact
Sustainability
sector. They fit in well with the overall strategic aims and objectives of key strategy documents such as the Accession Partnership and National Programme for Adoption of Acquis. Moreover, at an operational level they correspond well with the operational needs of the beneficiary institutions. However, relevance is, in some cases, adversely affected by project design weaknesses, e.g. not sufficiently recognising and defining beneficiaries needs and expectations (2002/000-580.03.02). In principle, infrastructure projects are being implemented efficiently by the beneficiaries identifying strongly with the projects objectives and goals and therefore also demonstrating a strong commitment to efficient project implementation. Cooperation among institutions involved in implementation of the projects was also rather good. The efficiency of the evaluated projects can in general therefore be assessed as good, although with one negative exception. In one case serious problems with the contractor and poor communication and cooperation between him and the beneficiary led to delays and the risk that the project will not be completed on time (PL0103.04). Overall efficiency was also negatively affected, but to a small extent, by number of other factors. The poor quality of tender documentation submitted by the beneficiaries necessitated several improvements (2002/000-580.03.06, 2002/000-605.03.01, 2002/000605.03.03). There were also some delays with contracting (2002/000-580.03.03, 2002/000605.03.01) and with time-consuming exchanges of documentation (PL0103.04, 2002/000605.03.01, 2002/000-605.03.03, 2003/005-710.03.07). Difficulties with proper assessment of particular contracts budgets by beneficiaries also necessitated modification of documents. The time lag between tender dossier design and tendering and constantly changes of market prices has negatively affected this assessment. The efficiency of the evaluated IB projects can in general be assessed as very good. Co-operation between the beneficiary institutions and the RTAs was also generally very good and fruitful (although there was one exception for 2002/000-580.03.02 where co-operation with the twinning partner was not satisfactory). The effectiveness of the evaluated infrastructure projects has generally been good with the majority of projects realising the expected outputs. Implementation structures work well and Phare procedures are properly used. For Phare 2003 projects it is very important to accelerate the tendering process in accordance with the Polish Public Procurement Law. In some cases there is a risk that, since time-consuming appeal procedures, the contracts with chosen contractors will not be signed in due time (2003/005-710.03.02, 2003/005-710.03.03, 2003/005-710.03.07). As a consequence of a problem with contractor for one project (PL0103.04), there is a risk that the project will not achieve all objectives. The effectiveness of the evaluated IB projects was generally very high. Almost all projects are expected to achieve their immediate objectives. The quality of results achieved is also high in the majority of cases (although there was one exception for 2002/000-580.03.02, where the quality of achievements was not always satisfactory). Implemented infrastructure projects are expected to achieve their immediate objectives, which are properly formulated and support achievement of wider objectives of the assistance provided and therefore will have a positive and expected impact on the sector. The prognosis for impact is generally good - even for those projects at an early stage of implementation where the evaluation is based more on prediction than hard evidence. The prognosis for impact for the evaluated IB projects is generally very positive. The majority of the projects will have a positive impact on the institutional development of the Police, Border Guard, Ministry of Justice, courts and prosecutors offices and other institutions and organisations participated in the projects. Increased staff skills and competencies, the development of new procedures and tools are all practical examples of the likely positive impact of evaluated projects (especially 2002/000-580.03.01, 2002/000-605.03.04, 2003/005710.03.06). There is one example (2002/000-580.03.02) which has had limited impact, because of lack of adjustment by twinning experts to the position following Polands absorption of EU structure and the level of Polish experts qualifications The sustainability of the infrastructure projects under evaluation is likely to be good as for the majority of investment projects. Obviously the sustainability of the results will depend on proper usage and beneficiaries commitment and contribution to the maintenance of constructed and purchased objects. In regard to SPF and SIPF projects their sustainability is also enhanced by greater experience and provided trainings for Euroregion and beneficiaries staff which will lead to more efficient realization of future projects. At the regional and local levels beneficiaries will be using the lessons learned and experience gained from Phare to increase their capacity to successfully absorb SF assistance. The sustainability of the IB projects under evaluation is likely to be good reflecting a strong
commitment within the Ministry of Interior and Administration, Ministry of Justice and their mandated bodies as well as the National Bureau for Drug Prevention to permanently embed the positive effects and impact of the projects under evaluation into their institutional procedures and responsibilities (2002/000-580.03.01, 2002/000-605.03.04, 2002/000-605.03.05, 2003/005710.03.06). In the case of 2002/000-580.03.02 only some results will be sustainable; for the rest of results their sustainability will be low due to the fact that these results are not in line with the needs of the beneficiaries.
th
Overall rating of evaluated projects from the JHA sector

Relevance
Efficiency
Impact
Descriptive rate
Rate explanation
Highly Satisfactory
Assistance provided under the infrastructure is highly relevant to sector needs. With some problems with four projects (PL0103.04, 2002/000-580.03.03, 2003/005710.03.03, 2003/005-710.03.07) projects implementation in general runs smoothly. Projects are either meeting or are expected to meet their immediate objectives and will have positive impact. The sustainability of all projects is likely to be high as for majority of investments projects. However it will depend on future contribution of beneficiaries in maintenance the results of the projects. The assistance provided under the evaluated IB projects is very relevant to sector needs and is being implemented in a very satisfactory way in accordance with Phare rules. In majority of cases, implementation structures work efficiently and effectively. All of the projects are expected to achieve all, or the majority of their objectives, and have already had a very positive impact. Sustainability of the results achieved should be very satisfactory. Some of the projects evaluated can be identified as good practice in the project implementation process.
38
Agriculture
Evaluation of the selected programmes from the monitoring sector Agriculture was conducted within the framework of two IE Reports (both conducted under 2005 AEP): IE/PL/AGR/0501054 covering: PL0104.08 - IACS and Animal Identification and Registration System; 2002/000-580.04.02 - Implementation of milk quota system; 2002/000-580.04.03 - Preparation of AMA as paying agency; 2002/000580.04.04 - Institution Building for the Financial Instrument for Fisheries Guidance; 2002/000-196.04.01 - Integrated information system for seed certification and marketing; and 2002/000-605.04.02 Preparation for EAGGF. IE/PL/AGR/0502055 covering Phare assistance under the following projects: 2003/000-379.04.01, 2003/005-710.04.01, 2002/000-580.02.01, 2003/000379.04.01, 2003/005-710.04.01, 2002/000-580.02.01, 2002/000-580.04.01, 2002/000-605.04.01, 2003/005-710.04.02, 2003/005-710.04.03, 2003/005710.04.04.
The results of the Interim Evaluation of the Phare programmes providing support to the sector are summarised in the following Table: Table 19. Results of evaluations of projects from Agriculture sector
The evaluated projects are in principle highly relevant to the needs of the Agriculture sector related to the final stage of preparation for accession. Wider and immediate objectives, based on the NPAA, AP and NDP are addressing fields of crucial importance for the completion of preparations for the enforcement and practical application of management mechanisms of both CAP and EAGGF. The assistance builds upon the achievements of the previous Phare programmes assisting the sector, e.g. 2002/000-605.04.02 continues activities commenced under PL0006.01 and 2002/000-580.04.03 was designed to complete the gaps in AMAs preparation for its role as paying agency which had been identified by pre-accession advisers employed under the twinning components of Phare 1999 (PL99/IB/AG/01) and Phare 2000 (PL2000/IB/AG/08-B). In general, the efficiency of implementation of the evaluated projects can be described as satisfactory. However, this assessment shown considerable differences in the efficiency of the project implementation. There are projects implemented efficiently (2002/000-580.04.02, 2002/000-580.04.3, 2002/000-580.04.04) and projects which efficiency was extremely low or reduced (PL01.04.08, 2002/000-196.04.01). The overall efficiency is negatively affected by extremely poor efficiency of PL0104.08. Particular causes of low efficiency include: poor capacity, esp. managerial capacity within beneficiaries institutions, delays in start-up and a lack of proper coordination between projects components. The low efficiency of implementing structures led to the cancellation of projects components (2002/000-196.04.01, 2002/000605.04.02) and resulted in the last minute contracting of all projects. The efficiency of implementation is increased thanks to beneficiaries identifying strongly with the projects
Relevance
Efficiency
The IE process is completed. The report (with cut-off date 15 th July 2005) was formally accepted by JE NAC as FV on 13th January 2006.
55
54
The IE report (with cut-off date 9th December 2005) was formally accepted by the JE NAC as FV on 11 th April 2006. Consolidated Evaluation Report No.. CR/PL/06001. 16th May 2006 39
Effectiveness
Impact
Sustainability
objectives and therefore also demonstrating a strong commitment to the project implementation. The overall efficiency has been negatively affected by the delays of the projects commencements. The effectiveness of the evaluated projects is in general satisfactory. Produced results support the achievement of immediate objectives. The overall effectiveness was negatively affected by the low efficiency of implementation (cancellation of projects components of 2002/000-196.04.01, 2002/000-605.04.02). In one case the effectiveness was reduced by the poor performance of the contractor (PL01.04.08). In two cases the effectiveness was negatively affected by cancellation of projects components ((2002/000-196.04.01, 2002/000-605.04.02). In one case the effectiveness was negatively affected by cancellation of projects component (2002/000580.04.01, Component 3, Supply of laboratory equipment and purchase of tests for BSE). In some cases the efficiency was increased by the use of savings (e.g. 2003/005-710.04.01, 2002/000-580.02.01). As implemented projects mostly achieved or are achieving their immediate objectives, which are properly formulated and support achievement of wider objectives of the assistance provided, one may expect a positive impact on the sector. The impact of the project 2002/000-580.04.01 will be reduced due to the cancellation of the large component 3 (Supply of laboratory equipment and purchase of tests for BSE) The impact of the project 2003/005-710.04.04 is uncertain as it strongly depends on the external factors. The results achieved by the projects in most cases should be sustainable. Sustainability is increased by the fact, that institutional solutions developed and implemented within the projects are very relevant for the successful implementation of statutory tasks of the beneficiaries institutions and have already been either tested in practice, or even positively audited. Due to the importance of the smooth and effective implementation of structural funds mechanisms and CAP policies within the sector, the political commitment to maintain what have been achieved is very likely.
th
Overall rating of evaluated projects from the AGR sector

(as on 25 April 2005).
Relevance
Efficiency
Impact
Descriptive rate
Rate explanation
+2
+1
+1
+1
+1
Satisfactory
The assistance is highly relevant to the needs of the sector related to the completion of preparations for accession. Almost all projects build upon the achievements of previous Phare programmes assisting the sector. Projects have been implemented smoothly and according to the Phare rules. The overall efficiency is negatively affected by the last minute contracting and extremely poor efficiency of PL0104.08. The beneficiaries identify themselves strongly with the projects objectives and demonstrate a strong commitment to the project implementation. One may expect widely positive, sustainable, although differentiated impact on the sector.
40

Evaluation of the selected programmes from the monitoring sector Transport and Environment was conducted within the framework of one IE Report conducted under the 2005 AEP: IE/PL/TRA&ENV/0501956 covering: 2002/000-632.07.01 Creation of a Central System of Radiological Monitoring and Radiation Safety of the wierk Nuclear Centre, 2002/000-632.07.02 Reduction of occupational exposure and radioactive waste arising from the operation of the MARIA research reactor through actions taken at the source, 2003/5812.05.01 Upgrading of the heat exchangers and ion exchangers at the MARIA research reactor to reduce the possible radioactive releases into environment, 2003/004-379/01/09 Improvement of the managing structures implementing the Cohesion Fund and ERDF in the transport sector, 2003/005-710.05.02 Continuation of the implementation of the EU Directive 2000/60/EC (Water Framework Directive WFD).
The results of the Interim Evaluation of the Phare programmes providing support to the sector are summarised in the following Table: Table 21. Results of evaluations of projects from Transport and Environment sector
All evaluated projects properly address sectors needs and respond to accession related priorities, and their relevance is very high. Wider and immediate objectives are addressing fields of crucial importance for the environment and transport sectors. Project design related to projects No 2003/004-379/01.09 and 2003/005-710.05.02 reflects NPAA and AP priorities and is in line with the governmental strategy. Nuclear safety projects properly implement the recommendations contained in the Council report on Nuclear safety in the context of Enlargement. In principle, projects are implemented efficiently (except project 2002/000-632.07.02) and project implementation progress is satisfactory and will produce expected results. In the case of twinning within project No 2003/004-379/01.09, co-operation between the beneficiary institutions and three RTAs is very different, depending on the RTA and particular beneficiary. The best results are produced in PKP PLK S.A. Co-operation within project No 2003/005710.05.02 seems to be very efficient and highly satisfactory. Efficiency of project 2002/632.07.02 is just satisfactory because of delays in projects implementation and wrong decisions concerning technical requirements in the tender dossiers.
Relevance
Efficiency
Effectiveness In case of two Phare 2002 projects, the contracting and disbursement periods were extended by 3.0 months. In the case of project 2002/632.07.02 a significant part of Phare funds was not utilised because of unsuccessful tendering procedures for three lots and a lack of time for repeating the procedure. Phare 2003 projects are implemented properly and all of them are contracted. Except project No 2002/632.07.02 the effectiveness of the evaluated projects in general is satisfactory and implementation structures work well and Phare procedures are
The report (with cut-off date 30th December 2005) was formally accepted by JE NAC as FV on 13th April 2006
56
properly used. Implemented projects, with the exception of project No 2002/632.07.02, are expected to achieve their immediate objectives, which are properly formulated and support achievement of wider objectives of the assistance provided and will have positive and expected impact on the environment and transport sectors. In the case of project 2002/632.07.02 the impact will be limited because of significant lose of Phare funds and partial results.
Impact
Sustainability of the evaluated projects, with the exception of project No 2002/632.07.02, is Sustainability expected to be relatively high. In the case of project 2002/632.07.02 only some results will be sustainable because of achieving only a part of the projects goals.
The overall ratings of the implementation of the assistance provided to the sector and covered by the IE processes conducted in the reporting period are presented in the following Table:
Table 22.
th
Overall rating of evaluated projects from the TRA&ENV sector

(as on 25 April 2005).
Relevance
Efficiency
Impact
Descriptive rate
Rate explanation
+2
+1
+1
+1
+1
Satisfactory
Assistance relevant to the needs of Transport and Environment sectors. Projects implemented well and in accordance to Phare rules and regulation, expected to produce planned results which impact will be sustainable. However the overall rating is negatively affected by the performance of project No 2002/632.07.02.
42
Thematic Reports
During the reporting period activities aimed at preparation of six Thematic/ Ad Hoc reports were conducted. By the cut-off date of this Consolidated Report only two of them were at the stage enabling presentation of their findings and conclusions. Three of these reports are covered by Annual Evaluation Plan for 2005 and three by the Annual Evaluation Plan for 2006. The following Thematic/ Ad Hoc reports covered by the 2005 AEP were elaborated during the reporting period: THE/PL/05009, Review of the Polish legislation and legal practice in relation to the public procurement in light of the legal and institutional solutions adopted in other UE Member States; THE/PL/05012, Twinning projects as an instrument preparing for the utilisation of Structural Funds; THE/PL/05015, Implementation of twinning projects financed under the Transition Facility programme. The following Thematic/ Ad Hoc reports covered by the 2006 AEP were elaborated during the reporting period: THE/PL/06003, Impact of Phare infrastructure projects (ESC, CBC, JHA, TRANS and ENV) on regional social and economic cohesion in Poland. Case studies of selected regions; THE/PL/06006, Assessment of the Relevance and Efficiency of structures managing 2004 2005 Transition Facility programme; and THE/PL/06009, Good Practice lessons learnt from Phare in Poland relevant for the programming and implementation of EU assistance to Third Countries covered by the Instrument for Pre-accession Assistance and New Neighbourhood Programme. Out of these Reports only THE/PL/05009 and THE/PL/05015 at the cut-off date of this Consolidated Report have passed the stage of preparation of the draft version of the report. The remaining Thematic/ Ad Hoc reports are at various phases of drafting process (while the first draft of THE/PL/05012 is scheduled to be submitted to JE NAC at the beginning of May 2006, the THE/PL/06009 had the kick-off meeting on 25 th April 2006 and is at a very early stage of preparation). The THE/PL/0500957. Thematic Report reviews the selected elements of the Polish legislation and legal practice in relation to the public procurement and, simultaneously,
57
The report was formally accepted by JE NAC on 20th March 2006. Consolidated Evaluation Report No.. CR/PL/06001. 16th May 2006 43
presents institutional and legal solutions adopted in this respect in selected EU Member States. Analysing selected elements of the Polish national legislation in the field of public procurement the report provided responses to the key evaluation questions. The analysis led to the following conclusions Binding in Poland rules of the Public Procurement Law (PPL) make the head of the awarding entity to be responsible for spending public resources. Regulations on principles for spending EU funded resources being the subject of the PPL regulations, establish responsibility for the appropriate spending of these resources, despite the contract awarding entity, also other subjects participating in implementation of PHARE and ZPORR. Defined by the Manuals of procedures solutions defining relations between the subject obliged to supervise appropriateness of spending of the analysed resources and the contract awarding entity not always base upon the official relationship. Relations between these subjects are regulated by civil-legal agreement relevant for the particular programme. Envisaged under the Polish law responsibility for contravening discipline of public finances does not directly refer to responsibility for non utilised assistance. These regulations do not envisage direct sanctions for not utilised resources. The Act Public Procurement Law does not include rules delegating the Presidents of Office of Public Procurement (UZP) right to control to other entities supervising spending of public resources. Similarly, in the prepared for the UZP Practical Guide on Public Procurement Procedures there are no recommendations for the ex-ante control by other subjects responsible for spending the EU funded resources. Ex-ante controls carried out for particular PHARE programmes by respective PAO and ex-ante controls for ZPORR conducted by Implementing Agencies / Intermediary Institutions played supplementary part for the control carried out by the President of UZP on the basis of the PPL regulations. Entities supervising the Orderers activities do not dispose the legal protection measures envisaged by the PPL for the situation when the Orderer breaches the PPL regulations.
It should be stated that the analysis covered the previous PPL, which was binding when the Thematic/Ad Hoc report was prepared. Recently the Polish Parliament adopted new Public Procurement Law and the analysis presented in this part of the report has reduced its relevance to the Polish legal situation.
44
Comparative analysis of the public procurement systems in the four EU Member States (two Old and two New Member States) was conducted. The analysis covered the legal and institutional systems operational in Germany, United Kingdom, Hungary and Lithuania. Analyse of similarities and differences between systems led to the following major conclusions: In practice, any procurement system contains elements of a decentralised and a centralised approach. A consensus has emerged in recent years in favour of the liberalisation and privatisation of public procurement. In the OMS countries, there has been a long tradition of centralised procurement followed by a gradual liberalisation of these procedures over a fairly extended period. The strengthening of financial control and regulation of procurement procedures, as well as annual audits of private sector suppliers have accompanied this process. Arrangements for the training and staff development of procurement personnel have also improved in recent years as the financial importance to individual countries of good procurement practices has come to be realised. The OMS have benefited from having a developed market sector and many private enterprises and suppliers who can deliver goods and services as needed. With accession NMS are also approaching this situation. Whilst decentralization is sometimes viewed in NMS as an expression of democratization the advantages of varying degrees of concentration require objective evaluation when public money is involved. The appropriate balance of centralisation and decentralisation will depend on many factors including purely logistical and numerical issues, institutional and capacity restraints, specific sectoral market parameters and should be kept under regular review. There are essentially two types of complaints which need to be dealt with - Bona fide (genuine and justified) and malicious or erroneous. In order to optimize the efficiency of PP systems, the former should be reduced as far as possible and the latter should be eliminated. Bona fide challenges and complaints are generally based on allegations of administrative or technical mistakes, corruption or ultra vires. Both administrative and technical mistakes can be remedied by clearly documented procedures, appropriate staff selection and training. Corruption can be remedied by clear and public selection criteria and transparency - essentially key elements of good governance. Ultra vires issue are related to the issues of errors and corruption and should be addressed by dealing with the above. In order to reduce the burden of malicious or erroneous complaints or challenges, it may be appropriate to screen claims at an early stage to assess their validity. There is also the possibility of introducing penalties for unjustified complaints and challenges. The OMS and NMS have different histories of development of the public sector and of PP in particular. This is reflected in the ways in which the sector is regulated and the institutions which operate on the basis of these regulations.(see annex 7 on modern approaches). Comparisons of OMS and NMS are therefore
limited in their relevance as regulation should be conceived to meet the current economic legislative and social needs and based on the prevailing economic legislative and social realties. Whilst ever closer, they are still different. The need for and degree of supervision is directly related to extent of errors and abuse of the system. As errors and abuse of the system are reduced by the above good governance measures, the resources required for supervision may be reduced accordingly, As a matter of principle and for long term sustainable improvement, available resources are more effectively targeted at addressing the prevention (transparency measures and training) rather than at the cure (control functions and sanctions)
Thematic report THE/PL/05015 Implementation of twinning projects financed under the Transition Facility programme58 was dedicated to the Institution Building projects implemented under the Transition Facility instrument and made comparison between the two tools: Phare and Transition Facility programme. It also evaluated the process of implementation of the Transition Facility projects. This evaluation concentrated mostly on Twinning and Twinning Light projects which by the cut-off date were the only ongoing activities under the Transition Facility scheme. Thematic Report focuses on implementation of 2004 and 2005 twinning projects financed under the Transition Facility programme especially on relevance of their objectives to the evolving needs and priorities at both sector and beneficiary level, efficiency of the administrative structures originally designed to implement the Phare programme and now being utilised for the implementation of the Transition Facility funded projects On the whole, the evaluated projects are highly relevant to Polands current needs within the sector. Moreover, at the operational level they correspond well with the operational needs of the main beneficiaries and its mandated bodies. In most of the projects the objectives and the activities have been defined on the basis of research and analysis conducted in the beneficiary institutions. With reference to the majority of projects being under implementation their relevance is verified through gathering the feedback from participants and recipients of the twinning activities e.g. trainings, seminars, expert missions. Taking into consideration quite early stage of the TF 2004 twinnings realisation the efficiency of the implementation and management system can be assessed as satisfactory. The administrative structures of TF programme implementation work properly. The institutions involved into implementation co-operate well. The experience gained by these institutions during the realisation of Phare programme is useful for implementation of the TF funded projects. The operational contacts agreed in the previous years strengthen the co-operation. The formal/ official way of ex-changing information and documents was limited to a large extend and replaced by working relations based cooperation between institutions involved. However the efficiency of project implementation with the Ministry of Finance is limited due to time-consuming and too
58
Draft report was submitted to the JE NAC on 14th April 2006. Consolidated Evaluation Report No.. CR/PL/06001. 16th May 2006 46
official (according to the CFCU and the UKIE staff) way of ex-changing of documentation and information. The co-operation between the CFCU and the twinning beneficiaries is satisfactory. The main element which negatively affects the implementation of the twinning activities is insufficient time devoted by the Polish side (project beneficiaries). Such situation is caused by insufficient number of staff in the beneficiaries institutions. Moreover, the Polish staff is not able to devote to twinning projects activities an appropriate amount of time due to other obligations and duties. On the other hand lack of time and insufficient number of staff in most cases are compensated by great commitment of the Polish side in the twinning. The main financial problem arising at the beginning of the twinning implementation was delayed delivery of TF co-financing. The twinning partners were obliged to use their own budgets to finance the initial activities. During the course of evaluation no large problems with Polish cofinancing were identified. The local financial resources have been provided and are being utilised. Only in one project 2004/016-829.03.03 Natura 2000 the beneficiary did not receive the financing. All the 2004 twinnings for which the covenants have been signed are under implementation. Two covenants will be signed soon. Generally the effectiveness of the implemented projects is satisfactory. The activities are being run according to the schedule and the first mandatory results have been achieved. The majority of twinnings are expected to achieve the majority of the expected immediate objectives. The prognosis for impact and sustainability is generally rather good even considering the fact that the all evaluated twinnings are at an early stage of implementation where our assessment is based more on prediction than hard evidence. The Report concludes that the implementation of the twinning projects under the Transition Facility instrument in Poland progresses well and should be rated as Satisfactory.
Reports of the Short Term Technical Experts

In the course of preparation of the IE reports it was extensively utilized tools of the expertise prepared by a Short Term Technical Expert (STTS) on a specific subject identified during the IE process by either partners of the IE process (NAC services, Implementing Agencies, Beneficiaries) or by the Evaluators. During the reporting period the STTS reports were produced in the course of work on the following reports: 1. For IE/PL/AGR/05010 one report on Readiness of Polish Agricultural; institutions for CAP mechanisms and Structural Funds in Agricultural sector contribution of selected six Phare projects which, although identifying some gaps and presenting recommendations has concluded that assistance delivered through the six Phare projects can be assessed as a success in the field of agricultural Institutional Building. 2. For IE/PL/JHA/05018 one report on The Use of the PHARE Twinning Projects in Updating/Modernising/Changing/Enriching the Training Courses Contents in the
Polish Police, Revising the Training Course System and Career Path for the Polish Police Officers, Starting from the Constable Rank, The Comparison of the Assumptions with the Execution Progressas per the Example of the Police Warsaw Headquarters. The expertise concluded that at the Police KGP and KSP managerial level, the approach to the Police functioning method, present in the twinning projects recommendations, is well-grounded. The execution of the majority of the recommendations concerning the professional career path, training system and content was initiated. However, the progress of this execution varies considerably. The implementation pace seems relatively slow. The report also pointed out that the current management of the information on human resources and training needs in the Police is a serious hindrance for effective use of the effects and experiences gained while executing the twinning projects. 3. For THE/PL/05009 two reports: One report Solutions adopted in Polish regulations on Public Procurement In the context of Phare Programme and Integrated Operational Programme for Regional Development analysed selected elements of the Polish national legislation in the field of public procurement and provided responses to the key evaluation questions. Second report Comparative analysis of public procurement law - Germany, UK, Lithuania and Hungary covered the legal and institutional systems operational in Germany, United Kingdom, Hungary and Lithuania. Analyse of similarities and differences between systems.
48
PERFORMANCE RATINGS
The number of IE reports carried out during the reporting period and large coverage of the reports, enables some provisional statistical analysis, comparing performance ratings for the sectors covered by the evaluation.
First of all it should be stated that the overwhelming majority of sectors and projects within the sectors were positively evaluated and received overall performance rating Satisfactory or higher. Out of six sectors being the subject to the Interim Evaluation process in the reporting period five were rated as Satisfactory, and one (Justice and Home Affairs) received the maximal rate Highly Satisfactory.
For particular projects covered by the IE process the ratings are much more diversified. During the reporting period the IE process covered 69 projects. Out of these projects almost 84% was rated as Satisfactory or higher (see: Table below).
Table 23. Ratings of the projects evaluated within the reporting period. .
Rating Number of project rated Percentage of projects rates
Highly Satisfactory (HS) Satisfactory (S) Just Satisfactory (JS) Unsatisfactory (US) Highly Unsatisfactory (HU) Total
24 34 9 2 0 69
35 49 13 3 0 100
The situation is illustrated in the following diagram:
49
Figure 2. Performance rating of the projects covered by the CR/PL/06001 report.

CR/PL/06001 - performance rating
Highly Satisfactory (HS) Satisfactory (S) Just Satisfactory (JS) Unsatisfactory (US) Highly Unsatisfactory (HU)
When assuming that HS=+2, S=+1, JS=0, U=-1 and HU=-2 (as it is stipulated by the Manual of Interim Evaluation of the Phare Programme in Poland, chapter 3.1.2) we can calculate the average rating for all the projects covered by the IE process in the reporting period. This calculation clearly leads us to the average numeric rating +1,16, what in descriptive terms means rating slightly higher than Satisfactory. This statistical calculation confirms the overall, satisfactory rating for the entire Phare assistance covered by the sectoral IE report. Comparison with the evaluation results presented in the previous Consolidated Report (CR/PL/05002) leads to the conclusion that there is visible small but evident progress in general quality of the implementation of the Phare projects in Poland. Consolidated Report CR/PL/05002 noted 75% of positive ratings and there was one extremely negative note Highly Unsatisfactory. Also average numbering rating shows small progress, as the CR/PL/05002 noted that this average numeric rating was +1. The comparison between CR/PL/06001 and CR/PL/05002 is illustrated by the following diagram:
50
Figure 3. comparicon between performance ratings of projects covered by the current (CR/PL/06001) and previous CR/PL/05002 Consolidated Reports
CR/PL/06001 and CR/PL/05002 - comparison of performance ratings
40 35 30 25 20 15 10 5 0
(S ) (H S) (J S) S) (U U )
CR/PL/065001 - current Consolidated report CR/PL/05002 - previous Consolidated Report
to ry
to ry
or y
to ry
Sa tis fa c
fa ct
fa c
ti s fa c
tS at is
Sa t is
ns a
Ju s
ig h
This high performance rating of the evaluated Phare projects shows that all involved institutions and parties (including beneficiaries) have gathered experience and knowledge that are necessary for proper implementation of Phare programme. This knowledge and know-how if properly and effectively utilised can benefit in the future in more effective and efficient implementation of the other EU funded interventions.
ig h
ly
Un s
ly
at is
fa c
to ry
(H
51
CONCLUSIONS
The assistance provided to the Public Administration sector under the 2002 and 2003 Phare programmes addresses the broad range of sectoral priorities related to EU accession. To some extent, the design of the assistance was based upon the achievements of the previous Phare programmes, and starts in places where the past programmes have stopped. In this sense it constitutes a well-developed and coherent approach to sectoral needs. The objectives of the Phare projects are in line with and support the objectives of the Accession Partnership (AP) and the National Programme for the Adoption of Acquis (NPAA). In general, most projects are being managed properly and in accordance with Phare rules, but at times implementation structures do not work efficiently and effectively, and implementation process is often delayed (particularly in the case of 2003/005-710.01.05, 2003/005-379.01.08, 2003/005-710.01.06). Effectiveness also is reduced by the late commencement of the contracting procedures (2003/004-379/01.07), which meant that not all measures were contracted before the expiry of the contracting period. The majority of the projects are expected to achieve the majority of their objectives, which will have a positive impact on preparing beneficiary institutions to implement and manage structural and cohesion funds. However, in some cases the results of the project are not as useful as they might be if all activities had started according to the schedule (2003/005-379.01.08, 2003/005-710.01.06). Sustainability of the results achieved should be in general satisfactory. The importance of supporting and strengthening NGO sector by 2003/004-379/01.01 project as a partner for Public Administration sector should also be underlined. This project should have positive and sustainable effects.
Economic and Social Cohesion. The assistance provided to the Regional Development sector under the Phare 2001 ESC, Phare 2002 ESC and Phare 2002 ESC programmes addresses the sectors main priorities as laid down by the National Strategy of Regional Development 2001 2006 (NSRD). The objectives of projects implemented are also in line with 2001 Accession Partnership with Poland (APP) in particular with the Economic and Social Cohesion (ESC) priority. The evaluated Phare 2001 ESC, Phare 2002 ESC and Phare 2003 ESC interventions in the Regional Development Sector investments projects constitute a coherent, well structured answer to the above mentioned sector priorities and needs. Projects are managed properly and in accordance with Phare rules. Implementation structures with some exceptions (last minute contracting of Phare
2001 projects) - work efficiently and effectively. Most of the evaluated projects are expected to achieve their objectives and to have positive, expected impact on socioeconomical development of the regions. The results infrastructure objects - will be sustainable. Also, the lessons learned and experience gained will facilitate the successful absorption of Structural Funds by beneficiary institutions. The assistance provided to the SME and HRD development under the 2002 and 2003 programmes addresses the broad range of the sectors main priorities as related to the process of accession and as related to the needs of the target groups. Therefore in general the assistance is highly relevant, although this statement does not reflect the considerable difference between HRD and SMEs projects. For the latter, the relevance (in terms of actual demand from SMEs) was significantly overestimated. The objectives of the Phare projects under the evaluation are in line with and support the objectives of the National Regional Development Strategy, National Human Resources Development Strategy as well as Accession Partnership and the National Programme for the Adoption of Acquis. The Active Labour Market Policies (ALMP) measures proves to be effective in supporting unemployed, however, they will have rather very limited impact on the higher level. The grant schemes proved to be effective way to implement these measures, as usually they are very close to the beneficiaries and are able to shape the program according to their specific situation. To much extend the assistance provided under 2002 and 2003 programmes bases upon the achievements of the previous Phare programmes, in particular using methodologies developed (e.g. Individual Action Plans). Regional and sectoral SME programmes with some modifications practically repeat the schemes developed under the previous Phare projects. The weak point of SMEs programs were the consulting grant components. With one exclusion59 there is very small interest in applying for this kind of support. As a consequence, a significant part of funds initially allocated for consulting grants had to be re-allocated to the investment grants. Unfortunately, not all efforts to re-allocate funds have been successful. For Phare 2003 SME projects, in total 6.1 M of respective allocations remained unused. Projects are managed properly and in accordance with Phare rules. Implementation structures work efficiently and effectively. The cooperation among the stakeholders including the ministries, IA, RIFs, and grant beneficiaries is in general smooth and productive. Also, in many case for grant beneficiaries under HRD projects, the implementation of the project is viewed as a useful exercise preparing to the implementation of other projects financed with ESF funds. Thus, the conclusion is that the overall picture of the intervention is positive with some lessons worth to be remembered. These are in particular related to two issues: the role of NGOs and PLOs in the implementation of ALMP measures and an adequate SMEs needs assessment especially with regard to the consulting grants. Cross-Border Cooperation The assistance provided to the Cross-Border Co-operation sector under the 2002 and 2003 (Poland Germany) programmes addresses the broad range of the sectors main priorities. All these programmes are, to a large extent, based
59
Introduction to quality consulting grants under 2002/000-580.06.05 Consolidated Evaluation Report No.. CR/PL/06001. 16th May 2006 53
upon the achievements of the previous Phare programmes and constitute a welldeveloped and coherent approach to the sectors needs. The objectives of the Phare projects under the evaluation are in line with and support the objectives of the Accession Partnership and the National Programme for the Adoption of Acquis. Projects are managed well and in accordance with Phare rules. Implementation structures work efficiently and effectively, although implementation process is sometime delayed by time-consuming procedures. Most of projects (with exception for 2002/000-606.21) are expected to achieve their objective and are likely to have positive and expected impact on sector performance. Sustainability of results produced should be relatively high; however, sustainability of some activities is depended on continued efforts and stable policy on both sides of the border.
Internal Market
The assistance provided to the Internal Market sector under the 2002 and 2003 projects covered within this interim evaluation report is particularly relevant to sector needs (with the exception of 2003/005-710.01.02). The objectives of the Phare projects under evaluation are in line with and support the objectives of the NPPM and AP, and are coherent with the relevant government strategies. Projects are managed relatively well and in accordance with Phare rules. However, for most of Phare 2003 projects there is a risk that contracting will not be finished within the contracting expiry date. At this stage it is not possible to accurately assess the Phare 2003 projects in terms of their impact and sustainability, however expected impact is satisfactory. The impact and sustainability of the Phare 2002 projects is also satisfactory.
Justice and Home Affaires

Assistance provided to the Justice and Home Affairs sector under 2001, 2002 and 2003 infrastructure projects covered by the interim evaluation process is highly relevant to the sector needs. To a large extent the assistance provided under 2001 and 2002 programmes is based upon the achievements of the previous Phare programmes, and starts in places where the past programmes stopped and constitutes a well developed and coherent approach to the sectors needs (e.g. PL0103.05, 2002/000-580.03.07, 2002/000605.03.02). On the other hand, one project deals with new issues and challenges which have not been covered by previous Phare assistance (2002/000-580.03.04 the Puszcza Biaowieska Euroregion is for the first time implementing an SPF project). The objectives of projects implemented are in line with and support the priorities of the AP and NPPM, and are coherent with the relevant government strategies. Three projects (2002/000-580.03.06, 2002/000-605.03.03, 2003/005-710.03.07) are also in compliance with regional development strategy. Implementation structures work efficiently and effectively, although the implementation process is on occasions delayed by the timeconsuming exchange of documents, complicated procedures and complex relation between various parties involved in the implementation process. Implemented projects
are expected to achieve their objectives and to have positive, expected impact on the sector. The results mostly pieces of infrastructure - will be sustainable. Also, mostly at the regional and local level of beneficiaries, the lessons learned and experience gained prepared them well for successful absorption of the Structural Funds. The assistance provided to the Justice and Home Affairs sector under the 2002 and 2003 Phare Institution Building projects addresses the broad range of sectoral priorities related to EU accession. To some extent, the design of the assistance was based upon the achievements of previous Phare programmes, and starts in places where the past programmes have stopped. In this sense, it constitutes a well developed and coherent approach to sectoral needs. The objectives of the Phare projects are in line with, and support the objectives of, the Accession Partnership and the National Programme for the Adoption of Acquis. All projects are being managed properly and in accordance with Phare rules and implementation structures work efficiently and effectively in almost all cases. The majority of evaluated projects has already achieved or is expected to achieve their objectives, which will have a positive impact on preparing beneficiary institutions to work in line with the EU standards and requirements. Sustainability of the results should be highly satisfactory. Some of the evaluated projects can be identified as good practice in the project implementation process (2002/000-580.03.01, 2003/005-710.03.01, 2003/005-710.03.06).
Agriculture
The assistance provided to the Agriculture sector under Phare 2001 and 2002 programmes addresses the sectors main priorities as related to the process of accession. All the evaluated projects are based upon the achievements of the previous Phare programmes, and starts in places where the past programmes stopped and constitutes a well developed and coherent approach to the sectors needs. The objectives of the Phare projects under the evaluation are in line with and support the objectives of the Accession Partnership and the National Programme for the Adoption of Acquis. Projects are managed in accordance with Phare rules and - with some exceptions (PL0104.08 lack of personal continuity in the project management) - properly. In general implementation structures work efficiently and effectively, although the implementation process has been significantly delayed by the time-consuming preparation of twinning covenant (PL0104.08)60 or long process of modification of the PF and preparation of tender documentation and related exchange of documents (2002/000-196.04.01). In general implementation structures work efficiently and effectively, although the implementation process has been delayed by late contracting and the need to coordinate with preceding projects, which are delayed, (e.g. 2003/005-710.04.05, 2003/005-710.04.06) Most of the evaluated projects have achieved or are on the way to achieve fully their immediate objectives and are likely to have a positive impact on the sectors performance. For other three projects the achievement of all immediate objectives is seriously threatened,
60
In the phase of preparation of the Twinning Covenant the implementation of this project was temporarily suspended by the EC what temporarily frozen all the activities. Obviously, this contributed to the delay. Consolidated Evaluation Report No.. CR/PL/06001. 16th May 2006 55
delayed and/or limited in the scope (PL0104.08, 2002/000-196.04.01, PL2002/000605.04.02). Accordingly, the impact of these projects will be limited. The overall impact of all evaluated projects on the sector performance is therefore expected to be satisfactory. Sustainability of results produced should be satisfactory, however, it is depended on commitment of the Polish authorities to provide the required financial resources and to limit turnover of highly trained staff. Also, in one case (2003/005710.04.04) sustainability manifestly depends on the continuation of activities and on the factor s which are beyond the influence of the Polish veterinary services. Although the overall picture of the evaluated intervention could be assessed as a positive one, it should be however stressed, that this assessment masks significant differences in the performance of evaluated projects: from ones performing very well and likely to have a positive impact on the sector, to the ones poorly performing with limited impact expected. Also, the loose of 7.7M under 2002/000-580.04.01 slightly negatively affects this picture.

The assistance provided to the environment and transport sectors under the 2002 and 2003 programmes addresses the broad range of the sectors main priorities. Project No 2003/005-710.05.02 is based upon the achievements of the previous Phare programmes (especially project No 2002/IB/EN/01) and constitute a well-developed and coherent approach to the sectors needs. The objectives of the Phare projects 2003/004-379/01.09 and 2003/005-710.05.02 are in line with and support the objectives of the Accession Partnership and the National Programme for the Adoption of Acquis. Nuclear Safety projects properly implement the recommendations contained in the Council report on Nuclear safety in the context of Enlargement. Projects are managed well (except project 2002/632.07.02) and in accordance with Phare rules. Implementation structures work efficiently and effectively (except project 2002/632.07.02), although implementation process is sometime delayed by time-consuming procedures. All the projects (except project 2002/632.07.02) are expected to achieve their objective and are likely to have positive and expected impact on the sectors performance. Sustainability of results produced should be satisfactory or just satisfactory (in the case of project 2002/632.07.02)
56
RECOMMENDATIONS
Recommendations presented in particular IE reports.
In this Consolidated Report the recommendations addressing evaluated sectors are presented in a form of a Table with clear indication of: (a) the sector and project addressed, (b) the relevant problem, (c) the recommendation in a form in which it was presented in a Table of Recommendations accompanying the particular IE report, and (d) deadline for implementation. Here are presented only those recommendations which, within the sector, address issues having wider more horizontal dimension and refer to the programme level. It should be remembered that the below table presents only recommendations from the IE reports which at the cut-off date were at the stage after the working meeting on the draft table of recommendation. The working meeting is being organised after the Evaluators received and introduced comments on the draft version of the IE report and before the draft Final Version of the IE report is submitted to the Evaluation Unit of the NAC services. Implementation of the recommendations presented by the sectoral Interim Evaluation reports is being monitored by the Evaluation Unit of NAC services which collects the relevant information about the recommendations implementation status and presents this information during the semi-annual Sectoral Monitoring Sub-Committees meetings. The most recent information was presented during the SMSC meetings in March 2006 and is available in the minutes of these meetings.
57
Table 24. Recommendations presented in the IE reports covered by the CR/PL/06001 Sector/ sub-sector Project code (IE report number)
2002/000-605.03.01 2003/005-710.03.02 Future external EU border Migration and asylum 2002/000-580.03.03 Sea border protection system investment policy
Identified problem and conclusion
Recommendation and expected result
Deadline for implementation
(IE/PL/JHA/05008) JHA
Problem 1: The President of the Public Procurement Office decided that the signing of the Contracts was not in accordance with the tender procedure and therefore started legal action. The Border Guard, as defendant, applied to the court to dismiss the entire case. Problem 2: the blocking of financing from Phare sources by the NAO Therefore:
There is a risk that the projects will not be implemented due to lack of financing as well as too short period of time for the realisation of contracts
The Beneficiary, PAO, NAC and IA CBC should organise a meeting in order to find the most efficient and effective solution to the problem. Inviting the Contractor should also be considered. The officials in PAO, NAO and IA CBC responsible for legal aspects of the projects should organise a meeting to decide if and how soon the Phare financing of the contracts can be provided (taking into consideration all legal regulations). Moreover, alternative sources of financing of the contracts should be considered. Remark: in order to assure effective implementation of projects 2002/000-580.03.03 and 2003/005-710.03.02.01it is necessary to: - assure financial resources for their realization; - extend the period of the Contracts realisation In order to:
(I)
End of 2005
Solution of the described problem

On 9th of February 2005 the Beneficiary officially sent to IA CBC a list of corrected The IA CBC should reply to the Beneficiarys letter or organise Indicators of Achievement (IoAs). However a meeting with the Beneficiary in order to establish proper IoAs. there was no response from the IA CBC. . Therefore: In order to: There is a risk that the new IoAs will not be Solution of the described problem taken into account during assessment of the achievements of the project
(I)
End of December 2005
58
2003/004-379.03.01 Migration 2002/000-605.0303 Construction of and asylum infrastructure Grzechotki-Mamonowo. crossing
(I)
A meeting of the Beneficiary, PAO and IA CBC should be Works on the building site cannot be continued organised in order to discuss possible solutions and new during winter. schedule of works using alternative technologies. In addition consideration should be given to extending the Therefore: disbursement period. End of February 2006 There is a risk that the project will not be completed in due time (completion originally In order to: planned for 14th of January 2006) Punctual termination of all activities related to the project. Achieving all expected results.
(I)
Only two of six deliveries will be realized (no valid offers were received for the four remaining deliveries). Therefore: There is a risk that not all goals of the project will be achieved.
The Beneficiary should present to PAO the way of achieving the goals of the project. In order to: Solution of the described problem End of 2005
59
2003/005-710.03.07 2002/000-580.03.07 Fight against crime Fight against crime IV III
(I)
The Beneficiary is not sufficiently prepared for implementation of the projects according to A meeting should be organised with the Beneficiary and the IA CBC in order to explain all doubts of the Beneficiary related to EDIS procedures. EDIS regulations. Therefore: In order to: There is a risk that co-operation between the Solution of the described problem Beneficiary and the IA CBC will be hampered.
End of 2005
IE/PL/AGR/05010 AGR (II) REG ESC (III)
The poor performance of the Contractor and difficulty in mobilizing him results in the significant decrease of the effectiveness of the implementation. Efforts of the Contracting All evaluated party to mobilize the Contractor did not bring projects the desired effects. Therefore:
In a case of large and technically complicated projects the highest attention should be paid to secure the position of he Contracting party. This includes the appropriate formulation of the contract, including, effective and well defined severe penalty system, contractually defined formal, administrative and technical demands, etc. Whenever it is necessary experienced lawyers should be consulted.
Permanently valid
In order to: The Contracting party does not have legal tools Stronger position of the Contracting party against the Contractor, strong enough to mobilize the Contractor. the interest of the beneficiary better secured. All evaluated The lack of financial liquidity significantly projects affects the implementation of Phare projects. Delayed payments create difficulties in the relations with contractors. In such cases there is a permanent risk that beneficiaries could be sued for penalty interests. Among the sources of the problem there is time which passes between the trigger point is achieved and the day when funds inflow the special account in the MF, during which the process of verification of the application takes place. The limit of time for the verification of the request for funds by EC services should be proposed,, which on the one hand will provide reasonable time for EC services to do the job, and on the other hand will make the time predictable In order to: The verification of the application will be a process limited in time, what will facilitate the financial planning, and the threat of loosing financial liquidity should be reduced. First quarter of 2006
60
The guidlines specifying the scope and level of details for the information attached to the request for funds, complying with EC demands, should be developed and distributed among all PAOs. In order to: Potentially, the process of asking for clarifications, answering etc. may be freely The information provided to EC services will be unified, EC demands will be met, less reservations and requests for long. clarification might be expected. Therefore: The routine practice to share with all the stakeholders and NAC The time used for the verification of the the information on the actual status, especially on potential application for the transfer of funds should be delays of the request for funds should be developed and limited. implemented. In order to: The knowledge on the actual status of the request for payments will facilitate the process of the financial planning. IE/PL/CBC/05014 REG CBC (IV) Procedures for the final beneficiaries regulating projects implementation and monitoring are complicated. Some beneficiaries have difficulties with understanding and implementing these procedures. Therefore: It is suggested that the Implementing Agencies will provide the final beneficiaries with the needed assistance (if necessary, also organising training sessions). It is recommended that every beneficiary should be informed about the place (WWW side, contact person with the relevant telephone number, etc.) where he can find all necessary information presented in easily understandable form. End of the first quarter 2006 IE/PL/REG/05013
General remark
Wrong implementation of binding procedures In order to: can result in problems with final closure and Efficient project implementation by the final beneficiaries and approval of the project. reduced problems with final closure and approval of projects.
61
IE/PL/CBC/05014 REG CBC (IV)
General remark
Implementation of most of the 2002 evaluated programmes suffered from delayed due payments to the contractors. That partially reflected problems with the cash-flow between the EU Commission and the National Fund and newly introduced system of advanced payments. Therefore:
It is suggested that the NAO will present the problem to the relevant Polish governmental authorities and the EU Commission Services able to take the binding decisions in this respect. The information about the action taken in this respect by NAO and its results should be presented during the next JMC meeting. In order to:
Spring 2006 JMC meeting
Without the smooth cash-flow it would be very Reduced risk to the financial liquidity of projects difficult to avoid these problems in the future. Only three persons work at the Department responsible for implementation Phare and Transition Facility projects. This is not enough. 2003/004-379/01.10 Strengthening the consumer protection policy Therefore: There will be a problem to keep a high quality of project implementation (as it is now) over the medium and long term. Excessive workloads significantly influence employees of the Department. This condition could also negatively affect the quality of the projects implementation. The risk of incorrect absorption of EU funds will appear. It could limit possibility of the OCCP operation as well as other projects beneficiaries (Trade Inspection and consumer NGOs). The number of employees at the Department should be increased either though external recruitment or internal transfer of workers within the institution. In particular, attempts to recruit outside the institution should be renewed. In order to: Maintaining a high quality of projects implementation without work overload.
IE/PL/INT/05017 INT (V)
31st July 2006
62
IE/PL/INT/05017 INT (V) IE/PL/INT/05017 INT (V)
Transition Facility training projects for which contracts are not signed yet. All Phare and Transition Facility projects under implementatio n, which include contracts for training
(I) (II) (III) (IV) (V)
The information included on the lists of participants is insufficient to contact To ensure completion Terms of References by detailed participants after the training has finished. information concerns content of lists of participants (at least: participants name and surname, name of company/institution, Therefore: telephone number and address of company/ institution). Lack of telephone numbers and addresses of participants of the training makes it difficult to In order to: carry out evaluation research after the project Possibility of carry out evaluation research among all had finished (e.g. to examine impact and participants of the training after the project has finished. sustainability of the training) The information included on the lists of participants is insufficient to contact To send letter to Beneficiary of projects to draw their attention to participants after the training has finished. obtain from the Contractor necessary information about Therefore: participants of trainings. Lack of telephone numbers and addresses of In order to: participants of the training makes it difficult to Possibility of carry out evaluation research among all carry out evaluation research after the project participants of the training after the project has finished. had finished (e.g. to examine impact and sustainability of the training)
30th of April 2006
28th February 2006
the final version of the IE/PL/JHA/05008 report, after the debriefing meeting, had been distributed on 21st January 2006; the final version of the IE/PL/AGR/05010 report, after the debriefing meeting, had been distributed on 7th February 2006; the final version of the IE/PL/REG/05013 report, after the debriefing meeting, had been distributed on 1st March 2006; the final version of the IE/PL/CBC/05014 report, after the debriefing meeting, had been distributed on 1st March 2006; the final version of the IE/PL/INT/05017 report, after the debriefing meeting, had been distributed on 1st March 2006;
63
ANNEXES
(not taken into account remarks of NAC Evaluation Unit concerning the Consolidated Evaluation Report)
64
65

Consolidated Report CR PL 0601

Caricato da

Informazioni sul documento

Titolo originale

Copyright

Formati disponibili

Condividi questo documento

Condividi o incorpora il documento

Opzioni di condivisione

Hai trovato utile questo documento?

Questo contenuto è inappropriato?

Copyright:

Formati disponibili

Consolidated Report CR PL 0601

Caricato da

Copyright:

Formati disponibili

Consolidated Report No.

Author: ECOTEC Consortium Date: 16th May 2006

Consolidated Evaluation Report No.. CR/PL/06001. 16th May 2006

The author of the Report is Mr Tomasz Skierniewski.

Consolidated Evaluation Report No.. CR/PL/06001. 16th May 2006

REG S SF SIPF SME SMSC SPF TF TRA UKIE

Consolidated Evaluation Report No.. CR/PL/06001. 16th May 2006

Consolidated Evaluation Report No.. CR/PL/06001. 16th May 2006

Economic and Social Cohesion

Justice and Home Affairs

Consolidated Evaluation Report No.. CR/PL/06001. 16th May 2006

Transport and Environment

Report IE/PL/TRA&ENV/05019 IE/PL/PAD/06002

Public Administration Development

Consolidated Evaluation Report No.. CR/PL/06001. 16th May 2006

Economic and Social Cohesion

IE/PL/INT/06004 Report IE/PL/JHA/06005 IE/PL/AGR/06008

PL2003/004-379/03.01 Migration and asylum system infrastructure development

Justice and Home Affairs

Consolidated Evaluation Report No.. CR/PL/06001. 16th May 2006

Sectoral evaluation results

Public Administration Development

Consolidated Evaluation Report No.. CR/PL/06001. 16th May 2006

Justice and Home Affairs

Consolidated Evaluation Report No.. CR/PL/06001. 16th May 2006

Transport and Environment

Consolidated Evaluation Report No.. CR/PL/06001. 16th May 2006

Consolidated Evaluation Report No.. CR/PL/06001. 16th May 2006

Progress of implementation of the 2005 and 2006 Annual Evaluation Plans

122 223 224 325 226

Regional Development Summary sectoral report (PAD)

327 228 129 230 18

Thematic/Ad Hoc reports Total

131 132 134 236 238 240 242 543 16 1

0 133 135 237 139 141 0 344 9 0

Consolidated Evaluation Report No.. CR/PL/06001. 16th May 2006

Table 8. Dispersion of dissenting views by their subject.

Subject of dissenting view

Figure 1. Dispersion of dissenting views by their subject

Consolidated Evaluation Report No.. CR/PL/06001. 16th May 2006

Total for the Sector:

Consolidated Evaluation Report No.. CR/PL/06001. 16th May 2006

Consolidated Evaluation Report No.. CR/PL/06001. 16th May 2006

(as on 25th April 2005)

Total for the sector

Consolidated Evaluation Report No.. CR/PL/06001. 16th May 2006

Overall rating of evaluated projects from the REG/CBC sector

(as on 25 April 2005)

Total for the +2 +1 +1 +1 +2 sector

Results of evaluations of projects from Internal Market sector

Overall rating of evaluated projects from the INT sector

(as on 25 April 2005)

Total for the +1 +1 +1 +1 +1 sector

Consolidated Evaluation Report No.. CR/PL/06001. 16th May 2006

Justice and Home Affairs

Overall rating of evaluated projects from the JHA sector

(as on 25 April 2005)

Total for the +2 +2 +2 +2 +2 sector

Consolidated Evaluation Report No.. CR/PL/06001. 16th May 2006

Overall rating of evaluated projects from the AGR sector

(as on 25 April 2005).

Total for the sector

Consolidated Evaluation Report No.. CR/PL/06001. 16th May 2006