|1. Project Data:
ICR Review Date Posted:
|Education Quality Improvement Program (eqip) Phase 2
Project Costs(US $M)
Loan/Credit (US $M)
Sector, Major Sect.:
|ED: Central government administration, Sub-national government administration, Primary education, Secondary education
Cofinancing (US $M)
|Education for the knowledge economy (50% - P)
Education for all (50% - P)
Board Approval (FY)
||ICR Review Coordinator:
|Judith Hahn Gaubatz
||George T. K. Pitman
||IEG ICR Review 1
|2. Project Objectives and Components:|
a. Objectives:The project was the second part of a two-phase Adaptable Program Loan (APL, 2001-2007), whose overall purpose (according to the Project Appraisal Document (PAD, page 3) was to support the Government's objectives to achieve near-universal completion of basic education, provide a greater number of students (from a wider range of backgrounds) with opportunities for post-basic education, and modernize the sector to improve the quality and efficiency of outputs.
According to the PAD (page 3), the objectives of this second-phase project were (i) to promote excellence in teaching and learning throughout the school sector, while (ii) continuing the push for equity by ensuring the inclusion of all children at all levels of the basic education system.
According to the Loan Agreement (LA, page 13), the objective of the project was to reinforce the process of reforming the education sector through (i) promoting excellence in teaching and learning in an improved pedagogical and physical environment; and (ii) ensuring that all children are provided with equitable and adequate opportunities to access quality education at all levels of the school system.
As the LA statement of objectives is more specific, it is used as the basis for this review.
b. Were the project objectives/key associated outcome targets revised during implementation?
c. Components (or Key Conditions in the case if Adjustment Loans):(Note: The actual project costs by component were not available. According to the project team, these figures were not tracked.)
1. Inclusive Basic Education (Appraisal: US$32.1 million; Actual: not available): This component aimed to improve the quality of education through introducing a new skills-based teaching methodology (Approche par competence - APC), modernizing the teaching of languages and science, and introducing an optional studies program. It also aimed to integrate and mainstream vulnerable children into regular schools and to enhance the quality of teaching in low-performing schools. Activities included developing new curricula and teaching materials, developing a learning assessment system, expanding the Priority Schools Program (PEPE) which addressed the needs of low-performing schools, implementing a program to integrated disabled children, and providing equipment and training,
2. Diversity in Secondary Education (Appraisal: US$5.0 million; Actual: not available): This component aimed to expand the options in secondary education to meet the needs of an increasingly diverse student population and to provide access to information regarding career paths and education programs. Activities included developing curricula and teaching materials for technology programs, evaluating the use of science and technology materials, establishing an Information and Guidance Center, and providing teacher training.
3. School Sector Management (Appraisal: US$5.2 million; Actual: not available): This component aimed to decentralize and modernize the school management system. Activities included establishing school improvement programs, developing a management information and communication technology (ICT) system, and providing training for users.
4. Strengthening Core Systems (Appraisal: US$218.2 million; Actual: not available): This component aimed to develop a strategy to restructure teacher training, integrate ICT in the learning experience, and ensure regular assessment of learning achievement. Activities included developing an in-service teacher training system, a communications strategy on the main themes of school reform, and ICT guidelines for teachers and schools.
d. Comments on Project Cost, Financing, Borrower Contribution, and Dates
Project cost and financing:
- Additional resources became available due to the appreciation in the exchange rate. It was agreed to use the extra resources to increase the number of schools to be rehabilitated.
- Funds were reallocated on two occasions to support scaling up of the ICT program and the equipping of language labs. As the reallocations involved more than five percent of project costs, Project Papers were prepared and subsequently approved by the Regional Vice-President (RVP).
- The ICR does not provide actual project costs by component, only loan costs..
- The Borrower provided US$82.8 million out of the planned US$160.6 million, or 51.6%. The ICR does not provide a reason for the shortfall.
- The closing date was extended from June 2008 to June 2009 to allow for the completion of activities which had experienced implementation delays, as well as those that were added due to the favorable exchange rate.
- The closing date was extended a second time from June 2009 to June 2010 to allow for the completion of several large procurements, which had experienced delays.
|3. Relevance of Objectives & Design:|
Objectives: High. The project objectives were highly relevant to the government's education reform priorities, including improving learning outcomes for vulnerable children, increasing the diversity of secondary education opportunities, and adapting the school system to the needs of the economy. The two-phase APL was intended as a key instrument for implementation of this reform agenda, and the continuing focus on these priorities in yet another follow-up Bank project further points to their high level of relevance. The Country Partnership Strategy for FY2010-2013 emphasizes results in the policy areas of improving employability and achieving the Millennium Development Goals (MDGs) in Education (increasing the primary completion rate and improving the quality of education).
Design: Modest. The project aimed to further the achievements of the first phase of the APL program, which focused on improving the quality of basic education, by improving teaching methodology, ensuring access, and diversifying the curriculum. The choice of an APL was appropriate given the government's fiscal constraints balanced against the need for major investment at the secondary education level.
However, while project activities were likely to contribute to the ultimate outcomes of increased enrollment and completion rates, intermediate outcomes that were more directly linked to the project's outputs should have been identified. In addition, the institutional arrangements were complex and called for "a wide range of actors and institutions within the education system to work in a collaborative and coordinated way which was not, and is still not, a practice observed in the Tunisian context" (ICR, page 11).
|4. Achievement of Objectives (Efficacy) :|
Objective: To Reinforce the Process of Reforming the Education Sector through promotion of excellence in teaching and learning in an improved pedagogical and physical environment and, ensuring all children are provided with equitable and adequate opportunities to access quality education. Substantial
The education reform agenda included the following: extending improvements of learning outcomes to the most vulnerable children; responding to the increasing diversity of the secondary education population by widening the range of opportunities; enabling the secondary school system to adapt to the needs of the economy; and taking advantage of the "lull" in the size of the lower basic education population to focus resources in cost-effective ways.
The project objective was to be achieved through the following two means:
Promoting Excellence in Teaching and Learning in an Improved Pedagogical and Physical Environment
- 1,000 trainers, 800 principals, and 42,542 teachers were trained on APC methodology. No targets or coverage levels provided.
- Creation of an Information and Guidance Center to facilitate career counseling and guidance services. The Center provided a database on alternative and available options regarding university study opportunities and technical and vocational training. 1,016 teachers received training on using the Center's service.
- Renovation of over 1,100 schools and 200 classrooms to increase infrastructure capacity (i.e. science and technology classrooms, laboratories, and boarding facilities). No target provided.
- Operationalization of education management ICT system in all schools, including training of 2,236 users and 1,049 technical staff. No target provided.
- The school improvement and school council programs were not, according to the ICR (page 32), implemented as widely as planned (the ICR does not indicate the extent to which these activities were implemented) , This was in part due to lack of support from teacher unions, as well as the political and cultural context in the country which made promotion of school autonomy difficult as an overall education policy goal.
- A communication strategy covering the main themes of school reform was not carried out.
Note: The baseline year reported is 2003/04, and final year is 2009/10.
- The completion rate for boys in basic education increased from 42.5% to 51.0%, surpassing the target of 48.0%.
- The completion rate for girls in basic education increased from 60.1% to 69.0%, falling slightly short of the target of 69.5%.
- The completion rate for boys in secondary education increased from 42.9% to 45.3%, falling short of the target of 54.3%. The ICR (page 18) notes that changes in the baccalaureate exam may have accounted for the changes in the indicator and that there remained "high repetition and drop-out rates among boys" despite progress in terms of absolute numbers and percentage of completers.
- The completion rate for girls in secondary education increased from 45.5% to 60.6%, falling short of the target of 67.9%. See above comment on the effect of changes in the baccalaureateexam.
- Improved scores in 2007 TIMSS, 2006 PISA, and 2009 PISA international student assessment exams. While the actual data is not cited in the ICR, the project team noted that the data was published by OECD.
- The share of non-salary expenditures at first stage of basic education increased from 2.5% to 3.2%, surpassing the target of 2.5%.
- The share of non-salary expenditures at second stage of basic education and secondary education decreased from 6.4% to 4.5%, falling short of the target of 6.4%. However, unit costs for secondary education increased in real terms by 57%, which the ICR (p. 19) suggests may be a reflection of the policy goal to invest in improving quality. The ICR also (page 18) reports that there was a significant change in the student/teacher ratio, which went from 20.4 to 13.4, resulting in an increase in the salary mass and therefore its relative share in the budget. It also notes that the results of this indicator may also have been due to the prevailing practice of categorizing as "investment" the expenditures on ICT equipment and some teaching and learning materials.
- The ratio of students per computer at first stage of basic education improved from 129 to 23, surpassing the target of 36.
- The ratio of students per computer at second stage of basic education improved from 99 to 23, surpassing the target of 69.
- The ratio of students per computer at secondary education improved from 45 to 19, falling short of the target of 15.
Ensuring that All Children are Provided with Equitable and Adequate Opportunities to Access Quality Education, which included increased access in low-income areas and for children with special needs.
- Expansion of the PEPE school program to 557 primary schools and 101 lower secondary schools, and expanding the number of beneficiary students from 7,667 in 2001 to 157,806 students at project closing. No targets provided. The program provided funding for school improvements, training for school staff, increased school hours, social support to children with special needs, generalization of canteens, and monitoring and evaluation by the coordination unit of the PEPE program.
- Rehabilitation and equipping of kindergartens serving 1450 children from low-income areas. No targets provided.
- Completion of program for integration of children with disabilities in 336 schools, covering 1219 children. No targets provided. The program included extensive training for teachers and school leaders, as well as dissemination of guidelines on integrating children with disabilities and rehabilitation of facilities to enable access.
Note: The baseline year reported is 2003/04, and final year is 2009/10.
- The enrollment rate for boys aged 6-11 years old increased from 96.8% to 97.9%, surpassing the target of 97.2%.
- The enrollment rate for girls aged 6-11 years old increased from 97.0% to 98.5%, surpassing the target of 97.5%.
- The enrollment rate for boys aged 6-16 years old increased from 90.0% to 91.3%, surpassing the target of 90.6%
- The enrollment rate for girls aged 6-16 years old increased from 91.0% to 92.8%, surpassing the target of 91.6%.
- The enrollment rate for boys aged 12-18 years old increased from 73.5% to 74.7%, surpassing the target of 74.4%.
- The enrollment rate for girls aged 12-18 years old increased from 77.5% to 81.4%, surpassing the target of 78.4%.
|5. Efficiency (not applicable to DPLs):|
Efficiency: Modest, due to lack of information in the ICR on cost-effectiveness and the efficient use of project resources. In addition, project implementation experienced considerable delays.
The PAD included a fiscal analysis of government spending on primary vs. secondary education because the demographic trends indicated that the population eligible for primary education was expected to decline, and expected to increase for secondary education. Fiscal efficiency was not expected to improve significantly, as the demographic changes were viewed as an opportunity to invest in improving quality, rather than to simply decrease costs. There was no economic analysis conducted.
Over the course of the project period, more schools were rehabilitated than originally planned; however, the ICR reports (para. 35) that "it became clear that additional resources in Tunisian Dinars would be available due to appreciation in the exchange rate of the Euro against the local currency. It was thus agreed to use the extra resources to increase the number of buildings in primary and secondary schools to be rehabilitated." This indicates that the increase in number of schools was more due to the injection of additional funds from favorable changes in the exchange rate, rather than efficiencies in project implementation.
a. If available, enter the Economic Rate of Return (ERR)/Financial Rate of Return at appraisal and the re-estimated value at evaluation:
* Refers to percent of total project cost for which ERR/FRR was calculated