|1. Project Data:
ICR Review Date Posted:
|Health Sector Development Project
Project Costs(US $M)
Loan/Credit (US $M)
|Health, Nutrition and Population
Cofinancing (US $M)
Board Approval Date
|Health (80%), Central government administration (15%), Compulsory health finance (5%)|
|Rural services and infrastructure (29% - P)
Health system performance (29% - P)
Population and reproductive health (14% - S)
Child health (14% - S)
Law reform (14% - S)|
||ICR Review Coordinator:
|Judith Hahn Gaubatz
||Judyth L. Twigg
|2. Project Objectives and Components:|
According to the Project Appraisal Document (PAD, page 2) and the Development Credit Agreement (DCA, page 14), the objective of the project was:
- To improve the coverage and utilization of quality primary health care based on the model of family medicine/general practice, with an emphasis on reaching the poor and disadvantaged.
The project objective was revised in May 2009, according to the Project Paper (page 5), as follows:
- To improve coverage, utilization, and quality of health care services in the territory of the Recipient; and
- To strengthen the government's stewardship functions in the health sector.
The project name was also changed to the "Health Sector Development Project" to reflect the broader scope of the project.
b. Were the project objectives/key associated outcome targets revised during implementation?
If yes, did the Board approve the revised objectives/key associated outcome targets?
Date of Board Approval: 05/20/2009
1. Primary Health Care Service Delivery (Appraisal: US$16.2 million; Actual: n/a): This component was to support the development of primary health care (PHC) services in rural and urban areas through rehabilitation and equipping of clinics. It was to be implemented in two phases: Phase I would focus on upgrading PHC clinics in up to 74 rural and high mountain areas of the Imereti region; Phase II would expand support to PHC clinics in urban areas and other rural areas, provided that adequate progress was made in Phase I. Activities were to include: rehabilitation of PHC clinics and referral laboratories; provision of diagnostic and medical equipment; a pilot program to test the referral network for maternal and child health services through the Kutaisi Maternal and Child Health Center; and information and education campaigns to increase public awareness of family medicine and PHC services.
2. Institutional Development (Appraisal: US$7.1 million; Actual: n/a ): This component was to support capacity building in medical training and health care management; as well as development of a policy framework and regulatory environment for primary health care (PHC). Activities were to include: rehabilitation of five Regional Family Medicine Training Centers; equipping of facilities for family medicine faculty and a residency program; stipends for doctors and nurses participating in family medicine re-training programs; support to the Ministry of Labor, Health and Social Affairs (MOHLSA) for planning and regulating PHC services, including developing a master plan for PHC clinics; strengthening the health management information system; and establishing of a Health Policy Unit, which would address health care financing issues.
3. Project Management Support (Appraisal: US$1.5 million; Actual: n/a): This component was to support the operations of a project management unit, called the Health and Social Project Implementation Center. This unit was to be established as a legally independent entity within the Ministry of Labor, Health and Social Affairs, with clearly defined project management functions (i.e. procurement, M&E).
The objectives and activities of the project components remained essentially the same in the restructured project, although allocations were revised and some of the activities were shifted among the components. (Note: The ICR reports the actual costs per component for the Credit only, not for the total project including the counterpart amounts.)
1. Strengthening PHC System (Revised: US$17.8 million; Actual: US$11.2 million): Information and education campaigns were to be shifted to Component 2, as part of efforts to increase public awareness about the government's overall health sector reform program. The pilot program to test the maternal and child health referral network was to be shifted to another donor.
2. Support for Health Sector Reform (Revised: US$4.1 million; Actual: US$11.2 million): Support for capacity building in the Ministry of Labor, Health and Social Affairs was to be increased, including a stronger focus on monitoring and evaluating sector performance, and developing national health accounts. Training of medical personnel on PHC services was to be shifted to Component 1.
3. Project Management (Revised: US$1.6 million; Actual: US$1.9 million): No significant changes.
d. Comments on Project Cost, Financing, Borrower Contribution, and Dates
- The original project cost was appraised at US$24.8 million. Under the project restructuring, the appraised project cost revised to US$28.0 million, due to exchange rate fluctuations. The actual project cost was US$26.9 million.
- Costs for Component 1 (PHC service delivery) were significantly lower than appraised due to a shift in government policy to privatize PHC clinics. Costs for Component 2 (Institutional development) increased significantly due to the strengthened project focus on capacity building in the Ministry of Labor, Health and Social Affairs.
- The project was originally financed by a Credit of US$20.34 million. Under the project restructuring, the appraised Credit amount was revised to US$23.5 million, due to exchange rate fluctuations. The actual Credit disbursed was US$24.28 million.
- The planned borrower contribution (for both the original and restructured project) was US$4.5 million. Counterpart funds were provided in full and in a timely manner.
- In March 2009, the project was formally restructured in its title, objectives, results framework, and components, with the project closing date extended to December 2010.
- The original project closing date of December 2007 was extended on four occasions to December 2009, December 2010, December 2011, and June 2012. The extensions were granted to allow completion of activities.
|3. Relevance of Objectives & Design:|
a. Relevance of Objectives:
The country's health system was largely based on the Soviet system, which consisted of a large number of hospital facilities and specialized health personnel, with low emphasis on preventive and primary health care services. There were sharp declines in public expenditures on health (from 13.2% of total public expenditures in 1991 to 0.54% in 1994) and inefficiencies in the existing health system (as reflected by the above-mentioned emphasis on hospital-based care, as well as the high proportion of private out-of-pocket payments (73.0% in 2000)). Therefore, the original project objectives focused on re-orienting the health system towards primary health care and addressing inefficiencies in public expenditures on health. The Bank's current Country Partnership Strategy (FY10-13) includes improved health coverage and improved public resource management (including for key social programs targeted to the poor) as key results areas. The country's medium-term development strategy, laid out in 2008, specifically identifies expanded coverage of health insurance, particularly for the poor and the vulnerable, as a key priority.
The additional revised objective to strengthen the government's stewardship of the health sector was also highly relevant, given the aforementioned inefficiencies in public health expenditures.
b. Relevance of Design:
The original project design included upgrading primary health care (PHC) clinics, as well as increasing demand for PHC services through communication campaigns. These outputs were likely to contribute to the intended outcomes on primary health care. Implementation of activities in the rural (remote) regions ensured targeting of the poorest and disadvantaged households. Although unforeseeable, a significant shift in government policy in 2008 (from the direct delivery of health services to policy making, regulation, and execution of public health functions) led to privatization of health facilities and therefore rendered direct project support to PHC clinics less relevant. The project design did not adequately address the financial incentive structures that would lead to increased demand for the upgraded facilities.
The revised project design continued support to the remaining key project activities: capacity building in family medicine training and development of a policy and regulatory framework to support primary health care. The revised design also increased focus on the capacity of the Ministry of Labor, Health and Social Affairs to monitor, analyze, and evaluate the performance of the health sector.
|4. Achievement of Objectives (Efficacy) :|
A number of project activities covered the entire country (medical training and sector management), while the infrastructure improvements (primary health care clinics) took place in rural areas. According to the project team, the infrastructure improvements were implemented in the four poorest rural regions in the country (Imereti, Shida Kartli, Adhara, Racha). The estimated population of the four regions is 1.46 million, out of 4.2 million total population.
Other donors, most notably the UK Department for International Development (DFID) and the European Union, were also actively engaged in primary health care development in the country; however, DFID implemented activities in urban areas and the European Union implemented activities in rural areas not covered by the Bank project. Observed results here can therefore reasonably be attributed to project-financed interventions.
To improve coverage of primary health care (Original and Revised)
Substantial, due to evidence of improved coverage of primary health care (PHC) clinics and family medicine staffing.
- Construction and/or rehabilitation of 103 rural PHC clinics in Imereti, Adjara, and Shida Kartli regions by the end of 2007. The original target was to construct/rehabilitate 180 clinics. However, by March 2008, the government had approved measures that would privatize rural health practices.
- Provision of medical supply packages to 98 rural PHC clinics in Imereti, Guria, Adjara, Shida Kartli and Racha-Lechkumi regions.
- Construction of a 25-bed hospital in Ambrolauri.
- Refurbishment of a diagnostic laboratory in Kobuleti.
- Development of an information, education, and communication strategy promoting primary health care. Most activities were carried out in the period May to December 2007.
However, the pilot activity to develop a maternal and child health referral center was only partially implemented. The Kutaisi Perinatal Center was partially rehabilitated and equipped; however, training was shifted to another development partner.
- In 2009, the proportion of the rural population that had access to a PHC clinic within 30 minutes of walking/other transportation was 71%. No baseline is provided.
- 41% of the total population had access to family medicine doctors (of which 86% had received re-training) and 49% by family medicine nurses (of which 100% had received re-training). The target was 50%.
- The DPT3 immunization coverage rate for infants (nationwide) increased from 78% in 2004 to 92% in 2010, achieving the target of 90%.
To improve utilization of primary health care (Original and Revised)
Modest, due to limited evidence of improvements in utilization rates.
- See outputs reported above on upgrading of PHC clinics and information and education campaigns.
- The number of out-patient visits per capita per year in project areas was 1.8 in 2010. The target was 2.3 for the general population and 2.6 for the poor. There was no baseline figure provided specifically for the project areas.
- The proportion of pregnant women who have had at least four prenatal visits (nationwide) increased from 83% in 2007 to 91.3% in 2010.
The ICR (page 13) suggests several reasons for the modest improvements in utilization of PHC services. The Medical Insurance Program for the Poor did not substantially cover services at PHC clinics, and it did not provide for free or low-cost medicines. Financial access barriers were also significantly lowered for hospital services, where quality of services is perceived to be better and medicines are covered by insurance, and therefore patients may have been more likely to choose hospital services over primary care.
To improve quality of primary health care (Original and Revised)
Substantial. A number of project activities regarding training and facilities upgrading were implemented, and there was some evidence of improvements in quality.
- Rehabilitation and/or equipping of five regional family medicine training centers.
- Support to the family medicine training program, including equipping of faculty facilities, developing a residency program, and conducting workshops/study tours.
- Development of a family medicine nursing curriculum, which was used in the five regional training centers.
- Training of 916 doctors and 1,073 nurses in family medicine. The total number of family medicine doctors needed in the country for adequate coverage was 2,200, of which half were targeted to be trained during the project period.
- Training of 404 primary health care doctors in health care management.
- Development of 20 nationally or internationally approved treatment guidelines. 550 rural doctors received training in the new clinical guidelines, achieving the target of 550.
- See also outputs reported above on rehabilitation and/or equipping of PHC clinics.
- According to a 2010 health utilization survey, 77.4% of the population reported that the reasons for treatment were completely explained; 90.3% reported that adequate time (more than 12 minutes) was spent with primary medical professionals; and 95.4% reported clean or very clean facilities. However, these figures represent nationwide data and not the project area specifically, and there are no comparable baselines.
- 52% of tuberculosis patients were being treated according to the internationally approved DOTS strategy, achieving the target of 40%.
- See also outcomes reported above on increased coverage of immunizations and antenatal care.
To strengthen the government's stewardship function in the health sector (Revised)
Substantial, due to the delivery of numerous project outputs and subsequent implementation of key health policies.
- Development of the PHC master plan, which included a management and organizational framework for PHC, as well as health work force rationalization and health facilities (PHC clinics and laboratories) rationalization plans.
- Development of a Health Sector Strategy White Paper for 2011-2015, the first since 1999.
- Development of a National Pharmaceutical Policy, amendment of legislation to allow parallel imports of medicines, and preparation of an Essential Drug List (based on World Health Organization guidelines).
- Establishment of a Health Policy Unit, which was responsible for health care financing policy. The Unit developed the capacity to prepare annual National Health Accounts, which the ICR (page 17) reports have been used to inform health financing policy and allocations of government funds.
- Conducting of a Health Sector Performance Assessment, with findings disseminated.
- Conducting of two rounds of Health Utilization and Expenditure Surveys (2007 and 2010).
- Evaluations of the Medical Insurance Program for the Poor (MIP) in 2008 and 2010.
- Implementation of information and education campaigns to increase public awareness of the government's health reform agenda, specifically programs for the poor, privatization of health facilities, and contracting with private insurance.
- Implementation of policy to increase remuneration for family medicine personnel.
- The health management information system was implemented as a pilot, but is not yet fully operational on a nationwide scale. A set of regulations on the standardization of procedures and codes for the information system have been submitted to Parliament for approval.
- 38.4% of public health expenditures were earmarked for programs for the poor, according to the National Health Accounts for 2011. This surpassed the target of 30.0%.
- 93.2% of the population was aware of the Medical Insurance Program for the Poor (MIP), an indication of public awareness of health care reforms.
- The amended pharmaceutical legislation led to a decrease in prices of some original brand medicines.
- The MIP evaluation results led to a revision of the insurance package, adding pharmaceutical benefits. The Essential Drug List was used to inform the contents of the pharmaceutical benefits.
- The NHA was used for preparing the medium-term expenditure framework for the health care budget.
Modest. The project design featured some elements that were likely to contribute to efficiency in the use of project resources. These included the updating of treatment protocols and the strong focus on primary health care delivery, which was significantly less costly than hospital-based or specialized clinic care. However, there were only modest improvements in utilization rates for primary health care, in part due to the inadequate focus on changing financial incentives to utilize primary care services. In addition, numerous policy and leadership changes by the government led to significant implementation delays, with the project period extended numerous times for a total of 4.5 years.
a. If available, enter the Economic Rate of Return (ERR)/Financial Rate of Return at appraisal and the re-estimated value at evaluation:
* Refers to percent of total project cost for which ERR/FRR was calculated