Sample Program Evaluation Projects
Program Evaluation Strategy for EPA's Office of Superfund Remediation Technology Innovation: On a quick turnaround basis, Indtai crafted a strategy for identifying, screening, and selecting projects for evaluating the Superfund remedial program. Indtai researched program evaluation methodologies and frameworks in the development of OSRTI's program evaluation strategy. We analyzed several comprehensive Superfund studies and evaluations and identified recommendations and potential follow-up evaluation projects. The potential projects were subject to Indtai's screening/prioritization procedures.
OMB’s PART Budget Evaluation: Indtai supported EPA’s Superfund Remedial Program in the preparation of a response to OMB’s Program Assessment Rating Tool (PART) evaluation. We reviewed and commented on EPA’s supporting evidence and responses to PART questions. Indtai conducted supplemental research for EPA’s use in answering PART questions. Indtai also developed a document management system to assist in EPA's response, please visit our Information Management projects for details.
Superfund Evaluation Measures: Indtai staff helped the Superfund program develop real-world measures of progress. We assisted in transforming data on jargon-focused, quantitative program measures like "RA starts" and "RODs completed"--which were perfectly meaningful and relevant to program staff--into qualitative indicators that would help Americans more easily grasp Superfund progress. The new measures covered emergency response actions by reporting on removal of life-threatening wastes, population relocation, and the provision of site security and alternative water supplies. Long-term cleanup goals were represented with information on contaminated land, surface water, and ground water; technologies applied to clean up contamination; and the volumes of materials handled during site cleanup. The development of qualitative evaluation measures was a revolution for Superfund. Taking into account GPRA principles, Indtai staff helped to propose measures that more holistically measured Superfund progress.
Congressional Inquiries on Cleanup Program: At a time when interest in Superfund reauthorization was high, Congressmen Swift and Dingell posed challenging questions to EPA on program activities and accomplishments. The questions were in-depth and Congress wanted answers quickly. Indtai consultants rose to the challenge. Our consultants were involved in a huge project that sent interview teams out to the Regions to collect data and required extensive analyses of information contained in multiple databases. Once the data began arriving from the Regions and were assembled from myriad sources, our consultants set about creating spare, good-looking fact sheets to respond to each question. The result was a clear and compelling presentation of Superfund accomplishments to Congress.
Joint Evaluation of Superfund & Construction Grants Programs: One of our staff members set the direction for a study evaluating the costs and durations of engineering phases in the Superfund and construction grants programs. The study validated the concept/hypothesis that these two large public works programs have comparable project life-cycle "curves." The outcome presented a reassuring message: that the Superfund program, often unfairly attacked as cumbersome and slow, was actually as effective and timely as the well-respected multi-billion dollar program for wastewater treatment plant construction.
Evaluation of Environmental Litigation Cases : On multiple types of litigation cases, Indtai consultants performed empirical evaluations of EPA decision-making, enforcement actions, remedy selections, and cost/durations of cleanup activities. For example, our experts evaluated the degree to which Superfund removal actions were consistent with the National Contingency Plan (NCP). Litigation analyses typically addressed issues of programmatic consistency, statutory compliance, equity/fairness, and cost reasonableness. Various programmatic evaluations involved mapping governing laws, regulations, and policies with precedents and actions performed in the field.
Legal Services Business Process Consulting: One of Indtai's staff members performed a business process consulting analysis for a large legal services firm in the UK to help the firm decide on automation of their paper-intensive business processes. He evaluated and developed more than 60 different process flows to demonstrate complexity and "choke-points" in the current process and to demonstrate opportunities to improve operations.
Hospital Business Process Consulting: One of our senior consultants conducted an evaluation of business processes at a large teaching hospital. He conducted a baseline evaluation of performance in multiple departments (e.g., radiology), comparing results to similar hospitals to identify opportunities for improvement. Our analyst observed work processes, reviewed labor schedules, and evaluated patient utilization of hospital service offerings to identify inefficiencies and misallocations of resources. He identified over $2 million in annual expense reductions and assisted with the implementation of business process improvements.
