Major Management Challenges and Program Risks
Environmental Protection Agency
Gao ID: GAO-03-112 January 1, 2003
In its 2001 performance and accountability report on the Environmental Protection Agency (EPA), GAO identified important challenges facing the agency in improving environmental information, developing a comprehensive human capital approach, and strengthening working relationships with the states. The information GAO presents in this report is intended to help to sustain congressional attention and an agency focus on continuing to make progress in addressing these challenges--and others that have arisen since 2001--and ultimately overcoming them. This report is part of a special series of reports on governmentwide and agency-specific issues.
The Environmental Protection Agency has made progress toward resolving the specific performance and management challenges that GAO previously identified. However, each of these challenges requires more work and vigilance to be overcome. In addition, the agency must face emerging challenges in managing grant resources to better achieve environmental results and in correcting weaknesses in controls over its financial reporting. Improving environmental information: EPA has taken important steps to improve the environmental information it uses to set priorities and measure progress. For example, EPA has embarked on a major effort to determine the overall status of the nation's environment. EPA has also taken steps to improve the compatibility and security of its data systems. However, EPA must work to further improve its environmental information, fill significant data gaps, and incorporate better scientific understanding into its performance measures. Strengthening human capital management: EPA has conducted a study of its workforce and issued a human capital strategy. However, the agency still must determine the number of employees it needs to accomplish its mission, the technical skills required, and how best to allocate employees among EPA's strategic goals and geographic locations. Similarly, EPA needs to fully prepare for the loss of leadership, institutional knowledge, and scientific expertise that will likely result from upcoming retirements. Making regulatory innovation successful: EPA has invested considerable time and resources in a variety of initiatives to encourage more effective and cost-efficient environmental protection. However, these initiatives have yielded limited results. Our work shows that current environmental statutes significantly impede regulatory innovation. If the statutory obstacles to innovation are not addressed, EPA's future regulatory initiatives may not fare better than past ones. Improving grants planning and management: EPA annually spends over half its budget on grants. However, the agency has often not focused its planning and performance measurement for grants on achieving environmental results. In addition, EPA must address persistent problems in its management and oversight of grants. Strengthening controls over financial reporting: EPA's Inspector General issued an unqualified opinion on EPA's consolidated financial statements for fiscal year 2001. However, the Inspector General identified several internal control weaknesses that EPA needs to address to improve its ability to process, summarize, and report financial data.
GAO-03-112, Major Management Challenges and Program Risks: Environmental Protection Agency
This is the accessible text file for GAO report number GAO-03-112
entitled 'Major Management Challenges and Program Risks: Environmental
Protection Agency' which was released on January 01, 2003.
This text file was formatted by the U.S. General Accounting Office
(GAO) to be accessible to users with visual impairments, as part of a
longer term project to improve GAO products‘ accessibility. Every
attempt has been made to maintain the structural and data integrity of
the original printed product. Accessibility features, such as text
descriptions of tables, consecutively numbered footnotes placed at the
end of the file, and the text of agency comment letters, are provided
but may not exactly duplicate the presentation or format of the printed
version. The portable document format (PDF) file is an exact electronic
replica of the printed version. We welcome your feedback. Please E-mail
your comments regarding the contents or accessibility features of this
document to Webmaster@gao.gov.
Performance and Accountability Series:
January 2003:
Major Management Challenges and Program Risks:
Environmental Protection Agency:
GAO-03-112:
A Glance at the Agency Covered in This Report:
The Environmental Protection Agency has the critical and complex
mission of protecting human health and safeguarding the environment. It
works collaboratively with the states, local governments, tribes, and
others on a variety of efforts, including ensuring that
* the air in every American community will be safe and healthy to
breathe;
* all Americans will have drinking water that is clean and safe to
drink;
* America‘s rivers, lakes, wetlands, aquifers, and coastal and ocean
waters will be protected;
* the foods Americans eat will be free from unsafe pesticide residues;
* America‘s wastes will be stored, treated, and disposed of in ways
that prevent harm to people and the natural environment; and
* the United States will lead other nations in reducing significant
risks from climate change, stratospheric ozone depletion, and other
hazards of international concern.
[See PDF for image]
[End of figure]
This Series:
This report is part of a special GAO series, first issued in 1999
and updated in 2001, entitled the Performance and Accountability
Series: Major Management Challenges and Program Risks. The 2003
Performance and Accountability Series contains separate reports
covering each cabinet department, most major independent agencies,
and the U.S. Postal Service. The series also includes a
governmentwide perspective on transforming the way the government
does business in order to meet 21st century challenges and address
long-term fiscal needs. The companion 2003 High-Risk Series: An
Update identifies areas at high risk due to either their greater
vulnerabilities to waste, fraud, abuse, and mismanagement or major
challenges associated with their economy, efficiency, or
effectiveness. A list of all of the reports in this series is
included at the end of this report.
GAO Highlights:
Highlights of GAO-03-112, a report to Congress included as part of
GAO‘s Performance and Accountability Series.
Why GAO Did This Report:
In its 2001 performance and accountability report on the
Environmental Protection Agency (EPA), GAO identified important
challenges facing the agency in improving environmental information,
developing a comprehensive human capital approach, and strengthening
working relationships with the states. The information GAO presents in
this report is intended to help to sustain congressional attention and
an agency focus on continuing to make progress in addressing these
challenges”and others that have arisen since 2001”and ultimately
overcoming them. This report is part of a special series of 25 reports
on governmentwide and agency-specific issues.
What GAO Found:
The Environmental Protection Agency has made progress toward resolving
the specific performance and management challenges that GAO previously
identified. However, each of these challenges requires more work and
vigilance to be overcome. In addition, the agency must face emerging
challenges in managing grant resources to better achieve environmental
results and in correcting weaknesses in controls over its financial
reporting.
* Improving environmental information. EPA has taken important steps to
improve the environmental information it uses to set priorities and
measure progress. For example, EPA has embarked on a major effort to
determine the overall status of the nation‘s environment. EPA has also
taken steps to improve the compatibility and security of its data
systems. However, EPA must work to further improve its environmental
information, fill significant data gaps, and incorporate better
scientific understanding into its performance measures.
* Strengthening human capital management. EPA has conducted a study of
its workforce and issued a human capital strategy. However, the agency
still must determine the number of employees it needs to accomplish its
mission, the technical skills required, and how best to allocate
employees among EPA‘s strategic goals and geographic locations.
Similarly, EPA needs to fully prepare for the loss of leadership,
institutional knowledge, and scientific expertise that will likely
result from upcoming retirements.
* Making regulatory innovation successful. EPA has invested
considerable
time and resources in a variety of initiatives to encourage more
effective and cost-efficient environmental protection. However, these
initiatives have yielded limited results. Our work shows that current
environmental statutes significantly impede regulatory innovation. If
the statutory obstacles to innovation are not addressed, EPA‘s future
regulatory initiatives may not fare better than past ones.
* Improving grants planning and management. EPA annually spends over
half its budget on grants. However, the agency has often not focused
its planning and performance measurement for grants on achieving
environmental results. In addition, EPA must address persistent
problems in its management and oversight of grants.
* Strengthening controls over financial reporting. EPA‘s Inspector
General issued an unqualified opinion on EPA‘s consolidated financial
statements for fiscal year 2001. However, the Inspector General
identified several internal control weaknesses that EPA needs to
address to improve its ability to process, summarize, and report
financial data.
What Remains to Be Done:
GAO believes that EPA should:
* Ensure that recent steps to improve environmental information receive
sustained top management support.
* Implement a systematic and comprehensive human capital approach.
* Articulate a clear and specific endorsement of legislation that would
address statutory obstacles to the agency‘s regulatory reinvention
efforts.
* Strengthen its grants planning and management to better achieve
environmental results.
* Improve its internal controls over financial reporting.
Contents:
Transmittal Letter:
Major Performance and Accountability Challenges:
GAO Contacts:
Related GAO Products:
Performance and Accountability and High-Risk Series:
This is a work of the U.S. Government and is not subject to copyright
protection in the United States. It may be reproduced and distributed
in its entirety without further permission from GAO. It may contain
copyrighted graphics, images or other materials. Permission from the
copyright holder may be necessary should you wish to reproduce
copyrighted materials separately from GAO‘s product.
January 2003:
The President of the Senate and the
Speaker of the House of Representatives:
This report addresses the major management challenges and program risks
facing the Environmental Protection Agency (EPA) as it works to carry
out its complex mission of protecting human health and safeguarding the
environment. The report discusses the actions that EPA has taken and
that are under way to address the challenges GAO identified in its
Performance and Accountability Series 2 years ago. The report also
summarizes the challenges that remain, new ones that have emerged, and
further actions that GAO believes are needed.
This analysis should help the new Congress and the administration carry
out their responsibilities and improve government for the benefit of
the American people. For additional information about this report,
please contact Robert A. Robinson, Managing Director, Natural Resources
and Environment, at (202) 512-3841 or at robinsonr@gao.gov.
Signed by David M. Walker:
David M. Walker
Comptroller General
of the United States:
[End of section]
Major Performance and Accountability Challenges:
In January 2001 we reported that EPA faced three performance and
accountability challenges in fulfilling its mission of protecting
human health and the environment. First, EPA needed to improve its
environmental and performance information management to set priorities
and measure results. Without a comprehensive picture of environmental
conditions, EPA faces difficulty in setting risk-based priorities for
its programs, evaluating performance progress and environmental
results, and reporting on its accomplishments. Second, EPA needed to
place greater emphasis on developing a comprehensive human capital
program. Without such a program, EPA faces difficulty in aligning human
capital investments with strategic goals and objectives, and
determining the number of employees, the skills, and the deployment of
its workforce needed to accomplish its mission. Finally, we reported
that the nation‘s complex future environmental challenges require EPA
and its stakeholders to adopt fundamentally different regulatory
approaches that are more flexible and less administratively burdensome.
During the past 2 years, EPA has continued its traditional efforts to
protect the nation‘s air, land, water, and human health, while
undertaking new roles and responsibilities, such as mitigating the
environmental effects of the tragic events of 2001. EPA played a major
role in responding to the attacks at the World Trade Center, assisting
in debris removal, air and water quality monitoring, worker protection,
dust cleanup, and criminal investigation. Similarly, EPA worked with
the Federal Bureau of Investigation and the Department of Defense at
the Pentagon crash site to monitor air and drinking water quality and
to collect forensic evidence for criminal investigation. EPA also
provided personnel, equipment, and contractors to help assess or clean
up anthrax contamination at the U.S. Postal Service, the Capitol Hill
complex, and other government sites. Despite its
increased responsibilities, EPA has, to its credit, also undertaken
some major initiatives to improve the overall management of the agency
and its resources.
These management initiatives have helped EPA make progress in
addressing the management challenges we identified in our 2001 report.
For example, in an effort to improve the quality of the information
used to set priorities and measure results, EPA plans to issue the
first-ever State of the Environment Report in early 2003, which will
summarize available information on the condition of the nation‘s
environment and identify the remaining information needed to complete
the picture. In addressing its human capital challenges, EPA has begun
to develop a workforce assessment system that will identify the
technical skills and number and type of positions required, inventory
the skills of the current workforce, examine attrition rates, and
forecast the number of new hires required. Finally, in an effort to
adopt regulatory approaches that are more flexible and less
administratively burdensome, EPA has invested considerable time and
resources in a variety of initiatives to encourage more effective and
cost-efficient ways of protecting the environment. However, for each of
the management challenges we identified in 2001, more work remains to
be done. In addition, we have identified two other challenges that EPA
needs to address. Specifically, EPA needs to strengthen its grants
management and improve internal controls over its financial management
reporting. In sum, the major management challenges that EPA faces are
as follows:
[See PDF for image] - graphic text:
[End of figure] - graphic text:
EPA Needs to Ensure That Recent Steps to Improve Environmental
Information Receive Sustained Top Management Support:
Information is critical to EPA‘s mission of protecting the environment
and public health. Information from scientific research, from the
monitoring of air and water quality and other environmental parameters,
and from epidemiological and other studies of the links between
environmental pollutants and human health effects is needed to inform
EPA‘s policies and to assess the effectiveness of the agency‘s policies
and programs in achieving desired results. While the quality of
environmental information and the scientific understanding of how
environmental factors can affect ecological conditions and human health
have improved since EPA‘s inception, the pace of progress has sometimes
been slow. Furthermore, significant gaps in environmental information
and scientific knowledge remain. EPA has taken a number of recent
actions to implement recommendations that we and others have made to
enhance the quality and usefulness of the environmental information
that it and its partners generate. These actions include adopting an
information strategic plan that envisions managing information as a
strategic resource, developing data standards to facilitate efficient
reporting, aggregating and integrating environmental data, measures to
improve information security, and initiatives to develop a
comprehensive set of environmental indicators and use them to provide
the public with a baseline report on the current state of
the environment.
To ensure that these and related actions continue and achieve the
desired results, EPA management needs to develop annual or multiyear
action plans to translate the ’vision“ embodied in the strategic
information plan into specific actions that will advance the
achievement of the plan‘s goals. Action plans would, among other
things, establish target dates for completing specific actions and
identifying the resources required to meet these milestones. Action
plans could help ensure that the strategic plan becomes and remains a
living document that informs agency decision making; guides investments
in information infrastructure, technology, and human capital; and
evolves over time to reflect progress, changing circumstances, and new
imperatives. Sustained progress in enhancing the agency‘s information
management will require a long-term commitment of management attention,
including appropriate follow-through and resource support.
Significant Gaps Remain in Environmental Data and Science:
The results of scientific research, and the information and knowledge
gained from monitoring the environment and public health, are essential
foundations for developing; assessing; and refining environmental
policy, including developing measures to gauge the effectiveness of
that policy in producing the desired outcomes. While EPA, the states,
and other environmental partners carry out a considerable amount of
research and collect extensive information on environmental parameters,
significant gaps and weaknesses remain in the knowledge and
understanding of environmental stressors and pollutants and their
effects on ecological condition and human health. Information obtained
from environmental monitoring is often fragmentary and of varying
quality, information on human exposures to toxic pollutants is limited,
and the ecological and public health effects of many environmental
contaminants are still not well understood. As we have reported in the
past, such gaps in the data and in scientific understanding hamper
EPA‘s efforts to (1) perform critical human exposure and risk
assessments, (2) use risk as a basis for setting program priorities,
(3) obtain a comprehensive understanding of environmental conditions
and changes over time, and (4) assess the agency‘s effectiveness in
carrying out its mission of protecting the environment and
human health.
Information on the health risk posed by exposures to toxic chemicals is
critical to EPA‘s policy decision making. However, the information
needed to credibly assess these risks often does not exist. In a May
2000 report on the lack of data regarding human exposures to toxic
chemicals in the environment, we reported that exposure data were
limited because the data were being collected nationwide for only a
small percentage of the nearly 1,500 potentially harmful chemicals we
reviewed.[Footnote 1] For the nearly 500 chemicals that EPA identified
as most in need of testing under the Toxic Substances Control Act, only
2 percent were being tested for human exposure. We recommended that the
Secretary of Health and Human Services and the EPA Administrator
develop a coordinated federal strategy for the monitoring and reporting
of human exposures to potentially toxic chemicals.
Progress in this area has been slow, however, and the benefits of
initiatives currently in the discussion or planning stages are likely
to be years away from realization. For example, EPA‘s Office of
Research and Development is moving to establish a program addressing
environmental public health outcomes as part of its Human Health
Research Strategy. This Office recently held a workshop involving
several public health agencies to help in developing a research
framework that would be complementary to other agencies‘ efforts and
define opportunities for collaboration. Also, according to officials of
EPA‘s Office of Environmental Information, that Office worked with the
Centers for Disease Control and Prevention in 2002 on a potential
cross-agency initiative to develop and link environmental and human
health information resources, specifically the Centers‘ National
Environmental Public Health Tracking Program network and EPA‘s National
Environmental Information Exchange Network. The proposed linkage holds
the potential to enhance information technology tools to foster the
analysis and dissemination of information obtained to a variety
of audiences.
Important data gaps also remain in EPA‘s Integrated Risk Information
System, a database containing information on human health effects that
may result from exposure to chemicals in the environment. Specifically,
the database contains no basic data on the toxicity of about two-thirds
of the known hazardous air pollutants and only limited information on
the ecological effects of environmental pollutants. Likewise, there are
significant data gaps and weaknesses in EPA‘s National Water Quality
Inventory, the primary report on the condition of the nation‘s waters.
The gaps result from the fact that only a small percentage of U.S.
waters is assessed for quality and only a limited number of assessments
are based on current, site-specific monitoring information.[Footnote
2] Incomplete water quality data make it difficult for EPA to
accurately describe the condition of the nation‘s waters and report on
the progress being made toward achieving established water quality
goals. The data gaps and weaknesses are also problematic because agency
officials rely on state-reported data in the inventory when making
program management decisions, including determining how certain Clean
Water Act funds will be allocated among the states.
EPA‘s research on the use of biological indicators for environmental
assessments demonstrates the importance and value of research.
Because site-specific water quality monitoring is complex, difficult,
and expensive, for many contaminants (including sediment, toxic
chemicals, pathogens, and invasive species) that are potentially of
concern, it is doubtful that many states, territories, and tribes will
ever be able or willing to devote sufficient resources to monitor their
streams and other water bodies adequately and on a regular basis.
Recognizing this, EPA has conducted research on alternative
methodologies for estimating the environmental conditions of streams,
estuaries, and other water bodies. EPA‘s Environmental Monitoring and
Assessment Program (EMAP) has conducted studies that have established
that the use of biological indicators that integrate chemistry,
habitat, pathogens, and other stressors over time lead to less
expensive approaches to monitoring the environmental conditions in
streams and other water bodies. According to EPA, as of May 2002,
20 states had adopted a methodology based on EMAP to determine the
environmental condition of steams and estuaries on a regional scale. In
addition, the agency reports that it has several initiatives under way
for the greater application of this approach to coastal areas and
streams in arid areas of the West and for assessing the nation‘s great
rivers.
In November 2001, at the direction of its Administrator, EPA embarked
on a major effort that holds the promise of providing, for the first
time ever, an overall picture--albeit less than perfect and complete--
of the nation‘s current environmental conditions and trends and,
equally important, of highlighting data gaps and indicating the
research and information collection efforts needed to fill those gaps.
The Administrator directed EPA‘s Office of Environmental Information
and Office of Research and Development to lead an agencywide initiative
to develop a set of indicators of environmental quality and use these
indicators as a basis for drafting the State of the Environment Report
to be issued in early 2003. The report is intended to serve as the
basis for initiating a broad public discussion about the environment
and environmental protection. As currently envisioned, it will
(1) describe current environmental conditions and trends using existing
data and indicators developed by EPA and others, (2) identify data gaps
and research needs, (3) discuss challenges that government and
other environmental partners face in filling those gaps and needs, and
(4) be accompanied by extensive technical information and support. The
report is to encompass five environmental theme areas: human health,
ecological condition, clean air, pure water, and better protected land.
Under human health, for example, the report will explore trends in
diseases, human exposure to environmental pollutants, and diseases
thought to be related to environmental pollution.
EPA views the draft State of the Environment Report as the starting
point of a public dialogue on environmental protection issues and an
important step toward a more comprehensive approach to identifying
priorities, focusing resources on areas of greatest concern, and
managing its work to achieve measurable results. If successful in its
aims, this multiyear undertaking could make a substantial contribution
not only to identifying and filling research and data gaps but also to
measuring progress within an overall framework of ecological and human
health, assisting EPA‘s strategic-planning efforts, and facilitating a
transition to performance-based management driven by environmental
goals. To be successful, however, particularly in identifying and
filling research and data gaps, this effort will require sustained
cooperation and coordination on the part of EPA, other federal and
state partners, academic institutions, and others. It will also require
adequate and dependable financing, something that many people--
including advocates of strong environmental science in the Congress--
may argue has been absent until now.
EPA Has Made Progress in Overcoming Data System Weaknesses That Limit
the Usefulness of Environmental Data, but More Needs to Be Done:
We reported in January 2001 that EPA‘s data management system is
outmoded in numerous respects, including having separately designed,
media-specific databases that are generally not technically
compatible.[Footnote 3] This incompatibility is a legacy of the
historical ’stove-pipe,“ or single media, orientation of EPA‘s programs
and has served as a barrier to the efficient reporting, aggregation,
and integration of data to present comprehensive information on
pollutants, industrial sectors, localities, and environmental
conditions and trends. Despite this historical legacy, however, EPA has
recognized the importance of integrated environmental information and
the need to make its databases compatible with one another and with
those of its state and tribal partners. For example, since our January
2001 report, the agency has made notable progress in implementing an
initiative to standardize basic data element definitions and formats to
permit the information contained in EPA and state and tribal databases
to be combined to present a more comprehensive picture of environmental
conditions and results. Agency officials also view data standardization
as a way to reduce the reporting burden for states and industry by
allowing more integrated data reporting and facilitating electronic
reporting via the Internet.
Implementing a recommendation that we made in a September 1999 report,
that the agency coordinate its data standardization efforts with the
states, federal agencies, and other organizations, EPA and its state
and tribal partners created the Environmental Data Standards Council to
work cooperatively to develop consensus-based data standards.[Footnote
4] To date, EPA and its partners on the Council have adopted and begun
to implement seven final data standards that will foster consistently
defined and formatted data elements and sets of data values and
facilitate public access to more meaningful data. The data standards
that have been finalized are:
* the date,
* the latitude/longitude,
* biological taxonomy,[Footnote 5]
* chemical identification,
* facility identification,
* permitting, and:
* the Standard Industrial Classification/North American Industrial
Classification System.
As an example of the function and value of such data standards, the
’chemical identification“ standard provides a consistent way to
identify and represent chemical substances across the agency. It
provides EPA with a unique, unambiguous, common name for each chemical
substance and chemical grouping in which the agency has an interest,
and provides a way to reference data about chemical substances across
EPA systems and to search for chemical entries in these systems. By the
same token, the ’facility identification“ data standard provides, for
the first time, a unique facility identification number for any
facility subject to EPA‘s regulatory authority, regardless of the media
program(s) involved. Achieving consensus even on such a seemingly
simple and straightforward matter was by no means an easy task. EPA
officials told us that it was necessary to overcome broad resistance
stemming from concerns about ’big brotherism.“:
In addition to these final standards, a number of new standards are
currently under development or envisioned by the Council and EPA action
teams. These standards include:
* contact,
* enforcement/compliance,
* tribal identifiers,
* reporting water quality results for chemical and microbiological
analytes,
* geospatial referencing,
* the electronic reporting of environmental laboratory results,
* federal facilities identifiers, and:
* the National Pollutant Discharge Elimination System (NPDES).
The NPDES will pick up where the final permitting standard leaves off,
by standardizing data elements related to water pollutant discharge
permits.
Other EPA initiatives related to the effort to integrate data within
and across agency programs and with partners and stakeholders include
the cross-agency Information Integration Program, which is intended to
foster the development of an information integration strategy to
identify tools and approaches that can be used across the agency and by
states and tribes to support improved decision making and increase
efficiency. This program culminated in (1) the creation of the Model
for Information Integration, which provides a framework for EPA‘s
integration efforts and establishes a vision for its target information
architecture; (2) the development of a system of registries that serve
as repositories for commonly used data element definitions and
information about data (metadata); [Footnote 6] and (3) an
Environmental Information Management System, developed by EPA‘s Office
of Research and Development, which provides descriptive information
about various data sets; databases; documents; models; and multimedia
projects, enabling users to identify and use the data that best meet
their needs.
While the measures taken to date represent noteworthy progress
toward the goal of environmental data compatibility and integration,
EPA still has some distance to travel and important challenges to
overcome. For the most part, the agency has focused on the
compatibility of its data with those of state and tribal agencies
rather than with the data of other federal agencies and nongovernmental
organizations that share an interest in environmental protection.
Improved collaboration between federal agencies is essential because
(1) individual agencies have different capacities and skills that are
complementary and lend themselves to fruitful collaboration and
(2) separate attempts have fallen short of supporting the large efforts
that are needed to produce high-quality, comprehensive data on
environmental conditions and trends. In this regard, EPA‘s Science
Advisory Board, created to provide the agency with expert and impartial
external scientific advice, recommended that EPA do more to link its
databases with external sources. For example, the Board noted that
’answering many health-related questions frequently requires linking
environmental data with census, cancer, birth registry, or other data
systems (such as water distribution maps) to determine whether there is
a relationship between the environmental measures and health.“:
Although EPA officials do not dispute the value of linking the agency‘s
databases with those of other federal agencies and nongovernmental
organizations, they note that efforts have been limited by resource
constraints and a lack of statutory authority to require other agencies
to collect and report data using formats compatible with those used by
EPA. Acknowledging that EPA may have unduly focused on state and tribal
partners, to the exclusion of federal agencies and others when
composing the Environmental Data Standards Council, officials of the
Office of Environmental Information pointed out that one of the reasons
for publishing proposed data standards in the Federal Register for
public comment, before making them final, is to solicit the
participation and input of other interested and knowledgeable parties,
including other federal agencies. They noted that another federal
agency, the Department of the Interior‘s U.S. Geological Survey (USGS),
in conjunction with the National Water Quality Monitoring Council, was
instrumental in proposing and initiating the development of the
standard for Reporting Water Quality Results for Chemical and
Microbiological Analytes. In addition, USGS has taken the lead in
developing a geospatial data standard, an e-government initiative that
is highly relevant to EPA and on which EPA is collaborating.
Data Limitations Still Hinder Development of Results Measures, but
Groundwork Is Being Laid for More Effective Performance Measurement:
Well before passage of the Government Performance and Results Act of
1993 (Results Act), a number of internal and external studies,
including our August 1988 general management review of EPA,[Footnote 7]
called on the agency to manage for measurable environmental results as
a way to improve its performance and accountability. As we and others
noted, developing effective measures of the environmental results of
EPA‘s policies and program activities would help the agency‘s managers
in assessing the extent to which the agency contributes to
environmental improvements and in setting priorities, planning, and
budgeting. The effective measurement of environmental results would
also serve to make the agency more accountable to the Congress and the
public for its performance.
The Results Act, for the first time, formally required EPA and other
federal agencies to prepare performance plans containing annual
performance goals and measures to help them move toward managing for
results. Performance goals and measures were to be used to assess an
agency‘s progress toward achieving the results expected from its major
functions. Performance goals established under the act‘s requirements
constitute target levels of performance expressed as tangible,
measurable objectives against which actual achievement can be compared.
Performance measures constitute the ’yardsticks“ to assess success in
meeting performance goals.
Notwithstanding EPA‘s timely actions to implement the Results Act‘s
procedural requirements, the agency‘s progress in moving toward
measuring the actual results of its activities has been slow. To a
large extent, EPA‘s performance goals and their associated performance
measures continue to be expressed as outputs--environmental
standards established, permits issued, enforcement actions taken--
rather than as end outcomes, measures that directly show how EPA‘s work
led to improvements in environmental conditions or public health. For
example, as shown in table 1, for fiscal year 1999, 86 percent of EPA‘s
278 performance measures consisted of output measures, while only
14 percent consisted of outcome measures. Three years later, in fiscal
year 2002, 71 percent of the agency‘s 365 performance measures
consisted of output measures, while the percentage of outcome measures
had moderately increased to 29 percent. For fiscal year 2003, under way
since October 1, 2002, EPA has a total of 284 performance measures of
which 60 percent are output measures and the remaining 40 percent,
outcome measures.
Close examination, however, shows that only a portion of EPA‘s fiscal
year 1999, fiscal year 2002, and fiscal year 2003 outcome measures
actually measured end outcomes, the environmental results of its
programs and activities (7 percent of fiscal year 1999 performance
measures, 22 percent of fiscal year 2002 performance measures, and
27 percent of fiscal year 2003 performance measures).[Footnote 8] The
remaining EPA outcome measures for these 3 fiscal years are more
properly classified as measures of intermediate outcomes rather than
end outcomes. Intermediate outcomes indicate progress or presumed
contributions toward achieving end outcomes. They are used when end
outcomes are not immediately clear, easily delivered, or quickly
achieved. For example, inducing local jurisdictions to adopt higher
water quality standards is an intermediate outcome contributing,
presumably, to the end outcome of safe drinking water.
Table 1: Classification of EPA‘s Performance Measures:
Fiscal year: 1999; Outputs: 86% (240 of 278); Intermediate outcomes: 7%
(18 of 278); End outcomes: 7% (20 of 278); Total outcomes: 14% (38 of
278).
Fiscal year: 2002; Outputs: 71% (260 of 365); Intermediate outcomes: 7%
(26 of 365); End outcomes: 22% (79 of 365); Total outcomes: 29% (105 of
365).
Fiscal year: 2003; Outputs: 60% (170 of 284); Intermediate outcomes:
13% (38 of 284); End outcomes: 27% (76 of 284); Total outcomes: 40%
(114 of 284).
[End of table]
Source: EPA.
Note: GAO‘s analysis of EPA‘s data.
The relatively low percentage of end outcome measures in EPA‘s
collection of performance metrics is largely a reflection of the fact
that data and scientific knowledge essential to permit end outcome
measurement are often lacking, as well as the fact that there is often
a significant time lag between actions taken to protect and improve the
environment and demonstrable effects. In addition, other factors, such
as the level of economic activity, can have confounding effects,
obscuring the role played by EPA programs in environmental change. The
data/knowledge problem is one that EPA is attempting to address through
its ongoing indicators initiative and anticipated State of the
Environment Report. While these efforts are expected to identify
important data gaps and point to the research needed to improve the
scientific understanding of the environment, it may be years before
such gaps are filled and research yields dividends of knowledge and
scientific understanding sufficient to allow for a more reliable
measurement of the environmental results of EPA‘s program activities.
Hence, the measurement of the environmental results of EPA‘s programs
and managing for improved performance are likely to continue to pose a
significant challenge for the agency for some time to come.
In addition to the environmental indicators and State of the
Environment Report initiatives, the agency has undertaken another
related initiative that has a similar potential over the longer term to
enhance its ability to measure and manage for environmental outcomes.
Known as ’Managing for Improved Results,“ this project was launched in
the summer of 2001 by EPA‘s Deputy Administrator, who charged the
Office of the Chief Financial Officer with the task of examining a mix
of near-and long-term reforms to improve the agency‘s ability to manage
for results. In response to this charge, a steering group of senior
headquarters and regional staff, reporting to the Deputy Administrator,
was assembled to (1) examine EPA‘s management practices, including
priority setting, planning, budgeting, and performance tracking/
reporting, and (2) explore options both for significant and far-
reaching reforms as well as smaller-scale improvements. Among the more
far-reaching recommendations that the steering group has made is the
recommendation that the agency develop a new strategic-planning
architecture with a new goal structure focused on a reduced number of
environmentally focused goals, as few as 5 in number (compared with the
current 10 strategic goals). With respect to performance measurement,
the steering group recommended that EPA‘s program offices develop
better performance measures as part of the strategic plan‘s goal
revision process. Actions envisioned as part of this recommendation
include (1) program offices responsible for each strategic objective
developing multiyear plans to improve the quality and
outcome-orientation of associated annual performance goals and annual
performance measures, (2) national program managers and lead regions
collaborating to improve measures, (3) goal teams ensuring that data of
adequate quality will be available, (4) the Office of the Chief
Financial Officer‘s expansion of its consultation and technical support
to the rest of the agency, and (5) using State of the Environment
Report indicators to guide the development of the next improved
generation of outcome-based performance goals and measures.
All of these initiatives aimed at improving EPA‘s ability to manage for
environmental results are, essentially, long-term in nature. They will
require a long-term commitment of management attention, follow-through,
and support--including the dedication of appropriate and sufficient
resources--for their potential to be fully realized. A number of
similar initiatives in the past have been short-lived and disappointing
in terms of lasting contributions to improved performance management.
Just as the forthcoming State of the Environment Report is intended to
foster an ongoing dialogue between the agency and its partners,
including the broader public, both the Environmental Indicators
Initiative and the Managing for Results Initiative represent just the
beginnings of long-term undertakings. These initiatives‘ ultimate
payoff will depend on how fully EPA‘s organization and management
support them and the extent to which needs identified--for more and
better data; for scientific research; for a restatement of strategic
goals; and for a refinement of performance goals, objectives, and
measures--are addressed in a determined, systematic, and sustained
fashion over a period of years. Even the task of revising the agency‘s
strategic goal structure and reducing the number of goals to a few
specifically focused on environmental dimensions will not be an easy
matter on which to achieve consensus and, once agreed upon, to
implement. As one senior EPA official pointed out, this is particularly
true when, as in EPA‘s case, budgeting is tied to the agency‘s
goal structure.
Significant Progress Made in Enhancing EPA‘s Information Security:
The security of EPA‘s information is critical to its mission of
protecting human health and the environment, a fact underscored by the
events of September 11, 2001, and their aftermath. Much of the
sensitive information contained in EPA‘s databases regarding
environmental infrastructure, such as municipal drinking water systems
and the location of stores of toxic chemicals, could be expected to
hold great interest for would-be terrorists and others with criminal
intent. In a review of EPA‘s information security program issued in
July 2000, we found serious and pervasive problems that ’essentially
rendered [the program] ineffective.“[Footnote 9] Our report
characterized the agency‘s security practices at the time as weak and
largely a paper exercise that did little to mitigate risks to the
agency‘s data and systems. We recommended that EPA take a number of
steps to improve security program management and planning, enhance
computer incident management, and strengthen access controls associated
with its major computer operating systems and agencywide network.
Since the issuance of our report, EPA and the agency‘s Office of
Inspector General reported that the agency has made substantial
improvements to its information security program. The agency has
improved its risk assessment and planning processes, implemented major
new technical and procedural controls, issued new policies, initiated a
regular process of testing and evaluation, and devoted significant
attention and resources to improving the technical information
infrastructure and building the management framework for an effective
security program, as documented by EPA‘s Office of Inspector General in
September 2002 and by an August 2002 GAO follow-up on the status of
agency efforts to implement the recommendations in our July 2000
report. Under the leadership of the Office of Environmental Information
(OEI), the agency has been taking steps to ensure appropriate public
access to the information in EPA‘s computer systems, while protecting
the confidentiality and integrity of its information. According to EPA
and the agency‘s Office of Inspector General, specific actions taken to
improve information security and to address problems that we, the
Inspector General, and others have cited, include the following:
* Developing the Information Security Action Plan to guide EPA‘s
revised security program and respond to the findings and
recommendations of our July 2000 report.
* Establishing the Technical Information Security Staff, within OEI, to
review EPA‘s security accomplishments, manage the agency‘s security
efforts, and evaluate needs for future security governance.
* Designating program and regional Information Security Officers,
who are responsible for coordinating security activities, providing
guidance, reviewing security practices, and informing colleagues of
their information security responsibilities.
* Defining, in consultation with EPA‘s state and tribal partners,
levels of security that must be met for the exchange of information
across the National Environmental Information Exchange Network. These
levels range from Level 1 (public information, available to all users
without authentication) to Level 4 (information requiring the highest
levels of proof of the integrity and origin of data, along with
confidentiality and third-party verification).
In an August 2002 follow-up on the status of EPA‘s efforts to address
our July 2000 report‘s recommendations, we concluded that although
some work remained to be completed to address the problems cited in
the report, EPA had made sufficient progress to justify closing out the
recommendations. However, notwithstanding the progress EPA has made in
this area, EPA‘s Inspector General continues to identify EPA‘s security
program management as a management challenge (albeit of a lower order
than in years past). As the Inspector General has noted, the dynamic
nature of security threats will require continued attention and
vigilance on the part of EPA management. The agency, moreover, will
need to strive to build and maintain a strong centralized security
program with an oversight process that identifies and adequately
addresses vulnerabilities and to ensure that information resources and
environmental data are secure. Given the agency‘s decentralized
organizational structure, it is essential for the success of EPA‘s
information security program that OEI exercise a strong leadership and
monitoring role. A major continuing challenge will be to provide the
public with access to a wide range of environmental information, while
also protecting against the use of this information in ways that could
harm the environment or public health and safety.
EPA‘s Recently Completed Information Strategy Needs to Be Implemented
Systematically and Revised Periodically in Light of Progress and
Changing Circumstances:
In a September 1999 report, we recommended that EPA develop a
comprehensive information management strategy that would (1) establish
milestones and identify the resources needed to fill key data gaps;
(2) identify and develop necessary data standards; and (3) coordinate
its data standardization efforts with other federal agencies, the
states, and other entities.[Footnote 10] In our January 2001 report on
EPA‘s major management challenges and program risks, we reported that,
beyond agreeing with our 1999 recommendation, EPA had made limited
progress in developing a comprehensive information management strategy
to ensure the completeness, compatibility, and accuracy
of data.[Footnote 11]
In July 2002, EPA issued its ’Strategic Information Plan: A Framework
for the Future,“ which largely responds to our 1999 recommendation. The
plan, developed by EPA‘s Office of Environmental Information, under the
direction of the Chief Information Officer, sets a new vision for EPA‘s
information management, which is to provide government and citizens
with fast, relevant, and integrated information about environmental and
public health conditions, trends, and potential threats. The plan
envisions establishing a system that advances the creation, management,
and use of information as a strategic resource at EPA and stresses the
need to streamline and strengthen the agency‘s information management
infrastructure to improve the effectiveness and efficiency of its
operations and programs. The plan sets six specific information
management goals for the agency: (1) improve the use of environmental
information, (2) collect appropriate data, (3) strengthen EPA‘s
information infrastructure, (4) enhance access to information,
(5) adopt an agencywide approach to using information to make
management decisions, and (6) invest in human capital for
information management.
EPA‘s Information Plan provides a much needed long-term strategic
vision for the information management function. It charts the course
the agency will need to pursue in coming years, in consultation and
collaboration with its state and tribal partners and other key
stakeholders, to design and implement systems and services that are
aimed at streamlining data collection, making the Internet the method
of choice for reporting and exchanging information, and making more
effective use of the information it collects.
As previously noted, a number of initiatives are already under way
within the agency to implement aspects of the goals laid out in the
strategic plan, including data quality improvement, the development and
implementation of data standards, and building networks for data
exchange. Missing in EPA‘s strategic information plan, however, are
indications of priorities, milestones, and estimated resource
requirements that could drive forward movement and provide a more
detailed road map for goal implementation. We recommended such an
’action plan“ in our September 1999 report and continue to believe that
an annual or multiyear action plan is needed to translate the ’vision“
embodied in the strategic plan into specific actions that will advance
goal achievement. An action plan would lay out in some detail and
specificity the discrete goal-related measures that will be taken
during the planning period. It would also establish target dates for
the completion of action and identify resources required to meet these
milestones. Action plans, we believe, could ensure that EPA‘s strategic
plan becomes and remains a living document that informs agency
decision making; guides investments in information infrastructure,
technology, and human capital; and evolves over time to reflect
achievements, changed circumstances, and new imperatives.
EPA Needs to Implement a Systematic and Comprehensive Human Capital
Approach:
High-performing organizations in the private and public sectors have
long understood the relationship between effective ’people management“
and organizational success. An organization‘s people--its human
capital--are its most critical asset in managing for results. EPA, like
many other federal agencies, has historically given insufficient
attention to strategically managing its human capital. As a result, EPA
faces critical agencywide human capital challenges that, if not
addressed, will limit its ability to achieve its mission. Specifically,
the agency has yet to determine the number of employees it needs to
accomplish its mission objectives, the technical skills required, and
how to best allocate employees among EPA‘s strategic goals and
geographic locations. Furthermore, with a substantial portion of its
workforce nearing retirement age, it is imperative that EPA fully
prepare for the resulting loss of leadership, institutional knowledge,
and scientific expertise.
To its credit, EPA has taken some steps in recent years to improve its
human capital management. The agency has conducted a workforce study
that identifies some of the general skills and abilities that EPA
employees need. Furthermore, the agency has developed a human capital
strategy that identifies EPA‘s vision for its people, its core values,
and its major human capital goals. However, EPA is far from being able
to implement a systematic and comprehensive human capital approach that
will enable the efficient and effective achievement of its mission
objectives. Specifically, EPA needs to (1) develop a system for
determining the number of employees and skills required to meet its
mission objectives and allocating staff according to identified mission
needs and (2) recruit, train, and develop employees to ensure that EPA
will have the leadership, institutional knowledge, and scientific
expertise needed to accomplish its mission, both now and in the future.
EPA Needs to Assess Workforce Requirements and Allocate Staff to
Accomplish Mission Objectives:
High-performing organizations identify their current and future human
capital needs, including the appropriate number of employees, the key
skills required for mission accomplishment, and the appropriate
deployment of staff across the organization. They then identify and
address any human capital gaps or surpluses. However, EPA, like many
other federal agencies, has yet to determine its current or future
human capital needs for accomplishing its mission or to fully inventory
the skills in the current EPA workforce. EPA‘s 1999 workforce study
identified general skills needed by EPA employees (such as effective
communication and collaboration) but did not identify the scientific or
technical skills critical to EPA‘s mission. Nor did the study address
the number of staff or the skills EPA needs agencywide and by
geographic location. In response to a 2001 Office of Management and
Budget (OMB) request, EPA, along with other federal agencies, prepared
a workforce analysis that included information on the number of its
supervisors and managers, their grade level, their location, and the
number of people they oversee, and an evaluation of the skills of the
workforce. However, because EPA has not yet comprehensively assessed
its workforce, EPA‘s human resource managers told us that the analysis
that it submitted to OMB is only a starting point for a systematic
workforce analysis.
Without reliable and valid workforce information, EPA cannot ensure
that it is hiring the right number and type of people or allocating
existing staff resources to effectively meet current or future mission
needs. During the past 12 years, when the size of the civilian federal
workforce was reduced significantly, EPA increased its workforce from
15,277 in fiscal year 1990 to 17,802 in fiscal year 2002. In doing so,
EPA hired thousands of employees without systematically considering the
workforce impact of the changes in environmental laws and regulations,
the technological advances, or the expansion in state environmental
staff that occurred during the 1990s. Similarly, EPA has yet to factor
these workforce changes into its allocation of existing staff resources
to its headquarters and regional offices to meet its strategic goals.
Furthermore, if EPA should need to downsize, as other federal agencies
have done, it would not have the information needed to ensure that
staff reductions could be absorbed with minimal impacts on mission
objectives. For example, the Congress denied EPA‘s proposal to downsize
its enforcement staff in order to shift resources to state enforcement
grants because EPA had no workforce information to demonstrate that
staff reductions would not jeopardize environmental enforcement.
In July 2001, we recommended that EPA develop a system for workforce
allocation and deployment that is explicitly linked to the agency‘s
strategic-planning efforts and is based on the systematic efforts of
each major program office to accurately identify the size of the
workforce, the deployment of staff geographically and organizationally,
and the skills needed to support EPA‘s strategic goals.[Footnote 12]
EPA has begun to develop a system, known as the ’national strategic
workforce planning system,“ that may substantially implement this
recommendation. The system is to be used by EPA regions and in
headquarters offices to assess workforce needs. According to EPA, the
system will, among other things, identify the technical skills and the
number and type of positions required, inventory the skills of the
current workforce, examine attrition rates, and forecast the number of
new hires required. EPA issued a methodology for the workforce-planning
system in September 2002 and has begun implementing the system in
several headquarters offices and in the Chicago, Kansas City, and
Seattle regional offices. EPA expects agencywide implementation of the
workforce-planning system to be under way by late 2003.
Although EPA‘s proposed workforce-planning system appears promising, it
is too early to determine how it will affect EPA‘s ability to
systematically allocate staff. As EPA‘s Deputy Assistant Administrator,
Office of Administration and Resources Management, acknowledged, EPA
has made progress in workforce planning, but the most difficult
challenges remain--such as using workforce data to make difficult
staffing decisions. For example, EPA‘s workforce planning will need to
take into account the agency‘s extensive use of grants to states and
awards to contractors to perform EPA‘s work. The agency estimates that
its contracted work alone would require an additional 11,000 to 15,000
employees if contractors were not used. Thus, EPA must plan for a
workforce that is adept at both delivering services directly and
managing the cost and quality of services delivered by third parties on
the government‘s behalf. In addition, EPA must work diligently and
effectively to gain support for its workforce-planning efforts within
both the executive and legislative branches.
Moreover, EPA‘s workforce-planning system, along with the agency‘s
other human capital efforts, will need to incorporate the implications
of major management initiatives. Specifically, EPA has undertaken a
comprehensive effort to assess the state of the environment, identify
priorities for environmental and human health improvements, and focus
its resources on achieving results in the areas of greatest concern.
EPA is currently working to integrate its ’state of the environment“
effort into its agencywide strategic plan. According to EPA officials,
the revised strategic plan will largely determine EPA‘s workforce
needs, and workforce allocation will be tied to the relative priority
assigned to strategic goals. Once the strategic plan is finalized
(expected in late 2003), EPA will then need to determine its impact on
the agency‘s human capital resources and systems.
EPA Needs to Ensure Continuity of Leadership and Mission-Critical
Skills:
To ensure a continuing ability to accomplish their mission objectives,
federal agencies need to aggressively pursue comprehensive succession
planning and executive development to address the loss of leadership
and institutional knowledge that will result from Senior Executive
Service (SES) retirements. At EPA, 162 senior executives, or
60 percent, will become eligible for retirement in the next 5 years. As
shown in figure 1, potential retirements may create particularly severe
leadership shortages in some EPA units and regions, such as region 7
(Kansas City) and region 10 (Seattle), where about 86 percent of the
executives will become eligible to retire over the next 5 years.
Figure 1: Percentage of Total SES Staff Eligible to Retire by 2008, by
EPA Unit/Region:
[See PDF for image]
[End of figure]
Note: GAO‘s analysis of EPA‘s data.
We reported in July 2001 that EPA did not have succession planning in
place to ensure continuity in the agency‘s leadership and to prepare
for the management losses that would likely occur, as many executives
become eligible for retirement.[Footnote 13] We recommended that EPA
work toward designing succession plans to maintain leadership
continuity that are based on (1) a review of current and emerging
leadership needs and (2) identifying sources of executive talent within
and outside EPA. In response, EPA reinstated a development program for
SES candidates, which is expected to prepare 51 candidates for
leadership positions. According to EPA, a number of these candidates
may be ready in the summer of 2003 for Office of Personnel Management
certification as senior executives. In addition, EPA has implemented a
management training program for new and current mid-level supervisors.
However, it remains to be seen how successful these programs will be in
developing the executive resources that the agency needs. EPA
implemented the management development programs before assessing how
revising its strategic objectives would affect its current and emergent
leadership needs. Therefore, EPA may need to modify these programs once
its strategic plan is finalized.
EPA also faces challenges in sustaining adequate scientific expertise
to carry out its mission. EPA acknowledges that its efforts to protect
human health and the environment must be based on the best available
science. However, EPA‘s scientific performance has been criticized many
times in reports by the National Research Council, EPA‘s Science
Advisory Board, and GAO, among other organizations, and in countless
complaints and lawsuits from stakeholders. In the National Research
Council‘s opinion, the concerns about EPA‘s scientific performance are
related to the agency‘s ability to attract and retain first-rate
scientific talent, given intense job market competition from the
private sector and academic institutions. EPA‘s challenge to maintain
adequate scientific expertise could intensify in the coming years, as
many agency scientists become eligible for retirement. As shown in
figure 2, a significant portion of EPA‘s key scientific and technical
staff--environmental protection specialists, biological scientists,
ecologists, toxicologists, environmental engineers, physical
scientists, and health physicists--will become eligible for retirement
by the end of 2008.
Figure 2: Percentage of EPA Staff in Key Scientific/Technical
Occupations Eligible for Retirement by 2008:
[See PDF for image]
[End of figure]
Note: GAO‘s analysis of EPA‘s data.
EPA can fill the gaps in scientific expertise that may arise from these
retirements through targeted recruitment efforts to hire ’outside“
expertise and by training current staff to develop the needed
expertise. To improve its ability to recruit highly qualified
scientists, EPA is considering the use of special hiring authority
modeled on a National Institutes of Health program to select and retain
senior scientists. Under this special authority, EPA would establish
competitive, limited-term (although renewable) appointments for
research scientists and engineers. The agency believes that the special
authority would increase EPA‘s flexibility to respond to emerging
environmental problems, establish a performance-based career path for
scientists, and reward scientific staff working on high-priority
environmental research. While such special authority might hold
promise, EPA officials acknowledge that the initiative is still in the
developmental stage. Therefore, it is too early to say how well the
proposed personnel authority would help EPA select and retain highly
qualified scientists. In addition to recruiting outside scientific
talent, EPA also needs to help current employees upgrade their
scientific expertise through internal or external training
opportunities. Thus far, however, EPA‘s strategy for developing its
workforce has aimed to enhance general competencies, such as
communication and collaboration, rather than specific mission-critical
scientific or technical skills.
EPA and State Efforts to Implement Innovative Regulatory Approaches May
Need Legislative Support:
For some time now, EPA has been counting on its efforts to ’reinvent“
environmental regulation to improve the efficiency and effectiveness
with which the agency and the states carry out their environmental
responsibilities. A key agency assumption has been that considerable
innovation can take place within the existing statutory environmental
framework. However, our work shows that limited progress in regulatory
innovation has been made to date, and that statutory constraints have
served as a major barrier. Although EPA has recently made vague
references to the impetus that statutory revisions could provide to
regulatory innovation, the agency needs to more clearly state the
legislative changes it would endorse to overcome constraints
to innovation.
EPA Has Tried a Variety of Initiatives to ’Reinvent“ Environmental
Regulation:
Under the existing federal approach to environmental protection, EPA,
pursuant to statutes such as the Clean Air Act and Clean Water Act,
prescribes regulations with which states, localities, and private
companies must comply. But this approach has often been criticized in
recent years for being costly, inflexible, and ineffective in
addressing some of the nation‘s most pressing environmental problems.
For example, the National Academy of Public Administration recently
reported that although traditional regulatory approaches manage to keep
most forms of industrial pollution in check, they are too narrow in
scope to affect many other more difficult problems and sources of
pollution or environmental degradation, such as diffuse sources of
water pollution caused by urban and agricultural runoff. Moreover, even
where existing approaches have succeeded in curtailing pollution from
major industrial sources, they have often been costly and have provided
regulated entities with little incentive to reduce pollution below
mandatory compliance levels.
EPA responded to such concerns during the 1990s with a variety of
initiatives intended to encourage innovative regulatory strategies that
could streamline environmental requirements while encouraging more
effective means of protecting the environment. Among the agency‘s
’flagship“ programs was Project XL, which encouraged individual
regulated facilities to propose projects that EPA would test to
determine whether alternative approaches could achieve compliance at
lower cost and produce greater environmental benefits. In addition to
pursuing a number of other ’high-priority actions“ and a number of
’other significant actions“ to encourage innovation, EPA stressed that
the agency‘s overall support for the reinvention effort was part of an
effort to transform the agency‘s culture to encourage staff to think
about and embrace innovative approaches to environmental regulation.
EPA‘s ’reinvention“ efforts of the 1990s encountered a number of
problems both within and outside the agency. These problems illustrated
issues that needed to be resolved in order for environmental regulation
to truly be ’reinvented.“ Specific examples follow:
* Key stakeholders in the reinvention process expressed concern over
the large number of complex and demanding initiatives under way--as
well as confusion over the underlying purpose of some of the agency‘s
major initiatives.
* EPA had difficulty in achieving ’buy-in“ among the agency‘s rank and
file, who were accustomed to the long-standing regulatory structure.
* EPA had difficulty in achieving agreement among external stakeholders
(including federal and state regulators and representatives of industry
and environmental organizations) in a number of its reinvention
efforts, particularly when stakeholders perceived that unanimous
agreement was required before progress could be made.
* EPA had a mixed record in evaluating the success of many of its
initiatives and was therefore unable to provide convincing evidence
to external stakeholders of the merits of pursuing an alternative
regulatory strategy.
Of perhaps greatest significance, much of the regulated community--
whose participation is crucial for reinvention to succeed--expressed
strong reservations about the prospects for reinvention within the
current statutory framework. In fact, a study by Resources for the
Future concluded that ’industry participants in reinvention programs
generally steer the programs to peripheral matters because their
counsels general caution them against taking any action that might
result in litigation.“[Footnote 14] Similarly, several of our studies
found that states‘ experimentation with pollutant trading and other
innovative environmental strategies was often constrained by the
statutory framework.[Footnote 15]
Recent GAO Findings Confirm Limitations on Ability to Innovate under
Current Statutory Framework:
In January 2002, we issued a report that cast doubt on EPA‘s ability to
achieve significant innovation in the absence of legislative
changes.[Footnote 16] The report contained detailed analyses of 20
initiatives that 15 states cited as being among the key initiatives
they had pursued. Specifically, we asked state environmental officials
to rank, in order, the most serious obstacles that had impeded progress
in pursuing these initiatives successfully. Among the most serious
impediments identified were federal regulations governing the
implementation of specific programs (ranked first or second in 12 of
the 20 cases).[Footnote 17] EPA has long maintained that it could
address these kinds of impediments through informal mechanisms and
administrative actions. However, our report countered this claim,
noting that EPA‘s ability to inject flexibility into its regulatory
programs was limited without clear statutory authorization.
Specifically, we concluded that current legislation does not contain
explicit language authorizing the use of innovative environmental
approaches in lieu of specific regulatory requirements, and the absence
of this ’safe legal harbor“ for EPA has been a significant obstacle to
states and others in their efforts to test innovative proposals. The
absence of this ’safe harbor“ has also tended to reinforce the cultural
resistance to innovation that EPA is seeking to change.
EPA‘s key initiatives have achieved varied success, further
underscoring questions about how well EPA‘s reinvention efforts will
fare without some kind of legislative support. For example, through the
end of 2000, the agency had invested considerable time and resources in
pursuing innovations under Project XL. The Administrator had set and
achieved the goal of signing agreements for at least 50 XL projects by
the end of that year. However, no new projects have been initiated, and
EPA reinvention officials indicated recently that the program is now
changing focus dramatically. Ongoing projects will continue, but any
new projects will need to meet a more selective test of being ’bigger,
bolder, and more strategic.“ EPA officials cited Massachusetts‘
Environmental Results Program as an example of a project meeting this
test because the underlying concepts apply broadly to a number of
facilities, as opposed to the single-facility focus of many past
XL projects.
EPA has recently taken steps to make its innovation efforts more
systematic and organized. In April 2002, the Administrator released a
new innovation strategy to help the agency strengthen innovation
partnerships with states, focus innovation on priority issues,
diversify environmental approaches, and foster a more innovative EPA
culture.[Footnote 18] To support the implementation of the strategy,
EPA has launched a pilot grant program to fund state innovations that
address the environmental priorities identified in the strategy. EPA
also plans to form the National Center for Environmental Innovation to
support implementation of its strategy, provide leadership on
environmental innovation, and manage key innovation programs. To help
assess the results of its efforts, EPA staff are tracking innovations
and reporting on them quarterly to agency management.
EPA‘s latest approach to bolstering environmental innovation is
understandable, given the fundamental barriers to broader regulatory
experimentation posed by the current statutory framework. However,
unless these statutory barriers are addressed more directly, it remains
to be seen whether EPA‘s recent efforts to promote innovation will fare
much better than its past efforts. EPA‘s innovation strategy hints at
some kind of statutory encouragement of regulatory innovation, noting
that the agency plans to ’engage in dialogue with parties that are
interested in applying the flexibility and multimedia dimensions of
these and other innovation programs more broadly through new
legislative authority.“ Such cryptic endorsement of legislative change
appears to be a small step in the right direction, but alone, it will
do little to encourage states and the regulated community to
participate actively in innovative projects. Nor will it provide
tangible assurances for the environmental community and other interest
groups that such projects can proceed without damaging the environment.
EPA needs to exert leadership in this area by articulating a clearer
and more specific endorsement of legislation that would more directly
address the root cause of the problems that have, for so many years,
impeded its regulatory reinvention efforts.
EPA Needs to Improve Its Grants Management to Better Achieve Its
Mission Objectives:
Effective grants management is essential for any federal agency that
uses grants as a vehicle to commit taxpayer money toward achieving
public purposes. Effective grants management is of particular
importance for EPA because it typically spends about half of its annual
budget on grants. In fiscal year 2002, EPA expended about $4 billion of
its $7.8 billion budget[Footnote 19] on grants, which it distributed to
over 3,300 recipients, including state and local governments, tribes,
universities, and nonprofit organizations. EPA awards grants to support
its ongoing programs--such as hazardous waste cleanup and wastewater
treatment--as well as to fund discretionary short-term projects--such
as training and outreach. The wide diversity of grant recipients and
wide range of activities that EPA grants support present the agency
with a formidable challenge to ensure that all awarded grants are used
to achieve the agency‘s overall mission of protecting human health and
the environment.
For many years, our reports and numerous other internal and external
agency management studies have called for EPA to manage its resources
to achieve environmental results. With such a high percentage of its
resources devoted to grants, the agency‘s ability to manage for results
largely depends on how well it manages its grants. However, in many
cases, EPA has not managed its grants so that they are effectively used
to achieve environmental results. EPA‘s project grants have often been
awarded without a clear plan for how the project will help achieve
EPA‘s mission or produce tangible environmental benefits. Furthermore,
after years of improvement initiatives, EPA still struggles to
efficiently and effectively administer its grant process to ensure that
available resources deliver the maximum effect.
EPA Needs to Better Plan and Measure Grant Results:
To help federal agencies more effectively use their resources to
achieve results, the Government Performance and Results Act of 1993
requires federal agencies to prepare strategic plans and goals and to
devise measures to gauge progress toward these stated objectives. Since
submitting its first strategic plan to the Congress in 1997, EPA has
continued to refine its plans, goals, and performance measures to help
it focus agency resources on environmental results. However, EPA‘s
planning and performance measurement for project grants has often been
disconnected from EPA‘s efforts to manage for an improved environment,
as shown below:
* EPA selects project grants before considering how the projects would
contribute to achieving the agency‘s strategic goals. In 2001, we
reported that EPA program officials treated EPA‘s strategic goals and
objectives not as a tool to guide the selection of project grants, but
rather as a clerical tool for categorizing grants after the funds were
already awarded.[Footnote 20] By assessing the relevance of these
grants to EPA‘s strategic plan after the selection process, EPA cannot
ensure that it is selecting the projects that will best help the agency
accomplish its mission.
* EPA often does not require grantees to submit work plans to explain
how a project would achieve measurable environmental results. In 2002,
EPA‘s Inspector General reported that EPA approved grantee work plans
without determining the projects‘ long-term human health and
environmental outcomes.[Footnote 21] Instead, EPA funded grants on the
basis of work plans that focused on short-term, procedural results,
such as meetings or conferences.
* EPA often does not measure what results are being achieved with
grants. We reported in September 2000 that EPA did not have criteria
to measure the effectiveness of its Science to Achieve Results grant
program.[Footnote 22] Instead, EPA‘s management of the program focused
on the procedures and processes of awarding grants. As a result, EPA
was uncertain about what the program was achieving. Similarly, the EPA
Inspector General reported in 2002 that, in many cases, EPA had not
measured whether the grants it had awarded were achieving meaningful
environmental benefits.[Footnote 23] In fact, for almost half of the
42 grants reviewed, EPA did not even attempt to measure the projects‘
outcomes. In some cases, the Inspector General concluded that what the
grant funding had accomplished was unknown or unclear.
EPA has acknowledged that its planning and performance measurement for
grants need to better focus on environmental results, and has promised
to take corrective action. EPA has recently announced that it will
upgrade its training for project officers and managers to emphasize the
importance of planning grants to achieve environmental results. EPA has
also announced that it will issue guidance to help ensure that all
grant work plans include a discussion of how grantees plan to measure
and report on environmental progress. However, the agency has also
expressed reservations about the extent to which grant projects can be
planned to achieve environmental results. The Assistant Administrator
for EPA‘s Office of Administration and Resources Management stated that
the Paperwork Reduction Act and OMB regulations may affect EPA‘s
ability to request that recipients collect information to measure the
results of EPA-funded activities. The Assistant Administrator also
stated that the limitations that currently exist in environmental
outcome measurement could affect the agency‘s ability to measure the
results of funded projects.
Planning for grants to achieve environmental results--and measuring
those results--is a difficult challenge, especially for projects such
as outreach or training. However, in view of the fact that EPA spends
about half of its budget on grants, it is imperative that EPA
wholeheartedly accept this challenge. Certain EPA-funded projects have
already demonstrated that outcome-based grant planning and measurement
are possible. For example, in seeking funding for outreach to local
building code officials about indoor air quality issues, a nonprofit
organization designed a grant project to deliver tangible environmental
results. That is, the project measured results in terms of actions that
affect human health--in this case, the construction of homes that
resist the release of radon into the indoor air. Regarding the
Assistant Administrator‘s concerns about the state of environmental
outcome measurement, it should be noted that EPA‘s Office of
Environmental Information and Office of Research and Development are
currently collaborating on developing a new generation of outcome-based
goals and measures using environmental indicators to help improve
performance measurement. As EPA improves its planning and measuring of
environmental results, it is important that the agency fully integrate
these improvements into its grants planning and performance management.
EPA Needs to Better Administer Grant Resources to Maximize Results:
Along with improved planning and performance measurement for grants,
EPA also needs to improve its stewardship of grant funding to maximize
the impact of available resources. The effective management and
oversight of grants helps ensure that the agency funds the best
projects at the least cost, that grant money is properly used to
accomplish the intended results, and that funded projects are completed
in a timely manner. Historically, EPA has experienced various problems
in grants management and oversight, and these problems have persisted
in recent years, as shown below:
* EPA has not ensured that it obtains the best price through
competition for project grants. EPA‘s Inspector General reported in
2001 that EPA officials gave grants to the same recipients year after
year without competition or selected certain grantees without
competition on the basis of the undocumented belief that the grantee
was ’uniquely qualified.“[Footnote 24] In 2002, the Inspector General
reported that grant recipients, in turn, awarded contracts for EPA-
funded work without determining the reasonableness of the contractor‘s
price, instead selecting contractors on the basis of familiarity or in
some cases awarding contracts to their own subsidiaries
without competition.[Footnote 25]
* EPA has not provided effective oversight to ensure that grant funds
are used only for allowable purposes. In 2001, we reported that EPA‘s
oversight of nonprofit grantees was not sufficiently rigorous to
uncover expenditures for unallowable costs.[Footnote 26] Specifically,
we found that EPA conducted oversight reviews of only 4 percent of its
nonprofit grantees and that these reviews were not designed to identify
unallowable costs.
* EPA has sometimes not ensured that its grantees have proper financial
and internal controls in place to ensure that federal funds are
properly used. For example, the EPA Inspector General found that one
grantee could not adequately account for over half of its $300,000 in
EPA grant funding. Another grantee submitted multiple financial status
reports showing conflicting ending balances for its grant funding.
* EPA has often not ensured that grant projects are completed in a
timely manner. In September 2000, we reported that EPA had not tracked
its Science to Achieve Results research grants to ensure their on-time
completion.[Footnote 27] We found that 144 of the nearly 200 grantees
reviewed had missed their deadline for submitting final reports, even
after extensions had been granted.
* EPA does not have an automated data system that it can rely upon to
provide consistent and accurate information to support grants
management. EPA‘s system does not generate reports needed to
effectively monitor grants, and individual grantees do not always have
unique identifiers in the system but may appear under multiple names or
identification numbers.
EPA has recently taken various actions intended to improve its
management and oversight of the grants it awards, such as (1) issuing
an order to require competition in the award of many grants and to
require detailed justifications for noncompetitive awards;
(2) conducting training sessions about competitive procurement
requirements for grant recipients and EPA personnel; (3) revising
agency policy to require EPA staff to conduct more on-site reviews of
grant recipients and to check for unallowable costs in grantee
spending; (4) developing a new data system to better track funding
amounts, project milestones, and agency oversight activities; and
(5) developing a long-term strategic plan for grants management that is
intended to improve accountability, coordination, and resource
management for EPA grants.
Although these actions appear promising, EPA has a long history of
undertaking initiatives to improve grants administration, and, despite
years of corrective actions, problems persist. The EPA Inspector
General recently concluded that some agency actions to address grant
weaknesses have not been effective, and in May 2002 recommended that
EPA designate grants management as a material weakness under the
Federal Managers‘ Financial Integrity Act. OMB also recommended that
EPA identify grants management as a material weakness. OMB believes
that a strong grants competition policy, along with improved
prioritization, oversight, and enforcement procedures, is needed to
improve EPA‘s grants management and will ultimately lead to better
environmental outcomes.
Notwithstanding the Inspector General‘s and OMB‘s recommendations, in
November 2002, the Administrator concurred with the recommendations
of EPA senior managers not to declare the agency‘s grants management to
be a material weakness under the Integrity Act. The agency justified
its decision on the basis of the policies it had recently issued to
improve competition in awarding grants and to strengthen the agency‘s
monitoring of grant recipients. EPA does, however, consider grants
management to be an ’agency level“ weakness under the Integrity Act--a
weakness that does not merit the attention of the President or Congress
but is significant enough to require regular reporting to the
Administrator. While EPA‘s classification of grants management under
the Integrity Act may be the subject of debate, it is clear that
improving grants management must be a top priority for the agency. With
about half of EPA‘s budget devoted to grants, the agency‘s ability to
efficiently and effectively accomplish its mission largely depends on
how well it manages its grant resources.
EPA Needs to Improve Internal Controls over Its Financial Reporting:
EPA‘s Inspector General issued an unqualified opinion on EPA‘s
consolidated financial statements for the fiscal year ended 2001.
However, when it considered internal controls over financial reporting,
the Inspector General identified three reportable conditions that could
adversely affect the agency‘s ability to process, summarize, and report
financial statement data. Additionally, in its assessment of compliance
with laws and regulations that relate to financial statement reporting,
the Inspector General identified two instances of noncompliance, only
one of which was substantial. While noteworthy, neither instance of
noncompliance would result in material misstatements to the audited
financial statements.
EPA had three reportable conditions in fiscal year 2001. The first was
its failure to implement Statement of Federal Financial Accounting
Standard (SFFAS) No. 10, Accounting for Internal Use Software, until
the end of fiscal year 2001, even though the standard was applicable
for the entire fiscal year. SFFAS No. 10 requires the capitalization of
the full cost (direct and indirect) of internal use software whether it
is commercial off-the-shelf, contractor developed, or internally
developed. In addition, some of the supporting documentation used to
identify capitalized software cost was insufficient to determine
whether such costs exceeded the capitalization threshold. Because EPA
issued guidance at the end of fiscal year 2001 for capitalizing
internally developed software, the Inspector General did not believe a
recommendation was warranted.
The second reportable condition concerned the interagency agreement
invoice (IAG) approval process. EPA project officers did not fulfill
oversight duties related to reviewing and approving interagency
agreement invoices. The Inspector General has continued to find
instances where program offices did not receive support for IAG
invoices paid, did not promptly approve payable IAG invoices, or did
not identify the proper account to be charged. EPA agreed with the
Inspector General‘s findings and, according to the agency‘s management,
EPA has implemented an automated project officer approval system that
addresses this finding.
The third reportable condition dealt with automated application
processing controls for EPA‘s Integrated Financial Management System
(IFMS). The lack of system documentation made it impossible to assess
the adequacy of the automated internal control structure as it related
to automated input, processing, and output controls for the IFMS
system. The Inspector General found that EPA has taken tangible steps
to replace the IFMS with the Financial Replacement System (FinRS)
project. However, the Inspector General will not be able to
sufficiently assess the adequacy of the automated internal control
structure until the new system is in place.
The Inspector General‘s tests of compliance with the Federal Financial
Management Improvement Act of 1996 disclosed an instance where EPA‘s
financial management systems did not substantially comply with SFFAS
No. 4, Managerial Cost Accounting Concepts and Standards for the
Federal Government. Specifically, EPA did not comply with the
requirements to provide cost per output to management in a timely
fashion. In addition, under EPA‘s current cost-accounting structure,
when costs by output are produced, such costs are not described in
sufficient detail to be useful to managers. EPA took exception to these
Inspector General findings, stating that the agency believes it is in
compliance with the managerial cost accounting standard. According to
EPA‘s management, cost-per-output information is provided to program
managers on a regular basis. The resolution of this issue will likely
be the topic of future discussions between EPA management and the
Inspector General.
EPA was noncompliant with appropriation law when making disbursements
for grants funded with more than one appropriation. Specifically,
disbursements for these grants were made using the oldest available
funding (appropriation) first, which might or might not have been the
appropriation that benefited from the work performed. Consequently, EPA
was not in compliance with title 31, U.S. Code, section 1301, which
requires EPA to match disbursements to the benefiting appropriation. In
fiscal year 2001, EPA adopted new procedures for allocating costs on
such grants for new awards. Therefore, it is anticipated that the
problem will be corrected as the remaining obligated balances are
liquidated.
Although the Inspector General has identified several internal control
weaknesses, it appears that corrective actions are well under way. The
successful completion of these efforts to correct identified reportable
conditions and compliance issues will assist EPA in providing its
managers and the Congress with more timely and reliable financial
information.
[End of section]
GAO Contacts:
Subjects covered in this report: Improving environmental information
; Strengthening EPA‘s human capital management
; Making regulatory innovation successful
; Improving EPA‘s grants planning and management; Contact person: John
B. Stephenson, Director; Natural Resources and Environment; (202) 512-
3841; stephensonj@gao.gov.
Subjects covered in this report: Maintaining EPA‘s information
security; Contact person: Robert F. Dacey, Director; Information
Technology; (202) 512-3317; daceyb@gao.gov.
Subjects covered in this report: Accounting for EPA‘s financial
resources; Contact person: McCoy Williams, Director; Financial
Management and Assurance; (202) 512-6906; williamsm1@gao.gov.
[End of table]
[End of section]
Related GAO Products:
Performance and Accountability Series:
Major Management Challenges and Program Risks: A Governmentwide
Perspective (GAO-01-241, January 2001).
Major Management Challenges and Program Risks: Environmental Protection
Agency (GAO-01-257, January 2001).
High-Risk Series: An Update (GAO-01-263, January 2001).
Environmental and Performance Management Information:
Managing for Results: Agency Progress in Linking Performance Plans with
Budgets and Financial Statements (GAO-02-236, Jan. 4, 2002).
Environmental Information: EPA Needs Better Information to Manage Risks
and Measure Results (GAO-01-97T, Oct. 3, 2000).
Toxic Chemicals: Long-Term Coordinated Strategy Needed to Measure
Exposures in Humans (GAO/HEHS-00-80, May 2, 2000).
Managing for Results: EPA Faces Challenges in Developing
Results-Oriented Performance Goals and Measures (GAO/RCED-00-77,
Apr. 28, 2000).
Water Quality: Key EPA and State Decisions Limited by Inconsistent and
Incomplete Data (GAO/RCED-00-54, Mar. 15, 2000).
Environmental Information: EPA Is Taking Steps to Improve Information
Management, but Challenges Remain (GAO/RCED-99-261, Sept. 17, 1999).
Information Technology and Security:
Computer Security: Progress Made, but Critical Federal Operations and
Assets Remain at Risk (GAO-03-303T, Nov. 19, 2002).
Critical Infrastructure Protection: Significant Challenges Need to Be
Addressed (GAO-02-961T, July 24, 2002).
Information Technology: Enterprise Architecture Use across the Federal
Government Can Be Improved (GAO-02-6, Feb. 19, 2002).
Computer Security: Improvements Needed to Reduce Risk to Critical
Federal Operations and Assets (GAO-02-231T, Nov. 9, 2001).
Information Security: Fundamental Weaknesses Place EPA Data and
Operations at Risk (GAO/AIMD-00-215, July 6, 2000).
Human Capital:
A Model of Strategic Human Capital Management (GAO-02-373SP, Mar. 15,
2002).
Human Capital: Attracting and Retaining a High Quality Information
Technology Workforce (GAO-02-113T, Oct. 4, 2001).
Human Capital: Implementing an Effective Workforce Strategy Would Help
EPA to Achieve Its Strategic Goals (GAO-01-812, July 31, 2001).
Innovative Regulatory Approaches:
Environmental Protection: Overcoming Obstacles to Innovative State
Regulatory Programs (GAO-02-268, Jan. 31, 2002).
Environmental Protection: Challenges Facing EPA‘s Efforts to
Reinvent Environmental Regulation (GAO/RCED-97-155, July 2, 1997).
Environmental Protection: Status of EPA‘s Initiatives to Create a New
Partnership with States (GAO/T-RCED-96-87, Feb. 29, 1996).
EPA Grants Management:
Environmental Protection: Grants Awarded for Continuing Environmental
Programs and Projects (GAO-01-860R, June 29, 2001).
Environmental Protection: EPA‘s Oversight of Nonprofit Grantees‘ Costs
Is Limited (GAO-01-366, Apr. 6, 2001).
Environmental Protection: Information on EPA Project Grants and Use of
Waiver Authority (GAO-01-359, Mar. 9, 2001).
Environmental Research: STAR Grants Focus on Agency Priorities,
but Management Enhancements Are Possible (GAO/RCED-00-170,
Sept. 11, 2000).
Environmental Protection: Grants for International Activities and Smart
Growth (GAO/RCED-00-145R, May 31, 2000).
EPA Financial Management:
Debt Collection Improvement Act of 1996: Major Data Sources Inadequate
for Implementing the Debtor Bar Provision (GAO-02-462, Mar. 29, 2002).
Debt Collection Improvement Act of 1996: Status of Selected Agencies‘
Implementation of Administrative Wage Garnishment (GAO-02-313,
Feb. 28, 2002).
Inspectors General: Information on Resources and Selected
Accomplishments of 18 Inspectors General (AIMD-00-149R, Apr. 14, 2000).
[End of section]
Performance and Accountability and High-Risk Series:
Major Management Challenges and Program Risks: A Governmentwide
Perspective. GAO-03-95.
Major Management Challenges and Program Risks: Department of
Agriculture. GAO-03-96.
Major Management Challenges and Program Risks: Department of Commerce.
GAO-03-97.
Major Management Challenges and Program Risks: Department of Defense.
GAO-03-98.
Major Management Challenges and Program Risks: Department of Education.
GAO-03-99.
Major Management Challenges and Program Risks: Department of Energy.
GAO-03-100.
Major Management Challenges and Program Risks: Department of Health and
Human Services. GAO-03-101.
Major Management Challenges and Program Risks: Department of Homeland
Security. GAO-03-102.
Major Management Challenges and Program Risks: Department of Housing
and Urban Development. GAO-03-103.
Major Management Challenges and Program Risks: Department of the
Interior. GAO-03-104.
Major Management Challenges and Program Risks: Department of Justice.
GAO-03-105.
Major Management Challenges and Program Risks: Department of Labor.
GAO-03-106.
Major Management Challenges and Program Risks: Department of State.
GAO-03-107.
Major Management Challenges and Program Risks: Department of
Transportation. GAO-03-108.
Major Management Challenges and Program Risks: Department of the
Treasury. GAO-03-109.
Major Management Challenges and Program Risks: Department of Veterans
Affairs. GAO-03-110.
Major Management Challenges and Program Risks: U.S. Agency for
International Development. GAO-03-111.
Major Management Challenges and Program Risks: Environmental Protection
Agency. GAO-03-112.
Major Management Challenges and Program Risks: Federal Emergency
Management Agency. GAO-03-113.
Major Management Challenges and Program Risks: National Aeronautics and
Space Administration. GAO-03-114.
Major Management Challenges and Program Risks: Office of Personnel
Management. GAO-03-115.
Major Management Challenges and Program Risks: Small Business
Administration. GAO-03-116.
Major Management Challenges and Program Risks: Social Security
Administration. GAO-03-117.
Major Management Challenges and Program Risks: U.S. Postal Service.
GAO-03-118.
High-Risk Series: An Update. GAO-03-119.
High-Risk Series: Strategic Human Capital Management. GAO-03-120.
High-Risk Series: Protecting Information Systems Supporting the Federal
Government and the Nation‘s Critical Infrastructures. GAO-03-121.
High-Risk Series: Federal Real Property. GAO-03-122.
FOOTNOTES
[1] See U.S. General Accounting Office, Toxic Chemicals: Long-Term
Coordinated Strategy Needed to Measure Exposures in Humans, GAO/
HEHS-00-80 (Washington, D.C.: May 2, 2000).
[2] Pursuant to section 305(b) of the Clean Water Act, states report
biennially to EPA on the quality of their waters. EPA summarizes this
information in a biennial report, the National Water Quality Inventory.
The most recent such report is the report for 2000. For that report,
states assessed only 19 percent of the nation‘s river and stream miles;
43 percent of its total acres of lakes, ponds, and reservoirs; 36
percent of its square miles of estuaries; and 6 percent of its ocean
shoreline miles. Furthermore, as we reported in March 2000, on the
basis of our survey of 50 states and the District of Columbia, only 3
states indicated that they had the majority of the data needed to
identify and assess nonpoint sources of pollution, generally considered
to be the greatest contributor to water quality impairment at present.
[3] See U.S. General Accounting Office, Major Management Challenges and
Program Risks: Environmental Protection Agency, GAO-01-257
(Washington, D.C.: January 2001).
[4] See U.S. General Accounting Office, Environmental Information: EPA
Is Taking Steps to Improve Information Management, but Challenges
Remain, GAO/RCED-99-261 (Washington, D.C.: Sept. 17, 1999).
[5] This standard refers to the classification of biological organisms
in established categories, such as kingdom, phylum, class, order,
family, genus, species, and subspecies.
[6] One such registry, the Environmental Data Registry, contains
descriptive information about data managed by the agency, with special
emphasis on data elements used by EPA‘s national systems. The registry
is a single comprehensive source of information about the definition,
origin, source, and location of environmental data and is the primary
tool used by EPA for implementing data standards.
[7] See U.S. General Accounting Office, Environmental Protection
Agency: Protecting Human Health and the Environment through Improved
Management, GAO/RCED-88-101 (Washington, D.C.: Aug. 16, 1988).
[8] Examples of end outcomes would include ensuring that drinking water
is safe or maintaining healthy air with respect to levels of pollutants
such as carbon monoxide, sulfur dioxide, nitrogen dioxide, and lead.
[9] See U.S. General Accounting Office, Information Security:
Fundamental Weaknesses Place EPA Data and Operations at Risk, GAO/
AIMD-00-215 (Washington, D.C.: July 6, 2000).
[10] See GAO/RCED-99-261.
[11] See GAO-01-257.
[12] See U.S. General Accounting Office, Human Capital: Implementing an
Effective Workforce Strategy Would Help EPA to Achieve Its Strategic
Goals, GAO-01-812 (Washington, D.C.: July 31, 2001).
[13] See GAO-01-812.
[14] See Resources for the Future, Industry Incentives for
Environmental Improvement: Evaluation of U.S. Federal Initiatives
(Washington, D.C.: September 1996).
[15] See U.S. General Accounting Office, Environmental Protection:
Status of EPA‘s Initiatives to Create a New Partnership with States,
GAO/T-RCED-96-87 (Washington, D.C.: Feb. 29, 1996). Also, see U.S.
General Accounting Office, Environmental Protection: Challenges Facing
EPA‘s Efforts to Reinvent Environmental Regulation, GAO/RCED-97-155
(Washington, D.C.: July 2, 1997).
[16] See U.S. General Accounting Office, Environmental Protection:
Overcoming Obstacles to Innovative State Regulatory Programs,
GAO-02-268 (Washington, D.C.: Jan. 31, 2002).
[17] States also cited as a significant obstacle a cultural resistance
among many in EPA toward alternative approaches--a resistance that,
they maintained, often manifested itself in a lengthy and costly EPA
review of their proposals. But this cultural resistance was often tied
to the regulations themselves--participants were often concerned that
strict application of the regulations was needed to reduce the risk of
lawsuits filed by private interest groups.
[18] See Environmental Protection Agency, Innovating for Better
Environmental Results (April 2002).
[19] The fiscal year 2002 budget amount does not include unobligated
balances from previous budget authority.
[20] See U.S. General Accounting Office, Environmental Protection:
Information on EPA Project Grants and Use of Waiver Authority,
GAO-01-359 (Washington, D.C.: Mar. 9, 2001).
[21] See EPA Inspector General, Surveys, Studies, Investigations, and
Special Purpose Grants, Report No. 2002-P-00005 (Mar. 21, 2002).
[22] See U.S. General Accounting Office, Environmental Research: STAR
Grants Focus on Agency Priorities, but Management Enhancements Are
Possible, GAO-RCED-00-170 (Washington, D.C. Sept. 11, 2000).
[23] See footnote 21.
[24] See EPA‘s Competitive Practices for Assistance Awards, Report No.
2001-P-00008 (May 21, 2001).
[25] See Environmental Protection Agency, Procurement Made by
Assistance Agreement Recipients Should Be Competitive, Report No. 2002-
P-00009 (Mar. 28, 2002).
[26] See U.S. General Accounting Office, Environmental Protection:
EPA‘s Oversight of Nonprofit Grantees‘ Costs Is Limited, GAO-01-366
(Washington, D.C.: Apr. 6, 2001).
[27] See footnote 22.
GAO‘s Mission:
The General Accounting Office, the investigative arm of Congress,
exists to support Congress in meeting its constitutional
responsibilities and to help improve the performance and accountability
of the federal government for the American people. GAO examines the use
of public funds; evaluates federal programs and policies; and provides
analyses, recommendations, and other assistance to help Congress make
informed oversight, policy, and funding decisions. GAO‘s commitment to
good government is reflected in its core values of accountability,
integrity, and reliability.
Obtaining Copies of GAO Reports and Testimony:
The fastest and easiest way to obtain copies of GAO documents at no
cost is through the Internet. GAO‘s Web site ( www.gao.gov ) contains
abstracts and full-text files of current reports and testimony and an
expanding archive of older products. The Web site features a search
engine to help you locate documents using key words and phrases. You
can print these documents in their entirety, including charts and other
graphics.
Each day, GAO issues a list of newly released reports, testimony, and
correspondence. GAO posts this list, known as ’Today‘s Reports,“ on its
Web site daily. The list contains links to the full-text document
files. To have GAO e-mail this list to you every afternoon, go to
www.gao.gov and select ’Subscribe to daily E-mail alert for newly
released products“ under the GAO Reports heading.
Order by Mail or Phone:
The first copy of each printed report is free. Additional copies are $2
each. A check or money order should be made out to the Superintendent
of Documents. GAO also accepts VISA and Mastercard. Orders for 100 or
more copies mailed to a single address are discounted 25 percent.
Orders should be sent to:
U.S. General Accounting Office
441 G Street NW,
Room LM Washington,
D.C. 20548:
To order by Phone:
Voice: (202) 512-6000:
TDD: (202) 512-2537:
Fax: (202) 512-6061:
To Report Fraud, Waste, and Abuse in Federal Programs:
Contact:
Web site: www.gao.gov/fraudnet/fraudnet.htm E-mail: fraudnet@gao.gov
Automated answering system: (800) 424-5454 or (202) 512-7470:
Public Affairs:
Jeff Nelligan, managing director, NelliganJ@gao.gov (202) 512-4800 U.S.
General Accounting Office, 441 G Street NW, Room 7149 Washington, D.C.
20548: