Homeland Security
Improvements in Managing Research and Development Could Help Reduce Inefficiencies and Costs
Gao ID: GAO-11-464T March 15, 2011
This testimony discusses our past work examining the management of research and development (R&D) at the Department of Homeland Security (DHS). DHS acquisition programs represent hundreds of billions of dollars in life-cycle costs and support a wide range of missions and investments including Coast Guard ships and aircraft, border surveillance and screening equipment, nuclear detection equipment, and technologies used to screen airline passengers and baggage for explosives. Since its creation in 2003, DHS has spent billions of dollars on R&D on technologies and other countermeasures to address various threats and to conduct its missions. Within DHS, the Science and Technology Directorate (S&T) conducts overall R&D efforts to improve homeland security. Among other things, S&T works with DHS components to provide assistance in researching and developing technologies to meet their specific missions, while the components themselves are responsible for developing, testing, and acquiring these technologies. For example, DHS's Domestic Nuclear Detection Office (DNDO) is charged with developing, acquiring, and deploying equipment to detect nuclear and radiological materials, supporting the efforts of DHS and other federal agencies. The Transportation Security Administration (TSA) is responsible for securing the nation's transportation systems and, with S&T, researching, developing, and deploying technologies to, for example, screen airline passengers and their baggage. Furthermore, the Coast Guard utilizes a variety of assets such as small boats, ships, helicopters, and other aircraft to perform its missions and regularly develops and procures new assets to replace its aging fleet. In recent years, DHS has experienced challenges in managing its multibillion dollar R&D and acquisition efforts, including instances where technologies were implemented before testing and evaluation was complete. We have also identified problems with its testing and cost-benefit analyses efforts in this area. This testimony is based on reports and testimonies we issued from May 2009 through March 2011, including a report we issued earlier this month regarding opportunities to reduce potential duplication in government programs, save tax dollars, and enhance revenue. This testimony is based on the section from that report related to the management of R&D within DHS. Specifically, this testimony discusses inefficiencies in homeland security R&D and potential for cost savings in this area. This testimony is based on reports and testimonies we issued from May 2009 through March 2011, including a report we issued earlier this month regarding opportunities to reduce potential duplication in government programs, save tax dollars, and enhance revenue. The testimony is based on the section from that report related to the management of R&D within DHS. Specifically, this testimony discusses inefficiencies in homeland security R&D and potential for cost savings in this area.
In March 2011, we reported that in managing its multibillion-dollar research and development efforts, DHS had experienced cost overruns and delays in the procurement and deployment of technologies and systems needed to meet critical homeland security needs. We further reported that DHS could help reduce inefficiencies and costs by completing testing efforts before making acquisition decisions and by including cost-benefit analyses in its research and development efforts. DHS has made acquisition decisions without completing testing efforts to ensure that the systems purchased meet program requirements. Our prior work has shown that failure to resolve problems discovered during testing can sometimes lead to costly redesign and rework at a later date. Addressing such problems during the testing phase before moving to the acquisition phase can help agencies avoid future cost overruns. Specifically: (1) In September 2010, we reported that the Domestic Nuclear Detection Office (DNDO) was simultaneously engaged in the research and development phase while planning for the acquisition phase of its cargo advanced automated radiography system to detect certain nuclear materials in vehicles and containers at ports. (2) In June 2010, we reported that the Coast Guard placed orders for or received significant numbers of units for three programs--the Maritime Patrol Aircraft, Response Boat-Medium, and Sentinel Class Patrol Boat--prior to completing testing, placing the Coast Guard at risk for needing to make expensive changes to the design of these vessels after production had begun if significant problems were to be identified during future testing. (3) In October 2009, we reported that TSA deployed explosives trace portals, a technology for detecting traces of explosives on passengers at airport checkpoints, even though TSA officials were aware that tests conducted during 2004 and 2005 on earlier models of the portals suggested the portals did not demonstrate reliable performance in an airport environment. In addition, our prior work has shown that cost-benefit analyses help congressional and agency decision makers assess and prioritize resource investments and consider potentially more cost-effective alternatives. However, DHS has not consistently included cost-benefit analyses in its testing efforts and acquisition decision making. In 2006, we recommended that DHS's decision to deploy next-generation radiation-detection equipment, or advanced spectroscopic portals, used to detect smuggled nuclear or radiological materials, be based on an analysis of both the benefits and costs--which we later estimated at over $2 billion--and a determination of whether any additional detection capability provided by the portals was worth their additional cost.
GAO-11-464T, Homeland Security: Improvements in Managing Research and Development Could Help Reduce Inefficiencies and Costs
This is the accessible text file for GAO report number GAO-11-464T
entitled 'Homeland Security: Improvements in Managing Research and
Development Could Help Reduce Inefficiencies and Costs' which was
released on March 15, 2011.
This text file was formatted by the U.S. Government Accountability
Office (GAO) to be accessible to users with visual impairments, as
part of a longer term project to improve GAO products' accessibility.
Every attempt has been made to maintain the structural and data
integrity of the original printed product. Accessibility features,
such as text descriptions of tables, consecutively numbered footnotes
placed at the end of the file, and the text of agency comment letters,
are provided but may not exactly duplicate the presentation or format
of the printed version. The portable document format (PDF) file is an
exact electronic replica of the printed version. We welcome your
feedback. Please E-mail your comments regarding the contents or
accessibility features of this document to Webmaster@gao.gov.
This is a work of the U.S. government and is not subject to copyright
protection in the United States. It may be reproduced and distributed
in its entirety without further permission from GAO. Because this work
may contain copyrighted images or other material, permission from the
copyright holder may be necessary if you wish to reproduce this
material separately.
United States Government Accountability Office:
GAO:
Testimony before the Subcommittee on Technology and Innovation,
Committee on Science, Space, and Technology, House of Representatives:
For Release on Delivery:
Expected at 10:00 a.m. EDT:
Tuesday, March 15, 2011:
Homeland Security:
Improvements in Managing Research and Development Could Help Reduce
Inefficiencies and Costs:
Statement of David C. Maurer, Director:
Homeland Security and Justice Issues:
GAO-11-464T:
Chairman Quayle, Ranking Member Wu, and Members of the Subcommittee:
I am pleased to be here today to discuss our past work examining the
management of research and development (R&D) at the Department of
Homeland Security (DHS). DHS acquisition programs represent hundreds
of billions of dollars in life-cycle costs and support a wide range of
missions and investments including Coast Guard ships and aircraft,
border surveillance and screening equipment, nuclear detection
equipment, and technologies used to screen airline passengers and
baggage for explosives. Since its creation in 2003, DHS has spent
billions of dollars on R&D on technologies and other countermeasures
to address various threats and to conduct its missions. Within DHS,
the Science and Technology Directorate (S&T) conducts overall R&D
efforts to improve homeland security. Among other things, S&T works
with DHS components to provide assistance in researching and
developing technologies to meet their specific missions, while the
components themselves are responsible for developing, testing, and
acquiring these technologies. For example, DHS's Domestic Nuclear
Detection Office (DNDO) is charged with developing, acquiring, and
deploying equipment to detect nuclear and radiological materials,
supporting the efforts of DHS and other federal agencies. The
Transportation Security Administration (TSA) is responsible for
securing the nation's transportation systems and, with S&T,
researching, developing, and deploying technologies to, for example,
screen airline passengers and their baggage. Furthermore, the Coast
Guard utilizes a variety of assets such as small boats, ships,
helicopters, and other aircraft to perform its missions and regularly
develops and procures new assets to replace its aging fleet. In recent
years, DHS has experienced challenges in managing its multibillion
dollar R&D and acquisition efforts, including instances where
technologies were implemented before testing and evaluation was
complete. We have also identified problems with its testing and cost-
benefit analyses efforts in this area.
My testimony today is based on reports and testimonies we issued from
May 2009 through March 2011, including a report we issued earlier this
month regarding opportunities to reduce potential duplication in
government programs, save tax dollars, and enhance revenue. My
testimony today is based on the section from that report related to
the management of R&D within DHS. [Footnote 1] Specifically, this
testimony discusses inefficiencies in homeland security R&D and
potential for cost savings in this area.
For our past work, we reviewed program schedules, planning documents,
testing reports, and other acquisition documentation. For some of the
programs we discuss in this testimony, we conducted site visits to a
range of facilities, such as national laboratories, airports, and
other locations to observe research, development, and testing efforts.
We also conducted interviews with DHS component program managers and
S&T officials to discuss R&D issues related to individual programs. We
conducted this work in accordance with generally accepted government
auditing standards. More detailed information on the scope and
methodology from our previous work can be found within each specific
report.
DHS Could Reduce Cost Overruns and Procurement Delays by Completing
Testing and Conducting Cost-Benefit Analyses before Deploying
Technologies and Systems:
In March 2011, we reported that in managing its multibillion-dollar
research and development efforts, DHS had experienced cost overruns
and delays in the procurement and deployment of technologies and
systems needed to meet critical homeland security needs.[Footnote 2]
We further reported that DHS could help reduce inefficiencies and
costs by completing testing efforts before making acquisition
decisions and by including cost-benefit analyses in its research and
development efforts.
Overview of Our Past DHS R&D Work:
DHS has made acquisition decisions without completing testing efforts
to ensure that the systems purchased meet program requirements. Our
prior work has shown that failure to resolve problems discovered
during testing can sometimes lead to costly redesign and rework at a
later date. Addressing such problems during the testing phase before
moving to the acquisition phase can help agencies avoid future cost
overruns. Specifically:
* In September 2010, we reported that the Domestic Nuclear Detection
Office (DNDO) was simultaneously engaged in the research and
development phase while planning for the acquisition phase of its
cargo advanced automated radiography system to detect certain nuclear
materials in vehicles and containers at ports.[Footnote 3] DNDO
pursued the deployment of the cargo advanced automated radiography
system without fully understanding that it would not fit within
existing inspection lanes at ports of entry and would slow down the
flow of commerce through these lanes, causing significant delays. DHS
spent $113 million on the program since 2005. DHS canceled the
acquisition phase of the program in 2007.
* In June 2010, we reported that the Coast Guard placed orders for or
received significant numbers of units for three programs--the Maritime
Patrol Aircraft, Response Boat-Medium, and Sentinel Class Patrol Boat--
prior to completing testing, placing the Coast Guard at risk for
needing to make expensive changes to the design of these vessels after
production had begun if significant problems were to be identified
during future testing.[Footnote 4] Acquisition cost estimates for
these three programs together totaled about $6.8 billion, according to
Coast Guard data.
* In October 2009, we reported that TSA deployed explosives trace
portals, a technology for detecting traces of explosives on passengers
at airport checkpoints, even though TSA officials were aware that
tests conducted during 2004 and 2005 on earlier models of the portals
suggested the portals did not demonstrate reliable performance in an
airport environment.[Footnote 5] TSA also lacked assurance that the
portals would meet functional requirements in airports within
estimated costs. In addition, the machines were more expensive to
install and maintain than expected. In June 2006, TSA halted
deployment of the explosives trace portals because of performance
problems. We recommended that TSA ensure that tests are completed
before deploying checkpoint screening technologies to airports. The
agency concurred with the recommendation and has taken action to
address it. For example, TSA has required more-recent passenger
checkpoint technologies to complete both laboratory tests and
operational tests prior to their deployment.
In addition, our prior work has shown that cost-benefit analyses help
congressional and agency decision makers assess and prioritize
resource investments and consider potentially more cost-effective
alternatives. However, DHS has not consistently included cost-benefit
analyses in its testing efforts and acquisition decision making.
* In 2006, we recommended that DHS's decision to deploy next-
generation radiation-detection equipment, or advanced spectroscopic
portals, used to detect smuggled nuclear or radiological materials, be
based on an analysis of both the benefits and costs--which we later
estimated at over $2 billion--and a determination of whether any
additional detection capability provided by the portals was worth
their additional cost.[Footnote 6] DHS subsequently issued a cost-
benefit analysis, but in June 2009, we reported that this analysis did
not provide a sound analytical basis for DHS's decision to deploy the
portals. We also reported that an updated cost-benefit analysis might
show that DNDO's plan to replace existing equipment with advanced
spectroscopic portals was not justified, particularly given the
marginal improvement in detection of certain nuclear materials
required of advanced spectroscopic portals and the potential to
improve the current-generation portal monitors' sensitivity to nuclear
materials, most likely at a lower cost.[Footnote 7] At that time, DNDO
officials stated that they planned to update the cost-benefit
analysis. After spending more than $200 million on the program, in
February 2010 DHS announced that it was scaling back its plans for
development and use of the portals technology.
* In October 2009, we reported that TSA had not yet completed a cost-
benefit analysis to prioritize and fund its technology investments for
screening passengers at airport checkpoints.[Footnote 8] One reason
that TSA had difficulty developing a cost-benefit analysis was that it
had not yet developed life-cycle cost estimates for its various
screening technologies. We reported that this information was
important because it would help decision makers determine, given the
cost of various technologies, which technology provided the greatest
mitigation of risk for the resources that were available. We
recommended that TSA develop a cost-benefit analysis. TSA agreed with
this recommendation and has completed a life-cycle cost estimate and
collected information for its checkpoint technologies, but has not yet
completed a cost-benefit analysis.
In January 2011, DHS reported that it planned to take additional
actions to strengthen its R&D efforts. For example, DHS reported that
it planned to establish a new model for managing departmentwide
investments across their life cycles. DHS reported that S&T will be
involved in each phase of the investment life cycle and will
participate in new councils and boards DHS is planning to create to
help ensure that test and evaluation methods are appropriately
considered as part of DHS's overall research and development
investment strategies. According to DHS, S&T will help ensure that new
technologies are properly scoped, developed, and tested before being
implemented. In addition, DHS reported that the new councils and
boards it is planning to establish to strengthen management of the
department's acquisition and investment review process will be
responsible for, among other things, making decisions on research and
development initiatives based on factors such as viability and
affordability, and overseeing key acquisition decisions for major
programs using baseline and actual data.
Actions Needed and Potential Cost Savings:
Our work has highlighted the need for DHS to strengthen its R&D
efforts by ensuring that (1) testing efforts are completed before
making acquisition decisions and (2) cost-benefit analyses are
conducted to reduce research and development inefficiencies and
costs.[Footnote 9] The planned actions DHS reports it is taking or has
under way to address management of its research and development
programs are positive steps and, if implemented effectively, could
help the department address many of these challenges. However, it is
too early to fully assess the effect of these actions.
Rigorously testing devices using actual agency operational tactics
before making decisions on acquisition would help DHS reduce
inefficiencies and costs. Further, conducting cost-benefit analyses as
part of research, development, and testing efforts would help DHS and
congressional decision makers better assess and prioritize investment
decisions, including assessing possible program alternatives that
could be more cost-effective. We are currently assessing S&T's efforts
to oversee testing and evaluation across DHS for the Senate Committee
on Homeland Security and Governmental Affairs and plan to report on
that issue later this year.
Chairman Quayle, Ranking Member Wu, and Members of the Subcommittee,
this concludes my prepared statement. I would be pleased to respond to
any questions that you or other members of the subcommittee may have.
Contacts and Acknowledgments:
For questions about this statement, please contact David C. Maurer at
(202) 512-9627 or maurerd@gao.gov. Contact points for our Offices of
Congressional Relations and Public Affairs may be found on the last
page of this statement. Individuals making key contributions to this
statement include Chris Currie, Ned Woodward, and Michele Mackin,
Assistant Directors; Bintou Njie, Joe Dewechter, Molly Traci, and
Kevin Tarmann. Key contributors for the previous work that this
testimony is based on can be found within each individual report.
[End of section]
Related GAO Products:
Opportunities to Reduce Potential Duplication in Government Programs,
Save Tax Dollars, and Enhance Revenue. [hyperlink,
http://www.gao.gov/products/GAO-11-318SP]. Washington, D.C.: March
2011.
Combating Nuclear Smuggling: Inadequate Communication and Oversight
Hampered DHS Efforts to Develop an Advanced Radiography System to
Detect Nuclear Materials. [hyperlink,
http://www.gao.gov/products/GAO-10-1041T]. Washington, D.C.: September
15, 2010.
Combating Nuclear Smuggling: DHS Has Made Some Progress but Not Yet
Completed a Strategic Plan for Its Global Nuclear Detection Efforts or
Closed Identified Gaps. [hyperlink,
http://www.gao.gov/products/GAO-10-883T]. Washington, D.C.: June 30,
2010.
Department of Homeland Security: Assessments of Selected Complex
Acquisitions. [hyperlink, http://www.gao.gov/products/GAO-10-588SP].
Washington, D.C.: June 30, 2010.
Aviation Security: DHS and TSA Have Researched, Developed, and Begun
Deploying Passenger Checkpoint Screening Technologies, but Continue to
Face Challenges. [hyperlink, http://www.gao.gov/products/GAO-10-128].
Washington, D.C.: October 7, 2009.
Combating Nuclear Smuggling: Lessons Learned from DHS Testing of
Advanced Radiation Detection Portal Monitors. [hyperlink,
http://www.gao.gov/products/GAO-09-804T]. Washington, D.C.: June 25,
2009.
Combating Nuclear Smuggling: DHS Improved Testing of Advanced
Radiation Detection Portal Monitors, but Preliminary Results Show
Limits of the New Technology. [hyperlink,
http://www.gao.gov/products/GAO-09-655]. Washington, D.C.: May 21,
2009.
[End of section]
Footnotes:
[1] GAO, Opportunities to Reduce Potential Duplication in Government
Programs, Save Tax Dollars, and Enhance Revenue, [hyperlink,
http://www.gao.gov/products/GAO-11-318SP] (Washington, D.C.: March
2011). See also related GAO products at the end of this statement.
[2] [hyperlink, http://www.gao.gov/products/GAO-11-318SP].
[3] GAO, Combating Nuclear Smuggling: Inadequate Communication and
Oversight Hampered DHS Efforts to Develop an Advanced Radiography
System to Detect Nuclear Materials, [hyperlink,
http://www.gao.gov/products/GAO-10-1041T] (Washington D.C.: Sept. 15,
2010).
[4] GAO, Department of Homeland Security: Assessments of Selected
Complex Acquisitions, [hyperlink,
http://www.gao.gov/products/GAO-10-588SP] (Washington, D.C.: June 30,
2010).
[5] GAO, Aviation Security: DHS and TSA Have Researched, Developed,
and Begun Deploying Passenger Checkpoint Screening Technologies, but
Continue to Face Challenge, [hyperlink,
http://www.gao.gov/products/GAO-10-128] (Washington, D.C.: Oct. 7,
2009).
[6] GAO, Combating Nuclear Smuggling: DHS's Program to Procure and
Deploy Advanced Radiation Detection Portal Monitors Is Likely to
Exceed the Department's Previous Cost Estimates, [hyperlink,
http://www.gao.gov/products/GAO-08-1108R] (Washington, D.C.: Sept. 22,
2008).
[7] GAO, Combating Nuclear Smuggling: Lessons Learned from DHS Testing
of Advanced Radiation Detection Portal Monitors, [hyperlink,
http://www.gao.gov/products/GAO-09-804T] (Washington, D.C.: June 25,
2009).
[8] [hyperlink, http://www.gao.gov/products/GAO-10-128].
[9] [hyperlink, http://www.gao.gov/products/GAO-11-318SP].
[End of section]
GAO's Mission:
The Government Accountability Office, the audit, evaluation and
investigative arm of Congress, exists to support Congress in meeting
its constitutional responsibilities and to help improve the performance
and accountability of the federal government for the American people.
GAO examines the use of public funds; evaluates federal programs and
policies; and provides analyses, recommendations, and other assistance
to help Congress make informed oversight, policy, and funding
decisions. GAO's commitment to good government is reflected in its core
values of accountability, integrity, and reliability.
Obtaining Copies of GAO Reports and Testimony:
The fastest and easiest way to obtain copies of GAO documents at no
cost is through GAO's Web site [hyperlink, http://www.gao.gov]. Each
weekday, GAO posts newly released reports, testimony, and
correspondence on its Web site. To have GAO e-mail you a list of newly
posted products every afternoon, go to [hyperlink, http://www.gao.gov]
and select "E-mail Updates."
Order by Phone:
The price of each GAO publication reflects GAO‘s actual cost of
production and distribution and depends on the number of pages in the
publication and whether the publication is printed in color or black and
white. Pricing and ordering information is posted on GAO‘s Web site,
[hyperlink, http://www.gao.gov/ordering.htm].
Place orders by calling (202) 512-6000, toll free (866) 801-7077, or
TDD (202) 512-2537.
Orders may be paid for using American Express, Discover Card,
MasterCard, Visa, check, or money order. Call for additional
information.
To Report Fraud, Waste, and Abuse in Federal Programs:
Contact:
Web site: [hyperlink, http://www.gao.gov/fraudnet/fraudnet.htm]:
E-mail: fraudnet@gao.gov:
Automated answering system: (800) 424-5454 or (202) 512-7470:
Congressional Relations:
Ralph Dawn, Managing Director, dawnr@gao.gov:
(202) 512-4400:
U.S. Government Accountability Office:
441 G Street NW, Room 7125:
Washington, D.C. 20548:
Public Affairs:
Chuck Young, Managing Director, youngc1@gao.gov:
(202) 512-4800:
U.S. Government Accountability Office:
441 G Street NW, Room 7149:
Washington, D.C. 20548: