Defense Acquisitions

Opportunities and Challenges for Army Ground Force Modernization Efforts Gao ID: GAO-10-603T April 15, 2010

Since 2003, the Future Combat System (FCS) program has been the centerpiece of the Army's efforts to transition to a lighter, more agile, and more capable combat force. In 2009, however, concerns over the program's performance led to the Secretary of Defense's decision to significantly restructure and ultimately cancel the acquisition program. As a result, the Army is outlining a new approach to ground force modernization. This statement outlines the Army's preliminary post-FCS actions and identifies the challenges the Department of Defense (DOD) and the Army must address as they proceed. This testimony is based on GAO's report on the Army's Ground Force Modernization effort released on March 15, 2010. It emphasizes the December 2009 decision to begin low-rate initial production for Increment 1 of the Brigade Combat Team Modernization.

The Army is implementing DOD direction and redefining its overall modernization strategy as a result of the Secretary of Defense's decision to significantly restructure the FCS program. It is transitioning from the FCS long-term acquisition orientation to a shorter-term approach that biennially develops and fields new increments of capability within capability packages. It now has an approved acquisition program that will produce and field the initial increment of the FCS spinout equipment, which includes unmanned aerial and ground vehicles as well as unattended sensors and munitions. It has preliminary plans for two other major defense acquisition programs to (1) define and develop follow-on increments and (2) develop a new ground combat vehicle (GCV). The individual systems within Increments 1 and 2 are to be integrated with a preliminary version of an information network. Currently, the Army is continuing selected development work--primarily that related to Increments 1 and 2 and the information network--under the existing FCS development contract. The Army has recently released a request for proposals for the technology development phase of the proposed GCV development effort. The Army's projected investment in Increments 1 and 2 and GCV is estimated to be over $24 billion through fiscal year 2015. With these modernization efforts at an early stage, DOD and the Army face the immediate challenge of setting them on the best possible footing by buying the right capabilities at the best value. DOD and the Army have an opportunity to better position these efforts by utilizing an enhanced body of acquisition legislation and DOD policy reforms--which now incorporate many of the knowledge-based practices that GAO has previously identified--as well as lessons learned from the FCS program. Preliminary plans suggest that the Army and DOD are strongly considering lessons learned. However, DOD recently approved the first of several planned low-rate initial production lots of Increment 1 despite having acknowledged that the systems and network were immature, unreliable, and not performing as required. That decision reflects DOD's emphasis on quickly providing new capabilities to combat units. This decision did not follow knowledge-based acquisition practices and runs the risk of delivering unacceptable equipment to the warfighter and trading off acquisition principles whose validity has been so recently underscored. The Army needs to seize the opportunity of integrating acquisition reforms, knowledge-based acquisition practices, and lessons learned from FCS into future modernization efforts to increase the likelihood of successful outcomes.



GAO-10-603T, Defense Acquisitions: Opportunities and Challenges for Army Ground Force Modernization Efforts This is the accessible text file for GAO report number GAO-10-603T entitled 'Defense Acquisitions: Opportunities and Challenges for Army Ground Force Modernization Efforts' which was released on April 15, 2010. This text file was formatted by the U.S. Government Accountability Office (GAO) to be accessible to users with visual impairments, as part of a longer term project to improve GAO products' accessibility. Every attempt has been made to maintain the structural and data integrity of the original printed product. Accessibility features, such as text descriptions of tables, consecutively numbered footnotes placed at the end of the file, and the text of agency comment letters, are provided but may not exactly duplicate the presentation or format of the printed version. The portable document format (PDF) file is an exact electronic replica of the printed version. We welcome your feedback. Please E-mail your comments regarding the contents or accessibility features of this document to Webmaster@gao.gov. This is a work of the U.S. government and is not subject to copyright protection in the United States. It may be reproduced and distributed in its entirety without further permission from GAO. Because this work may contain copyrighted images or other material, permission from the copyright holder may be necessary if you wish to reproduce this material separately. Testimony: Before the Subcommittee on Airland, Committee on Armed Services, U.S. Senate: United States Government Accountability Office: GAO: For Release on Delivery: Expected at 2:00 p.m. EDT: Thursday, April 15, 2010: Defense Acquisitions: Opportunities and Challenges for Army Ground Force Modernization Efforts: Statement of Michael J. Sullivan, Director: Acquisition and Sourcing Management: GAO-10-603T: GAO Highlights: Highlights of GAO-10-603T, a testimony before the Subcommittee on Airland, Committee on Armed Services, U.S. Senate. Why GAO Did This Study: Since 2003, the Future Combat System (FCS) program has been the centerpiece of the Army‘s efforts to transition to a lighter, more agile, and more capable combat force. In 2009, however, concerns over the program‘s performance led to the Secretary of Defense‘s decision to significantly restructure and ultimately cancel the acquisition program. As a result, the Army is outlining a new approach to ground force modernization. This statement outlines the Army‘s preliminary post-FCS actions and identifies the challenges the Department of Defense (DOD) and the Army must address as they proceed. This testimony is based on GAO‘s report on the Army‘s Ground Force Modernization effort released on March 15, 2010. It emphasizes the December 2009 decision to begin low-rate initial production for Increment 1 of the Brigade Combat Team Modernization. What GAO Found: The Army is implementing DOD direction and redefining its overall modernization strategy as a result of the Secretary of Defense‘s decision to significantly restructure the FCS program. It is transitioning from the FCS long-term acquisition orientation to a shorter-term approach that biennially develops and fields new increments of capability within capability packages. It now has an approved acquisition program that will produce and field the initial increment of the FCS spinout equipment, which includes unmanned aerial and ground vehicles as well as unattended sensors and munitions. It has preliminary plans for two other major defense acquisition programs to (1) define and develop follow-on increments and (2) develop a new ground combat vehicle (GCV). The individual systems within Increments 1 and 2 are to be integrated with a preliminary version of an information network. Currently, the Army is continuing selected development work”primarily that related to Increments 1 and 2 and the information network”under the existing FCS development contract. The Army has recently released a request for proposals for the technology development phase of the proposed GCV development effort. The Army‘s projected investment in Increments 1 and 2 and GCV is estimated to be over $24 billion through fiscal year 2015. With these modernization efforts at an early stage, DOD and the Army face the immediate challenge of setting them on the best possible footing by buying the right capabilities at the best value. DOD and the Army have an opportunity to better position these efforts by utilizing an enhanced body of acquisition legislation and DOD policy reforms”which now incorporate many of the knowledge-based practices that GAO has previously identified”as well as lessons learned from the FCS program. Preliminary plans suggest that the Army and DOD are strongly considering lessons learned. However, DOD recently approved the first of several planned low-rate initial production lots of Increment 1 despite having acknowledged that the systems and network were immature, unreliable, and not performing as required. That decision reflects DOD‘s emphasis on quickly providing new capabilities to combat units. This decision did not follow knowledge-based acquisition practices and runs the risk of delivering unacceptable equipment to the warfighter and trading off acquisition principles whose validity has been so recently underscored. The Army needs to seize the opportunity of integrating acquisition reforms, knowledge-based acquisition practices, and lessons learned from FCS into future modernization efforts to increase the likelihood of successful outcomes. What GAO Recommends: In its March report, GAO recommended that the Secretary of Defense instruct the Army to correct the identified maturity and reliability issues prior to either fielding equipment or approving additional system procurement. GAO also recommended that the Secretary direct the Army to submit a comprehensive report to the Congress on its modernization investment, contracting, and management strategies. DOD concurred with GAO‘s recommendations. View [hyperlink, http://www.gao.gov/products/GAO-10-603T] or key components. For more information, contact Michael J. Sullivan at (202) 512-4841 or sullivanm@gao.gov. [End of section] Mr. Chairman and Members of the Subcommittee: I am pleased to be here today to discuss some of the Department of the Army's ground force modernization efforts as it moves away from the now-canceled Future Combat System (FCS) program. My statement today is based on the work we conducted over the last year in response to a request from the Subcommittee on Air and Land Forces, House Committee on Armed Services. This statement focuses on the Army's post-FCS acquisition plans. In particular, it emphasizes the December 2009 decision to begin low-rate initial production for Increment 1 of the Brigade Combat Team Modernization. Our recent report on the Army's ground force modernization efforts provides additional information on the Army's efforts.[Footnote 1] This statement is based on work we conducted from March 2009 through March 2010 in accordance with generally accepted government auditing standards. Those standards require that we plan and perform the audit to obtain sufficient, appropriate evidence to provide a reasonable basis for our findings and conclusions based on our audit objectives. We believe that the evidence obtained provides a reasonable basis for our findings and conclusions based on our audit objectives. Background: Since it started development in 2003, FCS has been at the center of the Army's efforts to modernize into a lighter, more agile, and more capable combat force. The FCS concept involved replacing existing combat systems with a family of manned and unmanned vehicles and systems linked by an advanced information network. The Army anticipated that the FCS systems, along with the soldier and enabling complementary systems, would work together in a system of systems wherein the whole provided greater capability than the sum of the individual parts. The Army expected to develop this equipment in 10 years, procure it over 13 years, and field it to 15 FCS-unique brigades--about one-third of the active force at that time. The Army also had planned to spin out selected FCS technologies and systems to current Army forces throughout the system development and demonstration phase. As we reported in 2009,[Footnote 2] the FCS program was immature and unable to meet the Department of Defense's (DOD) own standards for technology and design from the start. Although adjustments were made, such as adding time and reducing requirements, vehicle weights and software code grew, key network systems were delayed, and technologies took longer to mature than anticipated (see figure 1). By 2009, after an investment of 6 years and an estimated $18 billion, the viability of the FCS concept was still unknown. As such, we concluded that the maturity of the development efforts was insufficient and the program could not be developed and produced within existing resources. Figure 1: FCS Acquisition Program (2003 vs. 2009): [Refer to PDF for image: illustrated table] Cost estimate (Fiscal year 2009 billions of dollars): 2003: Research and development: $20.9; 2009: Research and development: $29.0; $8.1 billion increase. 2003: Procurement: $68.2; 2009: Procurement: $129.3; $61.1 billion increase. 2003: Total: $89.8; 2009: Total: $159.3; $69.5 billion increase. Schedule (Development start to initial operational capability): 2003: 7 years, 6 months; 2009: 12 years, 3 months; Over 4 1/2 years added. Requirements: 2003: Undefined; 2009: System-level requirements not matched with emerging designs; Persistent gaps. Software lines of code: 2003: 34 million; 2009: 114 million+; Triple in size. Projected maturity date of critical technologies[A]: 2003: 2006; 2009: 2009; 3 years added. Sources: DOD (data); GAO (analysis and presentation). [A] For FCS, the Army projected maturity based on a Technology Readiness Level 6, which is a representative model or prototype that has been tested in a relevant environment, but requires additional work for the appropriate form, fit, and function. Based on our best practices work, technologies that have reached a Technology Readiness Level 7, a prototype demonstrated in a realistic environment, are mature. [End of figure] In April 2009, the Secretary of Defense proposed a significant restructuring of the FCS program to lower risk and address more near- term combat needs. The Secretary noted significant concerns that the FCS program's vehicle designs--where greater information awareness was expected to compensate for less armor, resulting in lower weight and higher fuel efficiency--did not adequately reflect the lessons of counterinsurgency and close-quarters combat operations in Iraq and Afghanistan. As such, the Secretary recommended: * accelerating fielding of ready-to-go systems and capabilities to all combat brigades; * canceling the vehicle component of the FCS program, reevaluating the requirements, technology, and approach, and relaunching the Army's vehicle modernization program; and: * addressing fee structure and other concerns with current FCS contracting arrangements. In June 2009, the Under Secretary of Defense for Acquisition, Technology and Logistics issued an acquisition decision memorandum that canceled the FCS acquisition program, terminated manned ground vehicle development efforts, and laid out plans for follow-on Army Brigade Combat Team Modernization efforts. DOD directed the Army to transition to an Army-wide modernization plan consisting of a number of integrated acquisition programs, including one to develop ground combat vehicles (GCV). Subsequently, the Army has been defining its ground force modernization efforts per the Secretary's decisions and the June 2009 acquisition decision memorandum. Although the details are not yet complete, the Army took several actions through the end of calendar year 2009. It stopped all development work on the FCS manned ground vehicles--including the non-line-of-sight cannon--in the summer of 2009 and recently terminated development of the Class IV unmanned aerial vehicle and the countermine and transport variants of the Multifunction Utility/Logistics and Equipment unmanned ground vehicle. For the time being, the Army is continuing selected development work under the existing FCS development contract, primarily residual FCS system and network development. In October 2009, the Army negotiated a modification to the existing contract that clarified the development work needed for the brigade modernization efforts. The Army Has Started a Series of Development and Fielding Efforts: The Army is implementing DOD direction and redefining its overall modernization strategy as a result of the Secretary of Defense's decisions to significantly restructure the FCS program. It is transitioning from the FCS long-term acquisition orientation to a shorter-term approach that biennially develops and fields new increments of capability within capability packages. It now has an approved acquisition program that will produce and field the initial increment of the FCS spinout equipment, which includes unmanned aerial and ground vehicles as well as unattended sensors and munitions, and preliminary plans for two other major defense acquisition programs to define and develop follow-on increments and develop a new GCV. The Army also plans to integrate network capabilities across its brigade structure and to develop and field upgrades to other existing ground force equipment. * The first program, Increment 1, is a continuation of previous FCS- related efforts to spin out emerging capabilities and technologies to current forces. Of the Army's post-FCS modernization initiatives, Increment 1, which includes such FCS remnants as unmanned air and ground systems, unattended ground sensors, the non-line-of-sight launch system, and a network integration kit, is the furthest along in the acquisition development cycle (see figure 2). The network integration kit includes, among other things, the integrated computer system, an initial version of the system-of-systems common operating environment, early models of the Joint Tactical Radio System, and a range extension relay[Footnote 3]. In December 2009, the Army requested and DOD approved, with a number of restrictions, the low- rate initial production of Increment 1 systems that are expected to be fielded in the fiscal year 2011-12 capability package.[Footnote 4] The Army will be continuing Increment 1 development over the next 2 years while low-rate initial production proceeds. The projected development and production cost to equip nine brigades with the Increment 1 network and systems, supported by an independent cost estimate, would be about $3.5 billion. Figure 2: Increment 1 Systems: [Refer to PDF for image: illustrated list] Small unmanned ground vehicle Block 1: Provides enhanced situational awareness and force protection through reduced exposure to hazards during soldier-intensive and/or high-risk functions. Network integration kit: Provides enhanced communications and situational awareness through radios with multiple software waveforms, connections to unattended sensors, and links to existing networking capabilities. Urban unattended ground sensor: Provides force protection in an urban setting through a leave-behind, network-enabled reporting system of movement and/or activity in cleared areas. Class 1 unmanned aerial vehicle Block 0: Provides independent, soldier-level aerial reconnaissance, surveillance, and target acquisition capability. Non-line-of-sight launch system Provides the ability to precisely attack armored, lightly armored, and stationary or moving targets at extended ranges despite weather/environmental conditions and/or presence of countermeasures. Tactical unattended ground sensor: Provides enhanced situational awareness, force protection, and early warnings in a tactical setting through cross-cues to sensors and weapon systems. Sources: Army (data and photos); GAO (analysis and presentation). [End of figure] * For the second acquisition program, Increment 2 of brigade modernization, the Army has preliminary plans to mature Increment 1 capabilities--potentially demonstrating full FCS threshold requirements--as well as contributing further developments of the system-of-systems common operating environment and battle command software, and demonstrating and fielding additional capabilities. For example, these may include the Armed Robotic Vehicle Assault (Light)-- an unmanned ground vehicle configured for security and assault support missions--and the Common Controller, which will provide the dismounted soldier a handheld device capable of controlling, connecting, and providing data transfer from unmanned vehicles and ground sensors. Army officials indicated that they are currently working to define the content, cost, and schedule for Increment 2 with a low-rate initial production decision planned for fiscal year 2013 and a Defense Acquisition Board review expected later in fiscal year 2010. * The third acquisition program would develop a new GCV. The Army reviewed current fighting vehicles across the force structure to determine whether to sustain, improve, divest, or pursue new vehicles based on operational value, capability shortfalls, and resource availability. Per DOD direction, the Army also collaborated with the Marine Corps to identify capability gaps related to fighting vehicles. For development of a new GCV, the Army's preliminary plans indicate the use of an open architecture design to enable incremental improvements in modular armor; network architecture; and subcomponent size, weight, power, and cooling. DOD and the Army met in February 2010 to make a materiel development decision on the GCV, and the Army was subsequently authorized to release a request for proposals for GCV technology development.[Footnote 5] Over the next several months, the Army will be conducting an analysis of alternatives to assess potential materiel solutions for the GCV. The Army expects to follow the analysis with a Milestone A decision review on whether to begin technology development in September 2010.[Footnote 6] After Milestone A, Army officials are proposing the use of competitive prototyping with multiple contractors--the number of which will depend on available funding--during the technology development phase, which will feature the use of mature technologies and the fabrication and testing of prototype subsystems. In the technology development phase, the contractors will be expected to fabricate and evaluate several subsystem prototypes, including an automotive test rig and a mine blast test asset. The contractors will also be expected to develop a near-critical design review level design for their integrated vehicle and, in the process, inform the GCV concept development document. That document is expected to be finalized at the Milestone A decision point. Competitive prototypes will be fabricated and tested during the engineering and manufacturing development phase. A preliminary design review would be used to validate contractor readiness to enter detailed design at Milestone B in fiscal year 2013. The Army's preliminary plans indicate that the first production vehicles could be delivered in late fiscal year 2017, about 7 years from Milestone A. * The Army is planning to incrementally develop and field an information network to all of its brigades in a decentralized fashion, that is, not as a separate acquisition program. The Army has defined a preliminary network strategy and is in the process of defining what the end state of the network will need to be, as well as how it may build up that network over an undefined period of time. In the near term, the Army is working to establish a common network foundation to build on and to define a common network architecture based on what is currently available and expected to become available in the near future. Current communications, command and control, and networking acquisition programs will continue and will be expected to build upon the current network foundation and architecture over time. Networking capabilities will be expected to meet specific standards and interface requirements. According to Army officials, the ongoing incremental network and software development activities and requirements will be dispersed to these acquisition programs, where they will be considered for further development and possible fielding. The only original FCS network development activities that the Army plans to continue under the FCS development contract are those supporting the network integration kit for Increment 1 and whatever additional networking capabilities may be needed for Increment 2. DOD expects the Army to present its network development plans later in 2010. (See table 1.) Table 1: Army Budget Requests for Fiscal Year 2011 and Fiscal Years 2012-2015 for Increments 1 and 2 and GCV (Dollars in millions): Research and Development: Increments 1and 2; Fiscal year 2011: $1,568.0; Fiscal years 2012-2015: $4,126.0. Research and Development: GCV; Fiscal year 2011: 934.4; Fiscal years 2012-2015: 6,245.4. Research and Development: Subtotal; Fiscal year 2011: $2,502.4; Fiscal years 2012-2015: $10,371.4. Procurement: Increments 1and 2; Fiscal year 2011: $682.6; Fiscal years 2012-2015: $9,840.5. Procurement: GCV; Fiscal year 2011: 0; Fiscal years 2012-2015: $876.2. Procurement: Subtotal; Fiscal year 2011: $682.6; Fiscal years 2012-2015: $10,716.7. Total: Fiscal year 2011: $3,185.0; Fiscal years 2012-2015: $21,088.1. Source: Fiscal Year 2011 President's Budget. [End of table] As shown in table 1, the Army is proposing to make substantial investments in its post-FCS acquisition initiatives. For fiscal year 2011, the Army is proposing research and development funding of about $2.5 billion and procurement funding of about $683 million. For the following 4 years (fiscal years 2012-2015), the Army plans additional research and development investments of about $10.4 billion and procurement investments of about $10.7 billion. Recent Army Contract Actions Related to Its Post-FCS Efforts: For the time being, the Army is continuing selected development work-- primarily that related to Increment 1, Increment 2, and network development--under the existing FCS development contract. In October 2009, the Army negotiated a modification to the existing contract that clarified the development work needed for the brigade modernization efforts. The Army previously awarded a contract for long lead item procurement for Increment 1. A modification to that contract was recently issued to begin low-rate initial production of the Increment 1 systems. The Army has also recently released a request for proposals for the technology development phase of the proposed GCV development effort. Contractor proposals for GCV are expected to include plans, solutions, or both for, among other things, survivability (hit avoidance system, armor, and vehicle layout) and mobility (propulsion and power generation and cooling). According to the request for proposals, the proposals can utilize prior Army investment in armor recipes, but the contractors will not get an inherent advantage for doing so. Each solution will be based on its own merits. Contractor proposals are to be submitted in April 2010 and contract awards, for cost-plus type contracts, are to be awarded after the Milestone A decision in September 2010. Acquisition Direction and FCS Lessons Learned Offer Opportunities to Promote Successful Outcomes, but Decision to Proceed with Initial Production Is Premature: The challenge facing both DOD and the Army is to set these ground force modernization efforts on the best footing possible by buying the right capabilities at the best value. In many ways, DOD and the Army have set modernization efforts on a positive course, and they have an opportunity to reduce risks by adhering to the body of acquisition legislation and policy reforms--which incorporate knowledge-based best practices we identified in our previous work--that have been introduced since FCS started in 2003. The new legislation and policy reforms emphasize a knowledge-based acquisition approach, a cumulative process in which certain knowledge is acquired by key decision points before proceeding. In essence, knowledge supplants risk over time. Additionally, DOD and the Army can further reduce risks by considering lessons learned from problems that emerged during the FCS development effort. Initial indications are that the Army is moving in that direction. However, in the first major acquisition decision for the Army's post-FCS initiatives, DOD and the Army--because they want to support the warfighter quickly--are proceeding with low-rate initial production of one brigade set of Increment 1 systems despite having acknowledged that the systems are immature and unreliable and cannot perform as required. New Acquisition Reforms Point Way to Lower Risk: The body of acquisition legislation and DOD policy reforms introduced since FCS started in 2003 incorporates nearly all of the knowledge- based practices we identified in our previous work (see table 2). For example, DOD acquisition policy includes controls to ensure that programs have demonstrated a certain level of technology maturity, design stability, and production maturity before proceeding into the next phase of the acquisition process. As such, if the Army proceeds with preliminary plans for new acquisition programs, then adherence to the acquisition direction in each of its new acquisition efforts provides an opportunity to improve the odds for successful outcomes, reduce risks for follow-on Army ground force modernization efforts, and deliver needed equipment more quickly and at lower costs. Conversely, acquisition efforts that proceed with less technology, design, and manufacturing knowledge than best practices suggest face a higher risk of cost increases and schedule delays. Table 2: Comparison of Controls Used in Best Practices Model and DOD Policy: Knowledge point 1: Occurs as programs begin the engineering and manufacturing development phase (Milestone B). Match exists between requirements and resources. Technologies needed to meet essential product requirements have been demonstrated to work in their intended environments and the producer has completed a preliminary design of the product. Commercial best practices model: Demonstrate high technology readiness levels; May 2003 DOD policy: [Check]; December 2008 DOD policy: [Check]. Commercial best practices model: Ensure product requirements are informed by the systems engineering process; May 2003 DOD policy: [Check]; December 2008 DOD policy: [Check]. Commercial best practices model: Establish cost and schedule estimates for product based on knowledge from preliminary design using systems engineering tools; May 2003 DOD policy: [Empty]; December 2008 DOD policy: [Check]. Commercial best practices model: Conduct decision review for program launch; May 2003 DOD policy: [Check]; December 2008 DOD policy: [Check]. Knowledge point 2: Occurs at the critical design review between integration and demonstration. Design is stable and has been demonstrated through prototype testing. Ninety percent of engineering drawings are releasable to manufacturing organizations. Commercial best practices model: Complete 90 percent of design drawings; May 2003 DOD policy: [Empty]; December 2008 DOD policy: [A]. Commercial best practices model: Complete subsystem and system design reviews; May 2003 DOD policy: [Empty]; December 2008 DOD policy: [Check]. Commercial best practices model: Demonstrate with prototype that design meets requirements; May 2003 DOD policy: [Check]; December 2008 DOD policy: [Check]. Commercial best practices model: Obtain stakeholder concurrence that drawings are complete and producible; May 2003 DOD policy: [Empty]; December 2008 DOD policy: [B]. Commercial best practices model: Complete failure modes and effects analysis; May 2003 DOD policy: [Empty]; December 2008 DOD policy: [Check]. Commercial best practices model: Identify key system characteristics; May 2003 DOD policy: [Empty]; December 2008 DOD policy: [Check]. Commercial best practices model: Identify critical manufacturing processes; May 2003 DOD policy: [Empty]; December 2008 DOD policy: [Check]. Commercial best practices model: Establish reliability targets and growth plan based on demonstrated reliability rates of components and subsystems; May 2003 DOD policy: [Empty]; December 2008 DOD policy: [Check]. Commercial best practices model: Conduct design review to enter system demonstration; May 2003 DOD policy: [Check]; December 2008 DOD policy: [Check]. Knowledge point 3: Occurs at low-rate initial production commitment. Product is ready to be manufactured within cost, schedule, and quality targets. All key manufacturing processes are under statistical control and product reliability has been demonstrated. Commercial best practices model: Demonstrate manufacturing processes; May 2003 DOD policy: [Empty]; December 2008 DOD policy: [Check]. Commercial best practices model: Build production-representatives prototypes; May 2003 DOD policy: [Empty]; December 2008 DOD policy: [Check]. Commercial best practices model: Test production-representative prototypes to achieve reliability goal; May 2003 DOD policy: [Empty]; December 2008 DOD policy: [C]. Commercial best practices model: Test production-representative prototypes to demonstrate the product in a realistic environment; May 2003 DOD policy: [Empty]; December 2008 DOD policy: [Check]. Commercial best practices model: Collect statistical process control data; May 2003 DOD policy: [Empty]; December 2008 DOD policy: [Check]. Commercial best practices model: Demonstrate that critical processes are capable and under statistical control; May 2003 DOD policy: [Empty]; December 2008 DOD policy: [Check]. Commercial best practices model: Conduct decision review to begin production; May 2003 DOD policy: [Check]; December 2008 DOD policy: [Check]. Sources: DOD (data); GAO (analysis and presentation). [A] DOD criteria do not specify the percentage of drawings to be completed at the critical design review. [B] DOD's revised policy includes the post-critical design review assessment, which is the Milestone Decision Authority's assessment of the program manager's critical design review. However, we could not determine whether stakeholder concurrence was necessary to proceed. [C] DOD criteria establish reliability goals, but do not specify testing on production-representative prototypes. [End of table] As shown in table 2, the cumulative building of knowledge consists of information that should be gathered at three critical points over the course of a program: Knowledge point 1 (at the program launch or Milestone B decision): Establishing a business case that balances requirements with resources. At this point, a match must be made between the customer's needs and the developer's available resources--technology, engineering, knowledge, time, and funding. A high level of technology maturity, demonstrated via a prototype in its intended environment, indicates whether resources and requirements match. Also, the developer completes a preliminary design of the product that shows that the design is feasible and that requirements are predictable and doable. Knowledge point 2 (at the critical design review between design integration and demonstration): Gaining design knowledge and reducing integration risk. At this point, the product design is stable because it has been demonstrated to meet the customer's requirements as well as cost, schedule, and reliability targets. The best practice is to achieve design stability at the system-level critical design review, usually held midway through system development. Completion of at least 90 percent of engineering drawings at this point provides tangible evidence that the product's design is stable, and a prototype demonstration shows that the design is capable of meeting performance requirements. Knowledge point 3 (at production commitment or the Milestone C decision): Achieving predictable production. This point is achieved when it has been demonstrated that the developer can manufacture the product within cost, schedule, and quality targets. The best practice is to ensure that all critical manufacturing processes are in statistical control--that is, they are repeatable, sustainable, and capable of consistently producing parts within the product's quality tolerances and standards--at the start of production. The Army did not position the FCS program for success because it did not establish a knowledge-based acquisition approach--a strategy consistent with DOD policy and best acquisition practices--to develop FCS. The Army started the FCS program in 2003 before defining what the systems were going to be required to do and how they were going to interact. It moved ahead without determining whether the FCS concept could be developed in accordance with a sound business case. Specifically, at the FCS program's start, the Army had not established firm requirements, mature technologies, a realistic cost estimate, or an acquisition strategy wherein knowledge drives schedule. By 2009, the Army still had not shown that emerging FCS system designs could meet requirements, that critical technologies were at minimally acceptable maturity levels, and that the acquisition strategy was executable within estimated resources. With one notable exception, there are initial indications that DOD and the Army are moving forward to implement the acquisition policy reforms as they proceed with ground force modernization, including the Secretary of Defense's statement about the ground vehicle modernization program--to "get the acquisition right, even at the cost of delay." In addition, DOD anticipates that the GCV program will comply with DOD acquisition policy in terms of utilizing competitive system or subsystem prototypes. According to a DOD official, a meeting was recently held to consider a materiel development decision for the GCV, and the Army is proposing to conduct a preliminary design review on GCV before its planned Milestone B decision point. Additionally, a configuration steering board is planned for later in 2010 to address reliability and military utility of infantry brigade systems. Army's Decision to Proceed with Low-Rate Initial Production for Increment 1 Increases Risk: In the first major acquisition decision for the Army's post-FCS initiatives, DOD and the Army--because they want to support the warfighter quickly--are proceeding with low-rate initial production of Increment 1 systems despite having acknowledged that systems are immature, are unreliable, and cannot perform as required. In December 2009, the Under Secretary of Defense for Acquisition, Technology and Logistics approved low-rate initial production of Increment 1 equipment for one infantry brigade but noted that there is an aggressive risk reduction plan to grow and demonstrate the network maturity and reliability to support continued Increment 1 production and fielding. In the associated acquisition decision memorandum, the Under Secretary acknowledged the risks of pursuing Increment 1 production, including early network immaturity; lack of a clear operational perspective of the early network's value; and large reliability shortfalls of the network, systems, and sensors. The Under Secretary also said that he was aware of the importance of fielding systems to the current warfighter and that the flexibility to deploy components as available would allow DOD to "best support" the Secretary of Defense's direction to "win the wars we are in." Because of that, the Under Secretary specified that a number of actions be taken over the next year or more and directed the Army to work toward having all components for the program fielded as soon as possible and to deploy components of the program as they are ready. However, the Under Secretary did not specify the improvements that the Army needed to make or that those improvements are a prerequisite for the Under Secretary approving additional production lots of Increment 1. The approval for low-rate initial production is at variance with DOD policy and Army expectations. DOD's current acquisition policy requires that systems be demonstrated in their intended environments using the selected production-representative articles before the production decision occurs. However, the testing that formed the basis for the Increment 1 production decision included surrogates and non- production-representative systems, including the communications radios. As we have previously noted,[Footnote 7] testing with surrogates and non-production-representative systems is problematic because it does not conclusively show how well the systems can address current force capability gaps. Furthermore, Increment 1 systems--which are slated for a fiscal year 2011-12 fielding--do not yet meet the Army's expectations that new capabilities would be tested and their performance validated before being deployed in a capability package. As noted in 2009 test results, system performance and reliability during testing was marginal at best. For example, the demonstrated reliability of the Class I unmanned aerial vehicle was about 5 hours between failure, compared to a requirement for 23 hours between failure. The Army asserts that Increment 1 systems' maturity will improve rapidly but admits that it will be a "steep climb" and not a low-risk effort. While the Under Secretary took current warfighter needs into account in his decision to approve Increment 1 low-rate initial production, it is questionable whether the equipment can meet one of the main principles underpinning knowledge-based acquisition--whether the warfighter needs can best be met with the chosen concept. Test reports from late 2009 showed conclusively that the systems had limited performance, and that this reduced the test unit's ability to assess and refine tactics, techniques, and procedures associated with employment of the equipment. The Director, Operational Test and Evaluation recently reported that none of the Increment 1 systems have demonstrated an adequate level of performance to be fielded to units and employed in combat. Specifically, the report noted that reliability is poor and falls short of the level expected of an acquisition system at this stage of development. Shortfalls in meeting reliability requirements may adversely affect Increment 1's overall operational effectiveness and suitability and may increase life-cycle costs. In addition, in its 2009 assessment of the increment's limited user test--the last test before the production decision was made--the Army's Test and Evaluation Command indicated that the Increment 1 systems would be challenged to meet warfighter needs. It concluded that, with the exception of the non-line-of-sight launch system, which had not yet undergone flight testing, all the systems were considered operationally effective and survivable, but with limitations, because they were immature and had entered the test as pre-production- representative systems, pre-engineering design models, or both. Additionally, the command noted that these same systems were not operationally suitable because they did not meet required reliability expectations. In recent testimony before a House subcommittee, the Director, Operational Test and Evaluation stated that flight testing of the non- line-of-sight launch system was conducted in January and February 2010. In that testing, two of six missiles fired achieved target hits and four missed their targets. The Army informed the Director that Failure Review Board investigations of the flight failures are under way. Concluding Remarks: Army and DOD officials made a very difficult decision when they canceled what was the centerpiece of Army modernization--the FCS program. As they transition away from the FCS concept, both the Army and DOD have an opportunity to improve the likely outcomes for the Army's ground force modernization initiatives by adhering closely to recently enacted acquisition reforms and by seeking to avoid the numerous acquisition pitfalls that plagued FCS. As DOD and the Army proceed with these significant financial investments, they should keep in mind the Secretary of Defense's admonition about the new ground vehicle modernization program: "get the acquisition right, even at the cost of delay." Based on the preliminary plans, we see a number of good features, such as the Army's decision to pursue an incremental acquisition approach for its post-FCS efforts. However, it is vitally important that each of those incremental efforts adheres to knowledge- based acquisition principles and strikes a balance between what is needed, how fast it can be fielded, and how much it will cost. Moreover, the acquisition community needs to be held accountable for expected results, and DOD and the Army must not be willing to accept whatever results are delivered regardless of military utility. We are concerned that in their desire for speedy delivery of emerging equipment to our warfighters in the field, DOD and the Army did not strike the right balance in prematurely approving low-rate initial production of Increment 1 of brigade modernization. Although the Army argues that it needs to field these capabilities as soon as possible, none of these systems have been designated as urgent and it is not helpful to provide early capability to the warfighter if those capabilities are not technically mature and reliable. If the Army moves forward too fast with immature Increment 1 designs, then that could cause additional delays as the Army and its contractors concurrently address technology, design, and production issues. Production and fielding is not the appropriate phase of acquisition to be working on such basic design issues. In our recent report, we made recommendations intended to reduce the risk of proceeding into production with immature technologies. [Footnote 8] In that regard, we recommended that the Secretary of Defense mandate that the Army correct the identified maturity and reliability issues with the Increment 1 network and systems prior to approving any additional lots of the Increment 1 network and systems for production. Specifically, the Army should ensure that the network and the individual systems have been independently assessed as fully mature, meet reliability goals, and have been demonstrated to perform as expected using production-representative prototypes. We also recommended that the Secretary of the Army should not allow fielding of the Increment 1 network or any of the Increment 1 systems until the identified maturity and reliability issues have been corrected. In response, DOD concurred with our recommendations and stated that the need to correct those issues has been communicated to the Army. DOD also asserted that Increment 1 systems will be tested in their production configuration, and performance will be independently assessed against capability requirements prior to DOD approving production of any additional lots of Increment 1 systems. The Army has many Increment 1 development and testing activities planned for the coming months and we intend to monitor their progress closely. DOD also stated that Increment 1 systems would not be fielded until performance is sufficient to satisfy the warfighter's capability requirements. It is essential that (1) Increment 1 network and systems clearly demonstrate their ability to fully satisfy the needs of the warfighter and (2) DOD and the Army not be willing to accept whatever acquisition results are delivered regardless of their military utility. Again, we intend to follow the Army and DOD's activities and actions in the coming months. Mr. Chairman, this concludes my prepared statement. I would be happy to answer any questions you or members of the subcommittee may have. Contacts and Acknowledgments: For future questions about this statement, please contact Michael J. Sullivan at (202) 512-4841 or sullivanm@gao.gov. Contacts for our Offices of Congressional Relations and Public Affairs may be found on the last page of this testimony. Individuals making key contributions to this statement include William R. Graveline, Assistant Director; William C. Allbritton; Andrea M. Bivens; Noah B. Bleicher; Tana M. Davis; Marcus C. Ferguson; and Robert S. Swierczek. [End of section] Footnotes: [1] GAO, Defense Acquisitions: Opportunities Exist to Position Army's Ground Force Modernization Efforts for Success, [hyperlink, http://www.gao.gov/products/GAO-10-406] (Washington, D.C.: Mar. 15, 2010). [2] GAO, Defense Acquisitions: Decisions Needed to Shape Army's Combat Systems for the Future, [hyperlink, http://www.gao.gov/products/GAO-09-288] (Washington, D.C.: Mar. 12, 2009). [3] The system-of-systems common operating environment is the operating environment that serves as middleware between operating systems and software applications. [4] The Army had developed a concept of continual modernization of ready-to-go capabilities through biennial deliveries of what are called capability packages. [5] A materiel development decision is a review that is the formal entry point into the acquisition process and is mandatory for all programs. After the materiel development decision, the Milestone Decision Authority may approve entry into the acquisition management system at any point consistent with phase-specific entrance criteria and statutory requirements. [6] Milestone A is the point at which a program enters the technology development phase; Milestone B is entry into the engineering and manufacturing development phase; and Milestone C is entry into the production and deployment phase. [7] [hyperlink, http://www.gao.gov/products/GAO-09-288]. [8] [hyperlink, http://www.gao.gov/products/GAO-10-406]. [End of section] GAO's Mission: The Government Accountability Office, the audit, evaluation and investigative arm of Congress, exists to support Congress in meeting its constitutional responsibilities and to help improve the performance and accountability of the federal government for the American people. GAO examines the use of public funds; evaluates federal programs and policies; and provides analyses, recommendations, and other assistance to help Congress make informed oversight, policy, and funding decisions. GAO's commitment to good government is reflected in its core values of accountability, integrity, and reliability. Obtaining Copies of GAO Reports and Testimony: The fastest and easiest way to obtain copies of GAO documents at no cost is through GAO's Web site [hyperlink, http://www.gao.gov]. Each weekday, GAO posts newly released reports, testimony, and correspondence on its Web site. To have GAO e-mail you a list of newly posted products every afternoon, go to [hyperlink, http://www.gao.gov] and select "E-mail Updates." Order by Phone: The price of each GAO publication reflects GAO‘s actual cost of production and distribution and depends on the number of pages in the publication and whether the publication is printed in color or black and white. Pricing and ordering information is posted on GAO‘s Web site, [hyperlink, http://www.gao.gov/ordering.htm]. Place orders by calling (202) 512-6000, toll free (866) 801-7077, or TDD (202) 512-2537. Orders may be paid for using American Express, Discover Card, MasterCard, Visa, check, or money order. Call for additional information. To Report Fraud, Waste, and Abuse in Federal Programs: Contact: Web site: [hyperlink, http://www.gao.gov/fraudnet/fraudnet.htm]: E-mail: fraudnet@gao.gov: Automated answering system: (800) 424-5454 or (202) 512-7470: Congressional Relations: Ralph Dawn, Managing Director, dawnr@gao.gov: (202) 512-4400: U.S. Government Accountability Office: 441 G Street NW, Room 7125: Washington, D.C. 20548: Public Affairs: Chuck Young, Managing Director, youngc1@gao.gov: (202) 512-4800: U.S. Government Accountability Office: 441 G Street NW, Room 7149: Washington, D.C. 20548:

The Justia Government Accountability Office site republishes public reports retrieved from the U.S. GAO These reports should not be considered official, and do not necessarily reflect the views of Justia.