2010 Census

Redesigned Approach Holds Promise, but Census Bureau Needs to Annually Develop and Provide a Comprehensive Project Plan to Monitor Costs Gao ID: GAO-06-1009T July 27, 2006

The U.S. Census Bureau (Bureau) estimates that the 2010 Census will cost over $11.3 billion, making it the most expensive in our history. The U.S. House of Representatives and Senate appropriation bills propose to reduce the Bureau's fiscal year 2007 budget request, raising questions about the Bureau's design of the 2010 Census and associated costs. Based on issued GAO work, this testimony addresses the extent to which the Bureau has (1) made progress redesigning its approach, including nonresponse follow-up, a key cost driver; and (2) developed a comprehensive project plan for the 2010 Census, as well as timely, detailed cost data for effective oversight and cost control.

Since 2000, the Bureau has made significant progress in redesigning the 2010 Census. Preparations for the 2010 Census appear to be further along than at a similar point of the 2000 Census; the Bureau plans to make the most extensive use of contractors in its history to implement such mission-critical tasks as data collection and processing, and updating addresses and maps; and it has developed new initiatives, such as changing to a short-form-only census and automating field operations to reduce nonresponse follow-up costs. Still, the Bureau will have to resolve challenges that could increase the costs of the census. For example, the Bureau will need to effectively monitor contracts, as $1.9 billion of the $11.3 billion life-cycle costs will be spent on seven major contracts. The Bureau has agreed to take steps to mitigate some of these challenges, such as enhancing the ability of key contract project offices to better manage contracts through such actions as developing action plans with milestones for key activities and regularly briefing senior managers. Also, the use of hand-held mobile computing devices (MCD) to help reduce nonresponse follow-up costs by automating operations and managing the agency's payroll is a key component of the redesigned census. However, the MCDs experienced reliability problems during testing. The Bureau maintains that those problems will be fixed by developing a new MCD through a contract awarded in March 2006; however, the new MCD will not be tested until the 2008 Dress Rehearsal, and little time will remain to develop, test, and incorporate refinements if the MCDs do not perform as expected. If after the Dress Rehearsal the MCD is found to be unreliable, the Bureau could be faced with the remote but daunting possibility of having to revert to the costly paper-based census used in 2000. The Bureau has not developed and provided a comprehensive, integrated project plan that details milestones, itemized costs, and measurable goals for completing key activities. Also, the Bureau's $11.3 billion life-cycle cost estimate lacks timely and complete supporting data, because it does not contain the most current information from testing and evaluation nor does it provide sufficient information on how changing assumptions could affect costs. For example, one key assumption that has not been updated pertains to the use of the MCDs. The Bureau anticipates that their use could reduce administrative and support costs in its local census offices, including 50 percent cost reductions for staff and office space. However, the 2004 Census Test showed that more help desk staff and more storage space would be needed to support the devices. The Bureau did not change the life-cycle cost estimate because, in the view of Bureau managers, field tests are for operational purposes, not to inform cost estimates. However, using test results to update cost assumptions could assist the Bureau and external policymakers to oversee costs and make necessary resource allocations. Furthermore, absent a comprehensive plan and updated cost information, the effect of proposed 2007 budget reductions on the overall design and life-cycle costs of the 2010 Census cannot be determined.



GAO-06-1009T, 2010 Census: Redesigned Approach Holds Promise, but Census Bureau Needs to Annually Develop and Provide a Comprehensive Project Plan to Monitor Costs This is the accessible text file for GAO report number GAO-06-1009T entitled '2010 Census: Redesigned Approach Holds Promise, but Census Bureau Needs to Annually Develop and Provide a Comprehensive Project to Monitor Costs' which was released on July 27, 2006. This text file was formatted by the U.S. Government Accountability Office (GAO) to be accessible to users with visual impairments, as part of a longer term project to improve GAO products' accessibility. Every attempt has been made to maintain the structural and data integrity of the original printed product. Accessibility features, such as text descriptions of tables, consecutively numbered footnotes placed at the end of the file, and the text of agency comment letters, are provided but may not exactly duplicate the presentation or format of the printed version. The portable document format (PDF) file is an exact electronic replica of the printed version. We welcome your feedback. Please E-mail your comments regarding the contents or accessibility features of this document to Webmaster@gao.gov. This is a work of the U.S. government and is not subject to copyright protection in the United States. It may be reproduced and distributed in its entirety without further permission from GAO. Because this work may contain copyrighted images or other material, permission from the copyright holder may be necessary if you wish to reproduce this material separately. Testimony: Before the Subcommittee on Science, the Departments of State, Justice, and Commerce, and Related Agencies, Committee on Appropriations, U.S. House of Representatives: United States Government Accountability Office: GAO: For Release on Delivery Expected at 9:30 a.m. EDT: Thursday, July 27, 2006: 2010 census: Redesigned Approach Holds Promise, but Census Bureau Needs to Annually Develop and Provide a Comprehensive Project Plan to Monitor Costs: Statement of Brenda S. Farrell Acting Director, Strategic Issues: GAO-06-1009T: GAO Highlights: Highlights of GAO-06-1009T, a testimony before the Subcommittee on Science, the Departments of State, Justice, and Commerce, and Related Agencies, Committee on Appropriations, House of Representatives Why GAO Did This Study: The U.S. Census Bureau (Bureau) estimates that the 2010 Census will cost over $11.3 billion, making it the most expensive in our history. The U.S. House of Representatives and Senate appropriation bills propose to reduce the Bureau‘s fiscal year 2007 budget request, raising questions about the Bureau‘s design of the 2010 Census and associated costs. Based on issued GAO work, this testimony addresses the extent to which the Bureau has (1) made progress redesigning its approach, including nonresponse follow-up, a key cost driver; and (2) developed a comprehensive project plan for the 2010 Census, as well as timely, detailed cost data for effective oversight and cost control. What GAO Found: Since 2000, the Bureau has made significant progress in redesigning the 2010 Census. Preparations for the 2010 Census appear to be further along than at a similar point of the 2000 Census; the Bureau plans to make the most extensive use of contractors in its history to implement such mission-critical tasks as data collection and processing, and updating addresses and maps; and it has developed new initiatives, such as changing to a short-form-only census and automating field operations to reduce nonresponse follow-up costs. Still, the Bureau will have to resolve challenges that could increase the costs of the census. For example, the Bureau will need to effectively monitor contracts, as $1.9 billion of the $11.3 billion life-cycle costs will be spent on seven major contracts. The Bureau has agreed to take steps to mitigate some of these challenges, such as enhancing the ability of key contract project offices to better manage contracts through such actions as developing action plans with milestones for key activities and regularly briefing senior managers. Also, the use of hand-held mobile computing devices (MCD) to help reduce nonresponse follow-up costs by automating operations and managing the agency‘s payroll is a key component of the redesigned census. However, the MCDs experienced reliability problems during testing. The Bureau maintains that those problems will be fixed by developing a new MCD through a contract awarded in March 2006; however, the new MCD will not be tested until the 2008 Dress Rehearsal, and little time will remain to develop, test, and incorporate refinements if the MCDs do not perform as expected. If after the Dress Rehearsal the MCD is found to be unreliable, the Bureau could be faced with the remote but daunting possibility of having to revert to the costly paper-based census used in 2000. The Bureau has not developed and provided a comprehensive, integrated project plan that details milestones, itemized costs, and measurable goals for completing key activities. Also, the Bureau‘s $11.3 billion life-cycle cost estimate lacks timely and complete supporting data, because it does not contain the most current information from testing and evaluation nor does it provide sufficient information on how changing assumptions could affect costs. For example, one key assumption that has not been updated pertains to the use of the MCDs. The Bureau anticipates that their use could reduce administrative and support costs in its local census offices, including 50 percent cost reductions for staff and office space. However, the 2004 Census Test showed that more help desk staff and more storage space would be needed to support the devices. The Bureau did not change the life-cycle cost estimate because, in the view of Bureau managers, field tests are for operational purposes, not to inform cost estimates. However, using test results to update cost assumptions could assist the Bureau and external policymakers to oversee costs and make necessary resource allocations. Furthermore, absent a comprehensive plan and updated cost information, the effect of proposed 2007 budget reductions on the overall design and life-cycle costs of the 2010 Census cannot be determined. What GAO Recommends: A January 2004 GAO report recommended that the Bureau develop a comprehensive project plan for the 2010 Census that would include milestones, itemized costs, and measurable goals. While the Bureau disagreed with the recommendation, it stated it would provide such a plan to Congress and GAO. More than 2 years passed and the Bureau did not provide this plan. In testimonies during March and June 2006, GAO reemphasized the need for such a plan. GAO still believes that in this era of serious budget challenges, it is important for the Bureau to implement this recommendation not only for the upcoming fiscal year budget but every fiscal year of the 2010 Census‘ life-cycle. In written comments on a draft of this report, OMB‘s acting administrator for the Office of Information and Regulatory Affairs agreed with the recommendations. [Hyperlink, http://www.gao.gov/cgi-bin/getrpt?GAO-06-1009T]. To view the full product, including the scope and methodology, click on the link above. For more information, contact Brenda S. Farrell at (202) 512-6806 or farrellb@gao.gov [End of Section] Mr. Chairman, Mr. Mollohan, and Members of the Subcommittee: Thank you for the opportunity to be here today to discuss the overall design of the 2010 Census and associated costs, in light of proposed budget reductions[Footnote 1] totaling approximately $50 million from the U.S. Census Bureau's (Bureau) $878 million fiscal year 2007 budget request. First, let me emphasize that the Bureau, which is a part of the Commerce Department, is aware of the need to contain 2010 Census costs and has taken some actions, including early planning, to contain those costs. In fact, one of the Bureau's stated goals for the 2010 Census is to contain costs. However, according to the Bureau's estimate, the 2010 Census will be the most expensive census in our nation's history, even after adjusting for inflation, totaling over $11.3 billion. Based on our issued work, my testimony today specifically addresses the extent to which the Bureau has (1) made progress redesigning its approach, including actions related to nonresponse follow-up, a key cost driver; and (2) developed a comprehensive, integrated project plan for the 2010 Census, as well as timely, detailed cost data for effective oversight and cost control. My main point today is that while the Bureau has planned early and reengineered the decennial census to contain costs, the Bureau has not developed and provided a comprehensive, integrated project plan to help monitor costs; and the Bureau's September 2005 life-cycle cost estimate for the 2010 Census does not reflect current information from testing and evaluation, lacks detailed information, and does not make clear the relationship between various cost drivers and the ultimate estimate. As a result, the impact of proposed reductions to the Bureau's fiscal year 2007 budget request can not be determined. Today's hearing is particularly crucial as many decennial activities will be finalized in fiscal year 2007, while others will just be getting started. The Bureau is completing the last of its field tests- -the 2006 Census Test, being held in the central portion of Travis County, Texas, and at the Cheyenne River American Indian Reservation and Tribal Trust Lands in South Dakota, where the Bureau is evaluating key operations and the type of equipment that it plans to employ for the full enumeration in 2010. The evaluations from 2006 testing, the content for the 2010 census questionnaire, and the baselining of all 2010 program requirements are also being finalized in 2007. We agree with Bureau officials who stated that, as 2010 approaches it becomes increasingly more difficult to make significant changes to the decennial's design without affecting the overall success of the census. A major milestone getting underway in 2007 will be the preparatory activities for a "Dress Rehearsal" scheduled for 2008 in San Joaquin County, California, and nine counties in Eastern North Carolina, including the city of Fayetteville. While "Census Day" for the Dress Rehearsal is April 1, 2008, preparations--such as opening the local census offices, recruiting and hiring, and updating and verifying the address file--will take place during fiscal year 2007. Finally, with three major contracts already in place, in 2007, the Bureau plans to award three of four remaining major 2010 decennial contracts. The decennial census is a crucial, constitutionally mandated activity undertaken by the Bureau. The stakes for a successful census are very high. The data that the census produces are used to reapportion the seats of the U.S. House of Representatives; realign the boundaries of the legislative districts of each state; allocate about $200 billion dollars each year in federal financial assistance; and provide a social, demographic, and economic profile of the nation's people to guide policy decisions at each level of government. Further, businesses use census data to target new services and products and to tailor existing ones to demographic changes. Over the decades, the decennial census has grown in cost and complexity, and we have been reviewing the national enumeration on behalf of Congress. Over the years, through scores of reports and testimonies, we have acquired broad institutional knowledge that gives us a historical view of the key ingredients of a successful census. One such ingredient is strong and continued congressional involvement in the decisions that influence the direction of the census. As you are keenly aware, Mr. Chairman, congressional support and funding of the reengineered census are essential to the ultimate success of the decennial. As a backdrop for this testimony, I want to highlight several broad themes that have emerged from our work over the years--lenses really-- through which to view the Bureau's business environment. They are important because they ultimately affect the Bureau's readiness to conduct the census and the quality of the results. First, completing the decennial census is a monumental undertaking, and the Bureau recognizes that streamlined and efficient operations are critical for the census' cost-effectiveness. The Census' sheer size and complexity make it a risky and fragile enterprise. The 2000 Census, for example, involved the hiring of more than 500,000 enumerators on a temporary basis, opening 511 local census offices and 24,000 questionnaire assistance centers nationwide, processing 1.5 billion sheets of paper, and in 10 weeks following up with 42 million nonrespondent households. The size of the census means that small problems can magnify quickly, and big problems could be overwhelming. For example, 60 seconds might seem like an inconsequential amount of time, but in 2000, if enumerators had spent just 1 minute more at each household during nonresponse follow-up, almost $10 million would have been added to the cost of the census, assuming a pay rate of around $13 per hour, with wages ranging from $8.25 to $18.50 per hour for enumerators in 2000, depending on the location. Second, sound risk management is important to a successful census because many risks are interrelated, and a shortcoming in one operation could cause other operations to spiral downward. For example, a low mail response rate would drive up the follow-up workload, which in turn would increase staffing needs and costs (of course, the reverse is also true, where a success in one operation could have a number of positive downstream impacts). Rigorous up-front planning and testing, as well as risk mitigation plans, are the best ways to stave off these problems. In the 2000 Census, the Bureau successfully planned and mitigated risk in recruiting and hiring workers by using management information systems capable of tracking key operations with real-time measures. To recruit the vast army of people needed to fill the ranks of its workforce for the 2000 Census, the Bureau set a recruitment goal of 2.4 million qualified applicants. Because the Bureau tracked the progress local census offices were making in meeting their individual goals, it was able to mitigate risk by quickly raising pay rates and taking other actions at those offices where recruitment was lagging. In the end, the Bureau exceeded its recruitment goal by 100,000 applicants. Third, the census is conducted against a backdrop of immutable deadlines; the census' elaborate chain of interrelated pre-and post- Census Day activities is predicated upon those dates. The Secretary of Commerce is legally required to (1) conduct the census on April 1 of the decennial year, (2) report the state population counts to the President for purposes of congressional apportionment by December 31 of the decennial year, and (3) send population tabulations to the states for purposes of redistricting no later than 1 year after the April 1 census date. To meet these legally mandated reporting requirements, census activities need to take place at specific times and in the proper sequence. We agree with Bureau officials who recently stated that the design and plans being implemented are too far down the road and time is too short to allow for significant adjustments to be effectively implemented. In fact, as Census Day approaches, the tolerance for any operational changes becomes increasingly small. Indeed, considerable risk and cost increases could accompany design changes that occur late in the decade. My remarks today are based on GAO-issued work on the planning and development of the 2010 Census. These reports are listed in attachment I. We analyzed Bureau cost and planning documents and data and interviewed key Bureau officials regarding the 2004 and 2006 Census Tests, contract monitoring, and the life-cycle cost estimate. In conducting our work, we visited the Texas and South Dakota test sites; Queens, New York; and several counties in rural south-central Georgia, where an earlier field test was held in 2004. During these visits we observed the address-canvassing operation, where workers go door to door verifying addresses and updating maps as part of the Bureau's effort to build a complete and accurate address list, and we observed the nonresponse follow-up operation, in which enumerators collect information from those households that do not return their initial questionnaire. We conducted our work in accordance with generally accepted government auditing standards. The Bureau Has Made Significant Progress Preparing for the 2010 Census: The Bureau has made significant progress redesigning its approach for conducting the 2010 Census, including early planning, a greater reliance on contractors, and actions related to nonresponse follow-up, a key cost driver. Specifically, the Bureau's preparations for the 2010 Census appear to be further along than at a similar point during the planning cycle for the 2000 Census. The Bureau also plans to make the most extensive use of contractors in its history, turning to the private sector to supply a number of different mission-critical functions, including data collection, data processing, and address and map updates. In addition, the Bureau has developed new initiatives to reduce the cost of nonresponse follow-up that include using a short- form-only census questionnaire and automating field operations. The Design of the 2010 Census Shows Promise: For the 2010 decennial, the Bureau developed a design for the census early in the decade, and Congress has been supportive of the Bureau's approach. However, the situation 10 years ago for the 2000 decennial was somewhat different. In testimony before Congress in late 1995, we expressed concern that Congress and the Bureau had not agreed on the fundamental design and budget of the census, and that the longer this situation continued, the greater the risk that the census would not be planned well and that hundreds of millions of dollars would be spent inefficiently.[Footnote 2] Indeed, the final life-cycle cost for the 2000 Census exceeded the original estimates by about $1.5 billion, or about 30 percent. While this time the Bureau has planned earlier than in the past, it needs to do more. The Bureau has a significant responsibility to provide Congress with detailed documentation and analyses that provide support and justification for its 2007 budget and 2010 life-cycle cost estimate, especially during a time when the nation is facing serious fiscal challenges. In our view, the Bureau needs to inform Congress in a timely manner on the cost and progress being made toward a successful 2010 Census. In planning early for the 2010 Census, the Bureau established four goals aimed at addressing shortcomings with the 2000 enumeration: (1) increase the relevance and timeliness of data, (2) reduce operational risk, (3) increase coverage and accuracy, and (4) contain costs. To achieve these goals, three components--all new operations--are key to the Bureau's plans for 2010: * enhancing procedures for building its address list, known as the Master Address File (MAF), and its associated geographic information system, called the Topologically Integrated Geographic Encoding and Referencing (TIGER®) database;[Footnote 3] * replacing the census long-form questionnaire with the American Community Survey (ACS)[Footnote 4]; and: * conducting a short-form-only decennial census supported by early research and testing. Steps that the Bureau has taken to correct problems it encountered when planning past censuses are another sign of the thoroughness of the Bureau's planning process. For example, early in the decade, senior Bureau staff considered various goals for the 2010 Census and articulated a design to achieve those goals. Moreover, staff with operational experience in the census participated in the 2010 design process. According to Bureau officials, this was a departure from the 2000 planning effort, in which Bureau staff with little operational experience played key roles in the design process, resulting in impractical reform ideas that could not be implemented. Bureau Will Make Extensive Use of Contractors for 2010 Census: For the 2010 Census the Bureau plans to make the most extensive use of contractors in its history, turning to the private sector to supply a number of different mission-critical functions, including nationwide data collection and processing activities, and improvements to the address file and maps. The Bureau estimates that of the $11.3 billion total cost of the census, around $1.9 billion (or 17 percent) will be spent for its seven largest contracts. To date, the Bureau has awarded three of its seven major contracts that account for approximately $1.3 billion. Those contracts support (1) MAF/TIGER modernization; (2) the development and operation of the Decennial Response and Integration System (DRIS)--a system planned to integrate decennial responses; and (3) the Field Data Collection Automation (FDCA) program--a system designed to provide field staff with the equipment and infrastructure needed to collect census data. As detailed below, it will be important for the Bureau to monitor the contracts to avoid late design changes and hastily designed, untested systems that could result in additional costs. In fiscal year 2007, the Bureau will also award three of four remaining major decennial contracts as follows: * in February 2007, the Bureau plans to award the contract for Data Access and Dissemination System II, which will replace the Bureau's current data tabulation and dissemination system; * in March or April 2007, the 2010 Census printing contract will be awarded; and, * in April 2007, the Bureau will begin to lease office space for the 2010 Census. The exact date for the 2010 communications contract--which is set to be awarded sometime in fiscal year 2008--is not yet firmly established. As we noted in our May 2006 report, the Bureau has a tight schedule for systems development and testing; therefore, it will be important for the Bureau to keep the award of decennial contracts on schedule. To stay on schedule, we recommended that the Bureau ensure that key systems provided by contractors are fully functional and ready to be assessed as part of the 2008 Dress Rehearsal.[Footnote 5] While the Bureau neither agreed nor disagreed with this recommendation, the Bureau did state that it would be providing the results from the 2006 Census Test to the FDCA contractor. Staying on track is important because we previously reported that during the 1998 Dress Rehearsal for the 2000 Census a number of new features were not test-ready; as a result, the Bureau said it could not fully evaluate them with any degree of assurance as to how they would affect the census.[Footnote 6] These late design changes and hastily developed, untested systems resulted in additional costs to the census. We recognize that contractors can help the Bureau address the challenges it faces as it plans for and implements the 2010 Census, especially as it becomes increasingly difficult to count the nation's population with the Bureau's in-house staff and capabilities. For example, the contractors that the Bureau relied on to perform some of its major decennial activities during Census 2000 generally performed well.[Footnote 7] However, increased reliance on contractors entails certain management challenges, including overseeing them to ensure that they meet the Bureau's needs in an effective, economical, and timely manner. For example, according to the Department of Commerce Office of Inspector General, the Bureau did not have sufficient program management staff to efficiently acquire systems and manage complex, high-dollar contracts during Census 2000.[Footnote 8] As a result, the cost of the Bureau's data capture system increased from $49 million to $238 million by the end of that decennial. Closely monitoring these major contracts will be important. In March 2006, we testified that while project offices responsible for the DRIS and FDCA contracts had carried out initial acquisition management activities, neither office had the full set of capabilities needed to effectively manage the acquisitions.[Footnote 9] For DRIS, the Bureau's project office had established baseline requirements, but the Bureau had not validated the requirements and had not implemented a process for managing the requirements. Also, the project office had identified the project's risks but had not developed written mitigation plans or established milestones for completing key risk mitigation activities. As for FDCA, the Bureau again had specified baseline requirements but had not validated them. While the project office had begun activities to oversee the contractor's performance, it had not determined which performance measures it would use, and the office had not implemented a risk management process. Until these basic management activities are implemented, both systems could face increased risks of cost overruns, schedule delays, and performance shortfalls. The Bureau has agreed to take steps to mitigate some of these challenges, such as enhancing the ability of key contract project offices to better manage contracts through such actions as developing action plans with milestones for key activities and regularly briefing senior managers. Bureau Has Taken Steps to Reduce Nonresponse Follow-up Costs, but Challenges with Technology Remain: Since 2000, the Bureau has reengineered the decennial census and has begun to implement new initiatives to reduce the cost of nonresponse follow-up, including a short-form-only census and automation, the key feature of which is the use of hand-held mobile computing devices (MCD). First, the Bureau plans to contain the cost of nonresponse follow-up by increasing mail response through a short-form-only census. The overall mail response rate has been declining steadily since 1970. In the 1980 Census, the mail response rate was 75 percent, 3 percentage points lower than it was in the 1970 Census. In the 1990 census, the mail response rate dropped to 65 percent and, in 2000, appeared to be leveling off at about 64 percent. Contributing to this decline was the unwillingness of some of the public to complete the long form. Specifically, the response rates during the 1990 and 2000 censuses to the short form were higher than the response rate to the long form. Bureau data suggest a 1 percent increase in the mail response rate would result from conducting a short-form-only census. Secondly, by using the MCD, the Bureau plans to automate field data collection to contain the cost of nonresponse follow-up. If successfully used, the MCD would allow the Bureau to automate operations and eliminate the need to print millions of paper questionnaires and maps used by census workers to conduct address canvassing and nonresponse follow-up, as well as managing field staff's payroll. The benefits of using the MCD have been tested in the 2004 and 2006 tests. For example, during the 2004 Census Test, the MCD allowed the Bureau to successfully remove over 7,000 late mail returns from enumerators' assignments, reducing the total nonresponse follow-up workload by nearly 6 percent. The ability to remove late mail returns from the Bureau's nonresponse follow-up workload reduces costs, because census workers no longer need to make expensive follow-up visits to households that return their questionnaire after the mail-back deadline. However, the MCDs experienced significant reliability problems during the 2004 and 2006 census tests. At this point, the uncertainty surrounding the MCD's reliability constitutes a risk to the cost- effective implementation of the 2010 Census. Specifically, during the 2004 Census Test, the MCDs experienced transmission problems, memory overloads, and difficulties with a mapping feature--all of which added inefficiencies to the test's nonresponse follow-up operation.[Footnote 10] During the 2006 Census Test's address canvassing operation, the device was slow to pull up address data and accept the data entered by census workers. Further, the MCD's global positioning system (GPS) receiver--a satellite-based navigational system to help workers locate street addresses and collect coordinates for each structure in their assignment area--was also unreliable. According to Bureau officials, some workers had trouble receiving signals; but even when a signal was available, the receiver was slow to find assignment areas and correct map locations. The Bureau extended the operation 10 days and still was unable to complete the job, leaving census blocks in Austin, Texas and on the Cheyenne River Reservation, South Dakota unverified. While acknowledging that the MCD's performance is an issue, the Bureau believes the problem will be addressed through a contract that was awarded on March 30, 2006, to develop a new MCD, among other things. However, the new MCD will not be operationally tested until the 2008 Dress Rehearsal, and if problems do emerge, little time will be left to develop, test, and incorporate refinements. In our May 2006 report, we highlighted the tight time frames to develop the MCD and recommended that systems being developed or provided by contractors for the 2010 Census--including the MCD--be fully functional and ready to be assessed as part of the 2008 Dress Rehearsal.[Footnote 11] The Department of Commerce noted in its comments on our draft report that the Bureau provided competitors for the contract with information about the design, requirements, and specification for the 2006 test in the request for proposals. Commerce also noted that the Bureau would share preliminary results from the 2006 test with the firm that was awarded the contract, upon the availability of those results. The Bureau, however, did not specify when preliminary results would be available. If after the 2008 Dress Rehearsal the MCD is found not to be reliable, the Bureau could be faced with a remote but daunting possibility of having to revert to the costly, paper-based census used in 2000. The Bureau in its 2005 life-cycle cost estimate did indicate that if it were to conduct a paper-based census in 2010 using the same methods as 2000, the life-cycle cost would increase by $1.3 billion dollars. However, as discussed in more detail later in this testimony, we are unable to determine the validity of the Bureau's cost estimates, paper- based or not, because those estimates are not supported by timely and detailed data. Nevertheless, we support the Bureau's efforts to contain cost and look forward to seeing the MCD that is currently being designed under the FDCA contract as well as more details concerning the Bureau's cost estimates. Bureau Does Not Have Sufficient Planning and Cost Documentation for the 2010 Census: Despite its emphasis on cost containment, the Bureau does not have a comprehensive, integrated project plan that details milestones and itemized costs for completing key activities for the 2010 Census, and its $11.3 billion life-cycle cost estimate for the 2010 Census lacks timely and complete supporting data. The supporting data of the estimate are not timely because they do not include the most current information from testing and evaluation, and the estimate is not complete because it does not provide sufficient information on how changing assumptions could affect cost. Absent this information, we are unable to determine the affect proposed budget reductions will have in 2007, as well as the impact of those reductions on the overall design and the Bureau's 2010 life-cycle cost estimate. Cost for Each Decennial Census Continues to Significantly Increase: In our January 2004 report, we reported that the Bureau's cost projections for the 2010 decennial census continue an escalating trend.[Footnote 12] As previously noted, the Bureau now estimates the 2010 Census will cost over $11.3 billion, making it the most expensive in history, even after adjusting for inflation. Although some cost growth can be expected, in part because the number of housing units-- and hence the Bureau's workload--has become larger, the cost growth has far exceeded the increase in the number of housing units. For example, the Bureau estimates that the number of housing units for the 2010 Census will increase by 10 percent over 2000 Census levels, while the average cost per housing unit for 2010 is expected to increase by approximately 29 percent from 2000 levels. Moreover, the risk exists that the actual, final cost of the census could be considerably higher. Indeed, the Bureau's initial cost projections for previous censuses proved to be too low because of such factors as unforeseen operational problems or changes to the fundamental design. For example, during the 2000 Census, the Bureau was unable to finalize its fundamental design until late in the decade because of lack of agreement between the administration and Congress over the design. This required the Bureau to proceed down a dual track. The Bureau estimated that the 2000 Census would cost around $4 billion if sampling was used, as opposed to $5 billion for a traditional census without sampling. In the end, the price tag for the 2000 Census (without sampling) was over $6.5 billion, a 30 percent increase in cost. Bureau Has Not Provided a 2010 Comprehensive Project Plan: Our January 2004 report contained a recommendation for improving the transparency, comprehensiveness, and timeliness of the 2010 Census' life-cycle costs. We specifically recommended that the Bureau develop a comprehensive, integrated project plan for the 2010 Census, and we also emphasized the importance of providing information on the interrelationships and dependencies among project milestones. Such a project plan would be updated as needed and would include: (1) detailed milestones that identify all significant interrelationships; (2) itemized estimated costs of each component, including a sensitivity analysis, and an explanation of significant changes in the assumptions on which these costs are based; (3) key goals translated into measurable, operational terms to provide meaningful guidance for planning and measuring progress, and (4) risk and mitigation plans that fully address all significant potential risks. We noted then that, although some of this information is available piecemeal, to facilitate a thorough, independent review of the Bureau's plans and hold the agency accountable for results, having a single, comprehensive document would be important. Although the Bureau disagreed with the recommendation, it stated it would develop and provide such a document to Congress and GAO. More than 2 years passed and the Bureau did not provide this plan. The Bureau has stated that it agrees with the Office of Management and Budget that the annual budget submission process is the appropriate vehicle for providing comprehensive and detailed cost information on 2010 Census planning. However, in our view, having a single comprehensive project plan that is updated annually, as we recommended in 2004, would have provided the Bureau with additional support for its fiscal year 2007 budget request. Further, GAO reemphasized the need for such a plan in testimonies during March and June 2006. 2010 Cost Estimate Lacks Timely and Complete Information: The Bureau's most recent cost estimate is not based on timely and complete information. As stated in our January 2004 report, the Bureau derived its 2010 cost estimate, in June 2001, by using the actual cost of the 2000 Census combined with assumptions about such cost drivers as (1) staffing needs, (2) enumerator productivity, (3) pay rates for census workers, (4) the nonresponse rate for mailing back the questionnaires,[Footnote 13] and (5) inflation.[Footnote 14] However, the most recent life-cycle cost estimate[Footnote 15] does not incorporate current information about assumptions made in 2001, leaving us unable to link information on assumptions among the cost estimates released in 2001, 2003, and 2005. For example, one key assumption that has not been updated pertains to the use of a new technology--new hand- held, GPS-enabled MCDs. These devices are important to the success of the 2010 census because they are expected to make possible automated and streamlined address canvassing, nonresponse follow-up, coverage measurement, and payroll operations. The Bureau anticipated that the use of MCDs would facilitate reductions in administrative and support costs in the Bureau's field offices, including a 50 percent reduction in clerical and administrative local census office staff costs and a 50 percent reduction in space at each local census office. However, the Bureau's existing assumptions about the use and reliability of the MCD were not updated to reflect information from the 2004 Census Test, which revealed that assumptions about staffing and space associated with the new technology had changed since the June 2001 life-cycle estimate. Specifically, Bureau evaluations of the 2004 test show that more help desk staff at the local census office were needed to support the use of the MCD, and additional storage space was needed for the devices. However, the Bureau did not use this information when revising its cost estimate in 2005 because, according to Bureau officials, they conduct field tests for operational purposes only--not to inform the cost estimates. In our view, revising cost estimates on the most recent information--including test results that are pertinent to cost assumptions--can assist the Bureau and external decision makers to oversee costs and make necessary resource allocations to help ensure a successful, cost-effective census. The Bureau's cost estimate also lacks complete information, such as sensitivity analysis regarding assumptions that could affect cost drivers. OMB Circular A-94 provides guidelines for cost-benefit analysis of federal programs and recommends that agencies develop a sensitivity analysis for major projects with significant uncertainty, like the decennial census. The circular provides a method for determining how sensitive outcomes relate to changes in assumptions. In January 2004, we reported that the Bureau could provide more robust information on the likelihood that the values the Bureau assigned to key cost drivers could differ from those initially assumed. We also stated that updates of the life-cycle cost could be timelier-- previously the life-cycle cost estimate had been provided at 2-year intervals.[Footnote 16] While the Bureau agreed to provide updates of the life-cycle cost annually, the Bureau's latest life-cycle cost document does not contain a sensitivity analysis on assumptions that impact cost. Having transparent information about cost estimates is especially important, because decennial costs are sensitive to many key assumptions. In fact, for the 2000 Census, the Bureau's supplemental funding request for $1.7 billion in fiscal year 2000 primarily involved changes in assumptions related to increased workload, reduced employee productivity, and increased advertising. Given the cost of the census in an era of serious national fiscal challenges, it would be beneficial for the Bureau and Congress to have sensitivity information about the likelihood--high, medium, or low--that certain assumptions would drive costs. By providing this information, the Bureau would better enable Congress to consider funding levels in this uncertain environment. Conclusions: Questions have been raised about the impact of proposed reductions in the Bureau's fiscal year 2007 overall budget request. Would such a budgetary change cause the dramatic changes in the decennial's overall design and life-cycle cost that the Bureau predicts? The answer is that given the lack of consolidated, timely, and detailed plans and cost estimates, we simply cannot tell. Importantly, this testimony notes that the preparatory steps for the 2010 Census have almost reached a point where the Bureau will no longer be able to effectively undertake design changes and other significant corrective actions if such are needed--for example, in response to unanticipated failures of the MCD. To help policymakers make informed decisions, including funding decisions, the Bureau needs to provide policymakers with comprehensive, timely, and updated information. As we have previously reported, the Bureau has planned earlier than in the past and that its plans and efforts to reengineer the census have potential to contain costs. However, we believe the Bureau needs to do more. In this testimony, as well as in our previous reports and testimonies, we have discussed the Bureau's ongoing emphasis on reengineering the census to contain costs. We have noted that while the $11.3 billion estimate makes the 2010 Census the most expensive in history, new cost drivers have emerged. As we previously recommended, a periodically updated comprehensive project plan and cost estimate that is supported by transparent, detailed, and comprehensive analyses and documentation would enable analysts, policymakers, and others to ascertain whether significant risks exist that could cause costs to increase. We believe that in this era of serious national budget challenges, it is important for the Bureau to implement our 2004 recommendation not only for this fiscal year but every fiscal year of the 2010 decennial life-cycle. To conduct its oversight and budgetary functions, Congress needs the Bureau to provide it with an annually updated comprehensive, integrated project plan which includes milestones, itemized costs, measurable goals, and risk mitigation plans. That concludes my statement, Mr. Chairman. I would be pleased to respond to any questions you or other members of the Subcommittee may have. Contacts and Acknowledgments: For questions regarding this testimony, please contact Brenda S. Farrell, on (202) 512-6806, or by email at farrellb@gao.gov. Individuals making contributions to this testimony include Carlos Hazera, Assistant Director; Mike Carley, Betty Clark, Robert Goldenkoff, , Shirley Hwang, Wright Lewis, Krista Loose, Lisa Pearson, Scott Purdy, Mark Ryan, Shannon VanCleave, and Timothy Wexler. [End of section] Attachment I: Related Products by GAO: GAO Products: 2010 Census: Census Bureau Needs to Take Prompt Actions to Resolve Long- standing and Emerging Address and Mapping Challenges. GAO-06-272. Washington, D.C.: June 15, 2006. 2010 Census: Costs and Risks Must be Closely Monitored and Evaluated with Mitigation Plans in Place. GAO-06-822T. Washington, D.C.: June 6, 2006. 2010 Census: Census Bureau Generally Follows Selected Leading Acquisition Planning Practices, but Continued Management Attentions Is Needed to Help Ensure Success. GAO-06-277. Washington, D.C.: May 18, 2006. Census Bureau: Important Activities for Improving Management of Key 2010 Decennial Acquisitions Remain to be Done. GAO-06-444T. Washington, D.C.: March 1, 2006. 2010 Census: Planning and Testing Activities Are Making Progress. GAO- 06-465T. Washington D.C.: March 1, 2006. Information Technology Management: Census Bureau Has Implemented Many Key Practices, but Additional Actions Are Needed. GAO-05-661. Washington, D.C.: June 16, 2005. 2010 Census: Basic Design Has Potential, but Remaining Challenges Need Prompt Resolution. GAO-05-09. Washington, D.C.: January 12, 2005. Data Quality: Census Bureau Needs to Accelerate Efforts to Develop and Implement Data Quality Review Standards. GAO-05-86. Washington, D.C.: November 17, 2004. Census 2000: Design Choices Contributed to Inaccuracies in Coverage Evaluation Estimates. GAO-05-71. Washington, D.C.: November 12, 2004. American Community Survey: Key Unresolved Issues. GAO-05-82. Washington, D.C.: October 8, 2004. 2010 Census: Counting Americans Overseas as Part of the Decennial Census Would Not Be Cost-Effective. GAO-04-898. Washington, D.C.: August 19, 2004. 2010 Census: Overseas Enumeration Test Raises Need for Clear Policy Direction. GAO-04-470. Washington, D.C.: May 21, 2004. 2010 Census: Cost and Design Issues Need to Be Addressed Soon. GAO-04- 37. Washington, D.C.: January 15, 2004. Decennial Census: Lessons Learned for Locating and Counting Migrant and Seasonal Farm Workers. GAO-03-605. Washington, D.C.: July 3, 2003. Decennial Census: Methods for Collecting and Reporting Hispanic Subgroup Data Need Refinement. GAO-03-228. Washington, D.C.: January 17, 2003. Decennial Census: Methods for Collecting and Reporting Data on the Homeless and Others Without Conventional Housing Need Refinement. GAO- 03-227. Washington, D.C.: January 17, 2003. 2000 Census: Lessons Learned for Planning a More Cost-Effective 2010 Census. GAO-03-40. Washington, D.C.: October 31, 2002. The American Community Survey: Accuracy and Timeliness Issues. GAO-02- 956R. Washington, D.C.: September 30, 2002. FOOTNOTES [1] Science, State, Justice, Commerce, and Related Agencies Appropriations Act, 2007, H.R. 5672, 109th Cong. tit. II (2006). [2] GAO, Decennial Census: Fundamental Design Decisions Merit Congressional Attention, GAO/T-GGD-96-37 (Washington, D.C.: Oct. 25, 1995). [3] The TIGER database is a mapping system that identifies all visible geographic features, such as type and location of streets, housing units, rivers, and railroads. To link TIGER to the master address file, the Bureau assigns every housing unit in the master address file to a specific location in the TIGER, a process called "geocoding." TIGER is a registered trademark of the U.S. Census Bureau. [4] ACS is intended to be a monthly survey of 250,000 households that, under the Bureau's plans, will replace the long-form census questionnaire. [5] GAO, 2010 Census: Census Bureau Generally Follows Selected Leading Acquisition Practices, but Continued Management Attention Is Needed to Help Ensure Success, GAO-06-277 (Washington, D.C.: May 18, 2008). [6] GAO, 2010 Census: Basic Design Has Potential, but Remaining Challenges Need Prompt Resolution, GAO-05-9 (Washington, D.C.: Jan. 12, 2005). [7] For example, the data capture system exceeded its performance goals for accuracy, and the advertising campaign blanketed the country with more than 250 advertisements in 17 languages, which helped boost the response rate higher than the Bureau had expected. [8] Department of Commerce Office of Inspector General, Improving Our Measure of America: What Census 2000 Can Teach Us in Planning for 2010, OIG-14431 (Washington, D.C.: Spring 2002). [9] GAO, Census Bureau: Important Activities for Improving Management of Key 2010 Decennial Acquisitions Remain to be Done, GAO-06-444T (Washington, D.C.: Mar. 1, 2006). [10] GAO-05-9. [11] GAO, 2010 Census: Census Bureau Generally Follows Selected Leading Acquisition Planning Practices, but Continued Management Attention Is Needed to Help Ensure Success, GAO-06-277 (Washington, D.C.: May 18, 2006). [12] GAO, 2010 Census: Cost and Design Issues Need to Be Addressed Soon, GAO-04-37 (Washington, D.C.: Jan. 15, 2004). [13] Lower mail-back response rates increase costs by necessitating costly follow-up visits by enumerators to nonresponding households and/ or the mailing of a follow-up questionnaire. [14] GAO-04-37. [15] U.S. Census Bureau: Census Bureau Estimated Life Cycle Costs for Reengineering the 2010 Decennial Census Program (Washington, D.C.: September 2005). [16] GAO-04-37. GAO's Mission: The Government Accountability Office, the audit, evaluation and investigative arm of Congress, exists to support Congress in meeting its constitutional responsibilities and to help improve the performance and accountability of the federal government for the American people. GAO examines the use of public funds; evaluates federal programs and policies; and provides analyses, recommendations, and other assistance to help Congress make informed oversight, policy, and funding decisions. GAO's commitment to good government is reflected in its core values of accountability, integrity, and reliability. Obtaining Copies of GAO Reports and Testimony: The fastest and easiest way to obtain copies of GAO documents at no cost is through GAO's Web site (www.gao.gov). Each weekday, GAO posts newly released reports, testimony, and correspondence on its Web site. To have GAO e-mail you a list of newly posted products every afternoon, go to www.gao.gov and select "Subscribe to Updates." Order by Mail or Phone: The first copy of each printed report is free. Additional copies are $2 each. A check or money order should be made out to the Superintendent of Documents. GAO also accepts VISA and Mastercard. Orders for 100 or more copies mailed to a single address are discounted 25 percent. Orders should be sent to: U.S. Government Accountability Office 441 G Street NW, Room LM Washington, D.C. 20548: To order by Phone: Voice: (202) 512-6000 TDD: (202) 512-2537 Fax: (202) 512-6061: To Report Fraud, Waste, and Abuse in Federal Programs: Contact: Web site: www.gao.gov/fraudnet/fraudnet.htm E-mail: fraudnet@gao.gov Automated answering system: (800) 424-5454 or (202) 512-7470: Congressional Relations: Gloria Jarmon, Managing Director, JarmonG@gao.gov (202) 512-4400 U.S. Government Accountability Office, 441 G Street NW, Room 7125 Washington, D.C. 20548: Public Affairs: Paul Anderson, Managing Director, AndersonP1@gao.gov (202) 512-4800 U.S. Government Accountability Office, 441 G Street NW, Room 7149 Washington, D.C. 20548:

The Justia Government Accountability Office site republishes public reports retrieved from the U.S. GAO These reports should not be considered official, and do not necessarily reflect the views of Justia.