2000 Census
Lessons Learned for Planning a More Cost-Effective 2010 Census
Gao ID: GAO-03-40 October 31, 2002
GAO reviewed the funding of 2000 Census planning and development efforts and the impact it had on census operations. Total funding for the 2000 Census, referred to as the life cycle cost, covers a 13-year period from fiscal year 1991 through fiscal year 2003 and is expected to total $6.5 billion adjusted to 2000 year dollars. This amount was almost double the reported life cycle cost of the 1990 Census of $3.3 billion adjusted to 2000 year dollars. Considering these escalating costs, the experience of the U.S. Census Bureau in preparing for the 2000 Census offers valuable insights for the planning and development efforts now occurring for the 2010 Census. Thorough and comprehensive planning and development efforts are crucial to the ultimate efficiency and success of any large, long-term project, particularly one with the scope, magnitude, and the deadlines of the U.S. decennial census. For fiscal years 1991 through 1997, $269 million was requested in the President's Budgets for 2000 Census planning and development and the program received funding of $224 million by Congress, or 83 percent of the amount requested. According to U.S. Census Bureau records, the bulk of the $86 million in funding received through the end of fiscal year 1995 was obligated for program development and evaluation methodologies, testing and dress rehearsals, and planning for the acquisition of automated data processing and telecommunications support. The U.S. Census Bureau was responsible for carrying out its mission within the budget provided and bureau management determined the specific areas in which available resources were invested. GAO could not determine what effect, if any, that higher funding levels might have had on bureau operations as this is dependent upon actual implementation and the results of management decisions that may or may not have occurred. According to bureau officials, early planning and development efforts for the 2000 Census were adversely affected by lower funding than requested for fiscal years 1993 through 1997. They identified 10 areas where additional funding could have been beneficial. These included difficulties in retaining knowledgeable staff, scaled back plans for testing and evaluating 1990 Census data, delays in implementing a planning database, and limited resources to update address databases. The bureau's experience in preparing for the 2000 Census underscores the importance of solid, upfront planning and adequate funding levels to carry out those plans.
Recommendations
Our recommendations from this work are listed below with a Contact for more information. Status will change from "In process" to "Open," "Closed - implemented," or "Closed - not implemented" based on our follow up work.
Director:
Team:
Phone:
GAO-03-40, 2000 Census: Lessons Learned for Planning a More Cost-Effective 2010 Census
This is the accessible text file for GAO report number GAO-03-40
entitled '2000 Census: Lessons Learned for Planning a More Cost-
Effective 2010 Census' which was released on November 07, 2002.
This text file was formatted by the U.S. General Accounting Office
(GAO) to be accessible to users with visual impairments, as part of a
longer term project to improve GAO products‘ accessibility. Every
attempt has been made to maintain the structural and data integrity of
the original printed product. Accessibility features, such as text
descriptions of tables, consecutively numbered footnotes placed at the
end of the file, and the text of agency comment letters, are provided
but may not exactly duplicate the presentation or format of the printed
version. The portable document format (PDF) file is an exact electronic
replica of the printed version. We welcome your feedback. Please E-mail
your comments regarding the contents or accessibility features of this
document to Webmaster@gao.gov.
Report to Congressional Requesters:
October 2002:
2000 CENSUS:
Lessons Learned for Planning a More Cost-Effective 2010 Census:
GAO-03-40:
Letter:
Results in Brief:
Background:
Total Funding for Bureau Planning Was Lower Than Requested:
Funding and Other Factors Affected Planning Efforts:
2000 Census Planning Provides Lessons Learned for The 2010 Census:
Conclusions:
Recommendation for Executive Action:
Agency Comments and Our Evaluation:
Appendixes:
Appendix I: Objectives, Scope, and Methodology:
Appendix II: Analysis of Funding by Fiscal Year for Planning and
Developments of the 2000 Census:
Appendix III: Comments from the Department of Commerce:
GAO Comments:
Tables:
Table 1: 2000 Census Planning and Development Funding Requested and
Received for Fiscal Years 1991 Through 1997 (dollars in millions):
Table 2: 2000 Census Planning and Development Funding for Fiscal Year
1992 (dollars in millions):
Table 3: 2000 Census Planning and Development Funding for Fiscal Year
1993 (dollars in millions):
Table 4: 2000 Census Planning and Development Funding for Fiscal Year
1994 (dollars in millions):
Table 5: 2000 Census Planning and Development Funding for Fiscal Year
1995 (dollars in millions):
Table 6: 2000 Census Planning and Development Funding for Fiscal Year
1996 (dollars in millions):
Table 7: 2000 Census Planning and Development Funding for Fiscal Year
1997 (dollars in millions:
AIR: American Indian Reservation:
DADS: Data Access and Dissemination System:
DSF: Delivery Sequence File:
FTE: full-time equivalent:
ICM: Integrated Coverage Measurement:
MAF: Master Address File:
OMB: Office of Management and Budget:
TIGER: Topologically Integrated Geographic Encoding and Referencing
system:
Letter October 31, 2002:
The Honorable William Lacy Clay, Jr.
House of Representatives:
The Honorable Carolyn B. Maloney
House of Representatives:
This report responds to your request to review the funding of 2000
Census planning and development efforts and the impact it had on census
operations. Total funding for the 2000 Census, referred to as the life
cycle cost, covers a 13-year period from fiscal year 1991 through
fiscal year 2003 and is expected to total about $6.5 billion adjusted
to 2000 year dollars. This amount was almost double the reported life
cycle cost of the 1990 Census of $3.3 billion adjusted to 2000 year
dollars. Current life cycle unadjusted cost estimates of the 2010
Census range from $10 billion to $12 billion. Considering these
escalating costs, the experience of the U.S. Census Bureau in preparing
for the 2000 Census offers valuable insights for the planning and
development effort now occurring for the 2010 Census. This report is
part of a series of GAO studies on lessons to be learned from the 2000
Census that can help bureau efforts to conduct an accurate and cost-
effective census in 2010.
We classified 2000 Census efforts into the following three phases.
* The planning and development phase consisted of a variety of
activities to prepare for the actual decennial census count on April 1,
2000. Although planning and development efforts continued into
subsequent phases of the census, this phase involved 7 fiscal years
from 1991 through 1997 with actual funding of about $238 million
adjusted to 2000 year dollars, or about 4 percent of the total
decennial life cycle cost.
* The implementation phase included conducting the 1998 dress
rehearsal, establishing 511 temporary local census offices in the 50
states, hiring and training over 500,000 temporary personnel, and then
conducting the actual census count. This phase involved 3 fiscal years
from 1998 through 2000 with actual funding of about $5.6 billion
adjusted to 2000 year dollars, or about 86 percent of the total
decennial life cycle cost.
* The postenumeration phase involves compiling and checking the census
counts for public release by April 1, 2001, for subsequent use in
congressional redistricting, and for other postcensus studies. This
phase covers 3 fiscal years from 2001 through 2003 with estimated
funding of about $686 million adjusted to 2000 year dollars, or about
10 percent of the total decennial life cycle cost.
As agreed with your offices, our review focused on the planning and
development phase of the 2000 Census and (1) the funding requested,
received, and obligated, with funding received and obligated by major
planning category,[Footnote 1] (2) funding and other factors that
affected planning efforts, and (3) lessons learned for the 2010 Census.
Our analysis was based on unaudited budget and financial data provided
by the U.S. Census Bureau. We performed our work between January 2001
and July 2001 at which time our review was suspended due to an
inability to obtain access to certain budget records. After lengthy
discussions with senior officials of the bureau, the Department of
Commerce, and the Office of Management and Budget (OMB), and
consultation with your staffs, this access issue was resolved in May
2002 and we completed our analysis in June 2002. Our work was done in
accordance with U.S. generally accepted government auditing standards.
Further details on our scope and methodology are presented in appendix
I.
The Department of Commerce provided written comments on a draft of this
report, including two attachments. We reprinted the comments in
appendix III, except for the second attachment, Potential Life-Cycle
Savings for the 2010 Census, which the bureau stated is currently under
revision and is outside the scope of our review.
Results in Brief:
Thorough and comprehensive planning and development efforts are crucial
to the ultimate efficiency and success of any large, long-term project,
particularly one with the scope, magnitude, and deadlines of the U.S.
decennial census. For fiscal years 1991 through 1997, about $269
million was requested in the President‘s Budgets for 2000 Census
planning and development and the program received funding of about $224
million by the Congress, or about 83 percent of the amount requested.
For fiscal years 1991 and 1992, OMB deemed the Department of Commerce
requests to fund early census reform as insufficient and doubled the
amounts to $1.5 million and $10.1 million, respectively. These amounts
were included in the President‘s Budgets and the Congress concurred by
authorizing the full amount requested. However, funding reductions by
the Congress occurred every subsequent fiscal year from 1993 through
1997. According to the bureau, these reductions resulted in the
elimination, deferral, or scaling back of certain projects in planning
for the 2000 Census. The bureau obligated 99 percent of its
appropriated 2000 Census funding through fiscal year 1997.
According to U.S. Census Bureau records, the bulk of the $86 million in
funding received through the end of fiscal year 1995 was obligated for
program development and evaluation methodologies, testing and dress
rehearsals, and planning for the acquisition of automated data
processing and telecommunications support. For fiscal years 1996 and
1997, bureau records indicated the bulk of $138 million of decennial
funding received was obligated for planning for the establishment of
field data collection and support systems, refining data content and
products, evaluating test results, and procuring automated data
processing and telecommunications support. For the planning and
development phase, personnel costs consumed about 53 percent of total
costs; contractual services consumed 16 percent; and space, supplies,
travel, and other expenses consumed the remaining 31 percent.
The U.S. Census Bureau was responsible for carrying out its mission
within the budget provided and bureau management determined the
specific areas in which available resources were invested. We could not
determine what effect, if any, that higher funding levels might have
had on bureau operations as this is dependent upon actual
implementation and the results of management decisions that may or may
not have occurred. According to bureau officials, early planning and
development efforts for the 2000 Census were adversely affected by
lower funding than requested for fiscal years 1993 through 1997. They
identified 10 areas where additional funding could have been
beneficial. These included difficulties in retaining knowledgeable
staff, scaled back plans for testing and evaluating 1990 Census data,
delays in implementing a planning database, and limited resources to
update address databases. While lower funding may have affected these
areas, information from various bureau and GAO reports and testimony,
as well as our current review, showed that operational, methodological,
and other factors also contributed to weaknesses in the bureau‘s
planning efforts.
The bureau‘s experience in preparing for the 2000 Census underscores
the importance of solid, upfront planning and adequate funding levels
to carry out those plans. As we have reported in the past, planning a
decennial census that is acceptable to stakeholders[Footnote 2]
includes analyzing the lessons learned from past practices, identifying
initiatives that show promise for producing a better census while
controlling costs, testing these initiatives to ensure their
feasibility, and convincing stakeholders of the value of proposed
plans. A major contributing factor to the funding reductions was the
bureau‘s persistent lack of comprehensive planning and priority
setting, coupled with minimal research, testing, and evaluation
documentation to promote informed and timely decision making. Over the
course of the 1990s, the Congress, GAO, and others criticized the
bureau for not fully addressing such areas as (1) capitalizing on its
experiences from past decennial censuses to serve as lessons learned in
future planning, (2) documenting its planning efforts, particularly
early in the process, (3) concentrating its efforts on the few critical
projects that significantly affected the census count, such as
obtaining a complete and accurate address list, (4) presenting key
implementation issues with decision milestones, and (5) identifying key
performance measures for success.
In light of the challenges facing the bureau as it prepares for the
next decennial census in 2010, we are recommending to the Secretary of
Commerce that the bureau‘s requests for funding of planning and
development activity provide comprehensive information supported by
sound data. This information would include, but is not limited to, such
information as:
* specific performance goals for the 2010 Census and how bureau
efforts, procedures, and projects would contribute to those goals;
* detailed information on project feasibility, priorities, and
potential risks;
* key implementation issues and decision milestones; and,
* performance measures.
The department agreed with our recommendation and stated that the
bureau is expanding documents justifying its budgetary requests.
Background:
As a result of controversy and litigation surrounding the 1990
Decennial Census, the U.S. Census Bureau recognized the need for a
full-scale review of its decennial census program. The Congress, OMB,
and GAO also agreed that this review was needed and that it must occur
early in the decade to implement viable actions for the 2000 Census and
to prepare for the 2010 Census.[Footnote 3] Early in the 1990s, in
reports and testimonies, we stressed the importance of strong planning
and the need for fundamental reform to avoid the risk of a very
expensive and seriously flawed census in 2000.[Footnote 4]
To address a redesign effort, in November 1990 the bureau formed the
Task Force for Planning the Year 2000 Census and Census-Related
Activities for 2000-2009. The task force was to consider lessons
learned from the 1990 Census, technical and policy issues,
constitutional and statutory mandates, changes in U.S. society since
earlier decennial censuses, and the most current knowledge of
statistical and social measurement. The bureau also established a Year
2000 Research and Development Staff to assist the task force and
conduct numerous research projects designed to develop new approaches
and techniques for possible implementation in the 2000 Census. In June
1995, the task force issued its report, Reinventing the Decennial
Census.
Concerns about the 1990 Census also led the Congress to pass the
Decennial Census Improvement Act of 1991 (Public Law 102-135) requiring
the National Academy of Sciences to study the means by which the
government could achieve the most accurate population count possible
and collect other demographic and housing data. The academy established
a panel on methods to provide an independent review of the technical
and operational feasibility of design alternatives and tests conducted
by the U.S. Census Bureau. The panel issued its final report in
September 1994. A second academy panel on requirements examined the
role of the decennial census within the federal statistical system and
issued its final report in November 1994.
In March 1995, the bureau conducted the 1995 Census Test which provided
a critical source of information to decide by December 1995 the final
design of the 2000 Census. These efforts resulted in a planned approach
for reengineering the 2000 Census which was presented in a May 19,
1995, U.S. Census Bureau report, The Reengineered 2000 Census.
In October 1995, we testified on the bureau‘s plans for the 2000
Census.[Footnote 5] In that testimony, we concluded that the
established approach used to conduct the 1990 Census had exhausted its
potential for counting the population cost-effectively and that
fundamental design changes were needed to reduce census costs and to
improve the quality of data collected. We also raised concerns about
the bureau proceeding with design plans for the 2000 Census without
input from the Congress. In the intervening months, the bureau was
unable to come to agreement with the Congress on critical design and
funding decisions. In February 1997, we designated the 2000 Decennial
Census a new high-risk area because of the possibility that further
delays could jeopardize an effective census and increase the likelihood
that billions of dollars could be spent and the nation be left with
demonstrably inaccurate census results.[Footnote 6] In July 1997, we
updated our 1995 testimony on bureau design and planning initiatives
for the 2000 Census and assessed the feasibility of bureau plans for
carrying out the 2000 Census.[Footnote 7]
To respond to Title VIII of Public Law 105-18, which required the
Department of Commerce to provide detailed data about the bureau‘s
plans by July 12, 1997, the bureau issued its Report to Congress, The
Plan For Census 2000. This plan also incorporated the bureau‘s Census
2000 Operational Plan that was updated annually. In November 1997,
Public Law 105-119 established the Census Monitoring Board to observe
and monitor all aspects of the bureau‘s preparation and implementation
of the 2000 Census.[Footnote 8] Section 209 (j) of this legislation
also required the bureau to plan for dual tracks of the traditional
count methodology and the use of statistical sampling to identify
historically undercounted populations of children and minorities.
Census Appropriations:
As 1 of 13 bureaus within the Department of Commerce, the U.S. Census
Bureau must submit its annual budget for review and inclusion in the
department‘s budget. The department must then make choices in
consideration of its overall budget to OMB and will therefore make
adjustments to bureau-requested budgets as deemed necessary. OMB will
review and further adjust department and bureau budgets to consider the
programs and priorities of the entire federal government that become
the President‘s Budget. The Congress may then adjust the President‘s
Budget through the appropriation process that becomes the budget of the
departments and the bureaus after signature by the President. The
appropriations for decennial census are no-year funds that are
available until expended, rescinded, transferred, or until the account
is closed.
Total Funding for Bureau Planning Was Lower Than Requested:
As shown in table 1, the Department of Commerce requested a total of
$268.7 million for 2000 Census planning and development in the
President‘s Budgets for fiscal years 1991 through 1997. The program
received total funding of $223.7 million from the Congress, or about 83
percent of the amount requested. Although the 2000 Census received all
of the funding requested in the President‘s Budgets for fiscal years
1991 and 1992, it received reduced funding for each fiscal year from
1993 through 1997. According to the bureau, these reductions resulted
in the elimination, deferral, or scaling back of certain projects in
planning for the 2000 Census. The bureau subsequently obligated 99
percent of its appropriated 2000 Census funding through fiscal year
1997.
Table 1: 2000 Census Planning and Development Funding Requested and
Received for Fiscal Years 1991 Through 1997 (dollars in millions):
Fiscal year: 1991; 2000 Census requested funding (President‘s
Budget)[A]: $1.5; 2000 Census appropriated funding by Congress[B]:
$1.5; 2000 Census requested funding not appropriated: $0; Percent of
requested annual funding received: 100.
Fiscal year: 1992; 2000 Census requested funding (President‘s
Budget)[A]: 10.1; 2000 Census appropriated funding by Congress[B]:
10.1; 2000 Census requested funding not appropriated: 0; Percent of
requested annual funding received: 100.
Fiscal year: 1993; 2000 Census requested funding (President‘s
Budget)[A]: 19.4; 2000 Census appropriated funding by Congress[B]:
13.7; 2000 Census requested funding not appropriated: 5.7; Percent of
requested annual funding received: 71.
Fiscal year: 1994; 2000 Census requested funding (President‘s
Budget)[A]: 23.1; 2000 Census appropriated funding by Congress[B]:
18.7; 2000 Census requested funding not appropriated: 4.4; Percent of
requested annual funding received: 81.
Fiscal year: 1995; 2000 Census requested funding (President‘s
Budget)[A]: 48.6; 2000 Census appropriated funding by Congress[B]:
42.0; 2000 Census requested funding not appropriated: 6.6; Percent of
requested annual funding received: 86.
Fiscal year: 1996; 2000 Census requested funding (President‘s
Budget)[A]: 60.1; 2000 Census appropriated funding by Congress[B]:
51.3; 2000 Census requested funding not appropriated: 8.8; Percent of
requested annual funding received: 85.
Fiscal year: 1997; 2000 Census requested funding (President‘s
Budget)[A]: 105.9; 2000 Census appropriated funding by Congress[B]:
86.4; 2000 Census requested funding not appropriated: 19.5; Percent of
requested annual funding received: 82.
Fiscal year: Total; 2000 Census requested funding (President‘s
Budget)[A]: $268.7; 2000 Census appropriated funding by Congress[B]:
$223.7; 2000 Census requested funding not appropriated: $45.0; Percent
of requested annual funding received: 83.
[A] Amounts include prior year recoveries of $1.6 million.
[B] Amounts include prior year recoveries and carry-in of $16.1
million.
Source: U.S. Census Bureau.
[End of table]
Bureau records indicated that the bulk of $86 million of decennial
funding received through the end of fiscal year 1995 was obligated for
program development and evaluation methodologies, testing and dress
rehearsals, and planning for the acquisition of automated data
processing and telecommunications support. For fiscal years 1996 and
1997, bureau records indicated that the bulk of $138 million of
decennial funding received was obligated for planning the establishment
of field data collection and support systems, refining data content and
products, evaluating test results, and procuring automated data
processing and telecommunications support. For the planning and
development phase, personnel costs consumed about 53 percent of
planning and development funds; contractual services consumed 16
percent; and space, supplies, travel, and other expenses consumed the
remaining 31 percent.
Because of different major program categories used by the bureau from
fiscal years 1991 through 1997, we could not present a comprehensive
table of funding for the period. However, we were able to analyze the
funding by fiscal year and a detailed analysis of funding requested,
received, and obligated, and funds budgeted by major program category
for fiscal years 1991 through 1997 are presented in appendix II.
Funding and Other Factors Affected Planning Efforts:
The U.S. Census Bureau was responsible for carrying out its mission
within the budget provided and bureau management determined the
specific areas in which available resources were invested. We could not
determine what effect, if any, that higher funding levels might have
had on census operations as this is dependent upon actual
implementation and the results of management decisions that may or may
not have occurred. However, according to bureau officials, lower than
requested funding levels for fiscal years 1993 through 1997 adversely
affected the bureau‘s planning and development efforts for the 2000
Census. As examples, they cited the following 10 areas where reduced
funding levels caused the bureau to curtail planning initiatives.
Although lower funding levels may have affected these areas,
information from previous bureau and GAO reports and testimony
indicated that operational, methodological, and other factors also
contributed to weaknesses in the bureau‘s planning efforts.
1. Difficulties in retaining knowledgeable staff. Although many key
bureau personnel and project managers involved with the 2000 Census had
also worked on the 1990 and earlier decennial censuses, bureau
officials stated that many experienced people retired or left the
bureau after the 1990 Census. According to the bureau, a contributing
factor was lower funding levels to pay personnel compensation and
benefits, which in turn affected the number of personnel with
institutional knowledge of the decennial census to lend support to the
2000 Census planning and development effort.
We noted that soon after a major event such as the decennial census
count, it is not unusual for personnel to leave the bureau, as did
three senior executives after the 2000 Census. In addition, Office of
Personnel Management data indicated that over half of the bureau‘s
full-time, nonseasonal work force of 5,345 employees as of March 2002
is eligible for retirement by 2010. Thus, the human capital issue will
remain a key planning area to ensure that the bureau has the skill mix
necessary to meet its future requirements.
2. Scaled-back plans for testing and evaluating 1990 Census data. A
bureau official stated that the amount of qualitative and quantitative
data from the 1990 Census was limited and hampered the quality and
results of planning and development efforts for the 2000 Census.
Additionally, many opportunities were lost in capitalizing on the 1990
Census data that did exist and more funding to evaluate this data could
have facilitated 2000 Census research and planning efforts. Bureau
officials stated that as they moved forward with planning for the 2000
Census, they had to scale back plans for testing and evaluating 1990
Census data because of a lack of funding. For example, they cited the
inability to update a 1990 Census study of enumerator supervisor
ratios.
3. Delays in implementing a planning database. Bureau officials stated
that they were unable to implement an effective planning database in
the early years of the 2000 Census. In one of its first plans, the
bureau conceived of a planning database that would capture data down to
very small geographic levels and would be continuously updated over the
decade for a number of census purposes. This database would have
enabled the bureau to target areas where language resources were
needed, identify areas where enumeration and recruiting could be
difficult, and position data capture centers to support the most cost-
efficient and effective infrastructure. However, according to bureau
officials, with lower funding through fiscal year 1995, the planning
database was put on hold. Later in the decade, the bureau resurrected
the planning database but did not develop and use it fully.
4. Limited resources to update address databases. According to bureau
officials, sufficient resources to update and coordinate large
databases of addresses and physical locations provided a continuous
challenge to the bureau. At the end of the 1990 Census, the bureau‘s
database contained 102 million addresses, each assigned to the census
block area in which it was located. At that point, the U.S. Census
Bureau‘s Geography Division initiated discussions with the U.S. Postal
Service to utilize its Delivery Sequence File (DSF) that contained
millions of addresses used to deliver the U.S. mail.[Footnote 9] The
bureau planned to use the DSF in updating its address database which
became the Master Address File (MAF).[Footnote 10] With lower funding
through 1995, bureau officials cited limited resources to update the
MAF database and to assess the quality of entered information.
5. Program to identify duplicate responses was not fully developed.
Bureau officials stated the program to identify duplicate responses was
not fully developed for the 2000 Census and more emphasis and funding
were needed to develop appropriate software and procedures. It is
important to be able to identify duplications in the MAF and multiple
responses from a person or household that contribute to a population
overcount. This includes operations to identify multiple responses for
the same address and computer matching of census responses received
against all other people enumerated in the block. Duplications also
occurred due to college students counted both at school and at home,
people with multiple residences, and military personnel residing
outside their home state.
6. Abandoned plans to use administrative records. In early planning for
the 2000 Census, the bureau funded efforts to use records from
nonbureau sources of information (such as driver licenses, voter
registrations, and other government programs) to supplement the census
count. This administrative records project was the result of extensive
research studies conducted by the bureau beginning in 1993 that focused
on initial plans for three uses of nonbureau information to:
* derive census totals for some nonresponding households,
* enhance the coverage measurement operations, and:
* help provide missing content from otherwise responding households.
Although bureau officials determined that administrative records had
the potential to improve coverage, the bureau abandoned plans to fund
and more fully develop an administrative records database in February
1997. While the lack of funding may have been a contributing factor,
bureau documents indicated that this action was primarily due to
questions about the accuracy and quality of administrative records and
issues of privacy protection.
7. Problems with multiple language questionnaires. Bureau officials
cited several funding and operational problems with census
questionnaires in the five languages that were used other than
English.[Footnote 11] In 1995, the bureau planned to mail forms in both
Spanish and English to areas with high concentrations of Spanish
speakers and produce forms in other languages as needed. In March 1997,
in response to requests for forms in other languages, the bureau
announced its intent to print questionnaires in multiple languages in
an effort to increase the mail response rate. The bureau selected four
additional languages as a manageable number based upon a perceived
demand. However, the bureau could not determine how to pinpoint the
communities that needed the non-English questionnaires. Instead, the
bureau indicated in a mailing that the questionnaires were available in
five languages and if an individual wanted a questionnaire in a
language other than English, the individual had to specifically request
the questionnaire in that language. As a result, the bureau did not
know the number of questionnaires to print in the five languages until
late in the process. Finally, the bureau did not have the time to
comprehensively assess the demand for questionnaires in other
languages.
8. Cost-effective use of emerging data capture technology. Early bureau
research assessed current and emerging data capture technologies, such
as electronic imaging, optical mark recognition, and hand-held devices,
which offered the potential for significant cost reductions in
processing large volumes of data. Bureau officials indicated they were
unsure of their exact requirements for the emerging data capture
technologies, and this resulted in most contracts being cost-
reimbursement contracts[Footnote 12] that required more funding than
planned. The bureau estimated that it ultimately spent about $500
million on contracts to improve the data capturing process.
Bureau officials also stated that they did not have the time to fully
develop and test the data capture systems or data capture centers, both
of which were contracted for the first time in the 2000 Census. For
example, the bureau said it could not adequately prepare for the full
development and testing of the imaging contract. As a consequence, the
first imaging test did not occur until 1998, and bureau officials
stated that it became clear that imaging was not working due to
technical and implementation problems. To some extent, this is not
unexpected when implementing new technologies. Although the contractor
and the bureau felt the system was not ready, it was tested anyway due
to the short time frame and major problems developed. Even though the
system eventually became operational in time for the 2000 Census count,
bureau officials indicated that this occurred at a higher than
anticipated risk and cost.
9. More use of the Internet. In the early 1990s, the full impact of the
Internet as a global communications tool was not yet envisioned.
Officials indicated that the bureau did not have sufficient time and
funding during the planning phase to fully understand and test all the
implications of using the Internet as a vehicle for census responses.
In addition, the bureau‘s major concern was that computer security
issues had not been adequately addressed, particularly since census
information must be protected and significant penalties may be imposed
for unauthorized disclosure.[Footnote 13] Also, the public perception
of using the Internet as a response medium had not been fully explored.
Nevertheless, in February 1999, the bureau established a means for
respondents to complete the 2000 Census short forms on the Internet
protected by a 22-digit identification number. According to bureau
officials, they received about 60,000 short forms via the Internet. The
rapid evolution of the Internet has the potential to significantly
reduce bureau workload and the large volume of paper forms for the 2010
Census.
10. Preparation for dress rehearsals. Bureau officials cited many
problems during the fiscal year 1998 dress rehearsals for the 2000
Census that were a direct result of funding levels in the early
planning and development years. They stated that because of delays in
receiving funding in the fall of 1997, they had to delay the dress
rehearsal census day from April 4 to April 18, 1998. In addition,
because many new items were incomplete or still under development, the
bureau said it could not fully test them during the dress rehearsals
with any degree of assurance as to how they would affect the 2000
Census.
However, despite these problems, the bureau testified in March 1998
that all preparatory activities for the dress rehearsal--mapping,
address listing, local updates of addresses, opening and staffing
offices, and printing questionnaires--had been completed.[Footnote 14]
In 1999, the bureau issued an evaluation that concluded that all in
all, the Census 2000 dress rehearsal was successful.[Footnote 15] The
evaluation also stated that the bureau produced population numbers on
time that compared favorably with independent benchmarks. It also
acknowledged some problems, but devised methods to address those
problems. Although the bureau conceded that planning efforts could be
improved, the lack of funding did not appear to be a significant issue,
except as it affected the ability to earlier plan the dress rehearsal.
2000 Census Planning Provides Lessons Learned for The 2010 Census:
The bureau‘s experience in preparing for the 2000 Census underscores
the importance of solid, upfront planning and adequate funding levels
to carry out those plans. As we have reported in the past,[Footnote 16]
planning a decennial census that is acceptable to stakeholders includes
analyzing the lessons learned from past practices, identifying
initiatives that show promise for producing a better census while
controlling costs, testing these initiatives to ensure their
feasibility, and convincing stakeholders of the value of proposed
plans.
Contributing factors to the funding reductions for the 2000 Census were
the bureau‘s persistent lack of comprehensive planning and priority
setting, coupled with minimal research, testing, and evaluation
documentation to promote informed and timely decision making. Over the
course of the decade, the Congress, GAO, and others criticized the
bureau for not fully addressing such areas as (1) capitalizing on its
experiences from past decennial censuses to serve as lessons to be
learned in future planning,
(2) documenting its planning efforts, particularly early in the
process,
(3) concentrating its efforts on a few critical projects that
significantly affected the census count, such as obtaining a complete
and accurate address list, (4) presenting key implementation issues
with decision milestones, and (5) identifying key performance measures
for success.
* Capitalizing on experiences from past censuses. In a fiscal year 1993
conference report,[Footnote 17] the Congress stated that the bureau
should direct its resources towards a more cost-effective census design
that would produce more accurate results than those from the 1990
Census. Further, the Congress expected the bureau to focus on realistic
alternative means of collecting data, such as the use of existing
surveys, rolling sample surveys, or other vehicles and that cost
considerations should be a substantial factor in evaluating the
desirability of design alternatives.
In March 1993 we testified[Footnote 18] that time available for
fundamental census reform was slipping away and important decisions
were needed by September 1993 to guide planning for 1995 field tests,
shape budget and operational planning for the rest of the census cycle,
and guide future discussions with interested parties. We noted that the
bureau‘s strategy for identifying promising census designs and features
was proving to be cumbersome and time consuming, and the bureau had
progressed slowly in reducing the design alternatives for the next
census down to a manageable number.
* Documenting early planning efforts. It is particularly important
early in the planning process to provide a roadmap for further work. We
found that the bureau did not document its 2000 Census planning until
late in the planning phase. While the U.S. Census Bureau prepared a few
pages to justify its annual budget requests for fiscal years 1991
through 1997, it did not provide a substantive document of its 2000
Census planning efforts until May 1995, and this plan was labeled a
draft.[Footnote 19] Finally, the Congress mandated that the bureau
issue a comprehensive and detailed plan for the 2000 Census within 30
days from enactment of the law.[Footnote 20] On July 12, 1997, the
bureau issued its Report to the Congress--The Plan for Census 2000,
along with its Census 2000 Operational Plan.[Footnote 21]
* Concentrating efforts on a few critical projects. While the bureau
required many activities to count a U.S. population of 281 million
residing in 117.3 million households, a few critical activities
significantly affected the Census 2000 count, such as obtaining a
complete and accurate address list. Although the bureau was aware of
serious problems with its address list development process, it did not
acknowledge the full impact of these problems until the first quarter
of 1997. Based upon its work with the postal service database, the 1995
Census Test, and pilot testing at seven sites, the bureau had gained
sufficient evidence that its existing process would result in an
unacceptably inaccurate address list due to:
* inconsistencies in the quality of the postal service database across
the nation;
* missing addresses for new construction;
* difficulties in identifying individual units in multiunit structures,
such as apartment buildings; and:
* inability of local and tribal governments to provide usable address
lists.
In September 1997, the bureau acknowledged these problems and proposed
changes.[Footnote 22] However, we believe that this action occurred too
late in the planning process and was not given a higher priority to
benefit the 2000 Census enumeration.
* Presenting key implementation issues and decision milestones. The
bureau discussed program areas as part of its annual budget requests
for fiscal years 1991 through 1997, but the requests did not identify
key implementation issues with decision milestones to target its
planning activities. Decision milestones did not appear until July
1997, when the bureau issued its Census 2000 Operational Plan.
Stakeholders such as the Congress are more likely to approve plans and
funding requests when they are thoroughly documented and include key
elements such as decision milestones.
* Identifying key performance measures. Census planning documents
provided to us through fiscal year 1997 did not identify key
performance measures. We believe that identifying key performance
measures is critical to assessing success in the planning phase of the
census and can provide quantitative targets for accomplishments by
framework, activity, and individual projects. Such measures could
include performance goals such as increasing mail response rates,
reducing population overcount and undercount rates, and improving
enumerator productivity rates.
Conclusions:
The lessons learned from planning the 2000 Census become even more
crucial in planning for the next decennial census in 2010, which has
current unadjusted life cycle cost estimates ranging from $10 billion
to $12 billion. Thorough and comprehensive planning and development
efforts are crucial to the ultimate efficiency and success of any
large, long-term project, particularly one with the scope, magnitude,
and deadlines of the U.S. decennial census. Initial investment in
planning activities in areas such as technology and administrative
infrastructure can yield significant gains in efficiency,
effectiveness, and cost reduction in the later implementation phase.
The success of the planning and development activities now occurring
will be a major factor in determining whether this large investment
will result in an accurate and efficient national census in 2010.
Critical considerations are:
* early planning;
* a comprehensive and prioritized plan of goals, objectives, and
projects;
* milestones and performance measures; and:
* documentation to support research, testing, and evaluation.
A well-supported plan early in the process that includes these elements
will be a major factor in ensuring that stakeholders have the
information to make funding decisions.
Recommendation for Executive Action:
As the U.S. Census Bureau plans for the 2010 Census, we recommend that
the Secretary of Commerce direct that the bureau provide comprehensive
information backed by supporting documentation in its future funding
requests for planning and development activities, that would include,
but is not limited to, such items as:
* specific performance goals for the 2010 Census and how bureau
efforts, procedures, and projects would contribute to those goals;
* detailed information on project feasibility, priorities, and
potential risks;
* key implementation issues and decision milestones; and:
* performance measures.
Agency Comments and Our Evaluation:
In commenting on our report, the department agreed with our
recommendation and stated that the bureau is expanding the documents
justifying its budgetary requests. For example, the bureau cited a
document which outlines planned information technology development and
activities throughout the decennial cycle of the 2010 Census. The
bureau also included a two-page document, Reengineering the 2010
Census, which presented three integrated components and other plans to
improve upon the 2000 Census. In this regard, it is essential that, as
we recommended, the bureau follow through with details and
documentation to implement these plans, define and quantify performance
measures against goals, and provide decision milestones for specific
activities and projects.
As agreed with you office, unless you announce its contents earlier, we
plan no futher distribution of this report until 7 days after its
issuance date. At that time, we will send copies of this report to the
Chairman and Ranking Minority Member of the Senate Committee on
Governmental Affairs, the House Committee on Government Reform, and the
House Subcommittee on Civil Service, Census, and Agency Organization.
We will also send copies to the Director of the U.S. Census Bureau, the
Secretary of Commerce, the Director of the Office of Management and
Budget, the Secretary of the Treasury, and other interested parties.
This report will also be available on GAO‘s home page at http://
www.gao.gov.
If you or your staffs have any questions concerning this report, please
contact Gregory D. Kutz at (202) 512-9095 or kutzg@gao.gov, Patricia A.
Dalton at (202) 512-6806 or daltonp@gao.gov, or Roger R. Stoltz,
Assistant Director, at (202) 512-9408 or stoltzr@gao.gov. Key
contributors to this report were Corinne P. Robertson, Robert N.
Goldenkoff, and Ty B. Mitchell.
Gregory D. Kutz
Director
Financial Management and Assurance:
Signed by Gregory D. Kutz:
Signed by:
Patricia A. Dalton
Director
Strategic Issues:
[End of section]
Appendixes:
Appendix I: Objectives, Scope, and Methodology:
The objectives of our review focused on the planning and development
phase of the 2000 Census that we classified as covering fiscal years
1991 through 1997 and (1) the funding requested, received, and
obligated with funding received and obligated by major planning
category, (2) funding and other factors that affected planning efforts,
and (3) lessons learned for the 2010 Census.
To determine the amount of 2000 Census planning and development funding
requested, received, and obligated, we obtained and analyzed annual
decennial census budgets included in the President‘s Budgets for fiscal
years 1991 through 1997, budgets subsequently received after
appropriation by the Congress, and amounts later obligated for the
purchase of goods and services by the bureau against those budgets. We
then obtained explanations from senior bureau officials for significant
variances in these budgets and the effect on decennial planning and
development. However, we did not assess the efficiency of the budgeting
process and the validity, accuracy, and completeness of obligations
against budgeted amounts received.
To determine the funding received and obligated by major planning
category for 2000 Census planning and development, we obtained and
analyzed funding requested, received, and obligated by framework,
activity, project, and object class and examined annual operational
plans. However, our analysis was hampered by the bureau‘s inconsistent
use of categories that evolved from 1 activity of general planning in
fiscal year 1991, 8 major study areas in fiscal years 1992 and 1993,
and 8 to 15 broad categories called frameworks beginning in 1994. For
internal management and reporting, the bureau further identified
program efforts by activities and projects that have varied since
fiscal year 1991.[Footnote 23] Additionally, the bureau expanded,
contracted, or modified program names and descriptions making
comparisons more difficult. We also obtained explanations from bureau
officials for significant efforts and variances in its funding received
and obligation of planning and development funding for the 2000 Census.
However, we did not assess the merits of budgeting by program and the
subsequent validity, accuracy, and completeness of obligations.
To identify funding and other factors that affected planning efforts,
we analyzed significant changes in funding requested, received, and
obligated at the framework level; identified initiatives that were
reduced, eliminated, or severely curtailed; discussed the effect of
these areas with bureau officials; and evaluated bureau responses. We
also reviewed various reports, testimony, and supporting documents
prepared by the bureau, GAO, and others. However, we could not
determine what effect, if any, that higher levels of funding might have
had on 2000 Census operations. These factors are dependent upon actual
implementation and the results of management decisions that may or may
not have occurred.
To provide lessons learned for the 2010 Census, we identified areas for
improvement and obtained support from bureau, GAO, and congressional
reports, testimony, interviews, and other documents.
Our work was performed in Washington, D.C. and at U.S. Census Bureau
headquarters in Suitland, Maryland between January and July 2001 when
our review was suspended due to an inability to obtain access to
certain budget records. After lengthy discussions with senior officials
of the bureau, Department of Commerce, and OMB, and consultation with
your staffs, this access issue was resolved in May 2002 and we
completed our analysis in June 2002. Our work was done in accordance
with U.S. generally accepted government auditing standards, except that
we did not audit budget and other financial data provided by the U.S.
Census Bureau.
On October 16, 2002, the Department of Commerce provided written
comments on a draft of this report, including two attachments. These
comments are presented in the ’Agency Comments and Our Evaluation“
section of the report and are reprinted in appendix III, except for the
second attachment, Potential Life-Cycle Savings for the 2010 Census,
which is currently under revision and is outside the scope of our
review.
[End of section]
Appendix II: Analysis of Funding by Fiscal Year for Planning and
Development of the 2000 Census:
This appendix includes our analysis of 2000 Census funding requested,
received, and obligated, and funding received and obligated by major
planning category for fiscal years 1991 through 1997. Our analysis was
hampered by the bureau‘s inconsistent use of major planning categories
that evolved over the period as follows:
* 1 activity of general planning in fiscal year 1991,
* 8 major study areas in fiscal years 1992 and 1993, and:
* 8 to 15 broad categories called frameworks beginning in 1994.
For internal management and reporting, the bureau further identified
program efforts by activities and projects that have varied since
fiscal year 1991. In addition, the bureau expanded, contracted, or
modified program names and descriptions making comparisons more
difficult.
Fiscal Year 1991 and 1992 Funding:
In March 1991 we testified[Footnote 24] that fundamental census reform
was needed because escalating costs and the apparently increased
undercount of the 1990 Census suggested that the current census
methodology may have reached the limits of its effectiveness. Of three
principles we presented, the last was that the Department of Commerce
must be willing to invest sufficient funds early in the decade to
achieve cost savings and census improvements in 2000. In fact, OMB
deemed some of the Department of Commerce requests to fund early census
reform as insufficient and doubled the department‘s requested amounts
to $1.5 million for fiscal year 1991 and $10.1 million for fiscal year
1992. These amounts were included in the President‘s Budgets and the
Congress concurred by authorizing the full amount requested. Census
planning officials said that if OMB had not augmented the department‘s
request, testing of reform options for 2000 would have been
constrained.
For the first year of the 7-year 2000 Census planning and development
phase, the fiscal year 1991 funding received was $1.5 million and the
bureau obligated the entire amount. The funding contained only one
category of general planning for the 2000 Census with funds to be used
for:
* completion of detailed cost-benefit studies of alternatives designs
for conducting the decennial census;
* exploration of new technologies to improve the 2000 Census;
* establishment of research and development efforts for administrative
methods and modeling and estimation techniques; and:
* planning of field tests in fiscal year 1993 to include new census
content, methods, technologies, and field structures.
Because total amounts were small and involved only general planning,
there were no significant variances. We noted that about 46 percent of
the funding was obligated for personnel costs relating to 19 full-time
equivalent (FTE) staff, 29 percent for services including consultants;
and the remaining 25 percent for space, supplies, travel, and other
costs.
Fiscal year 1992 funding received was $10.1 million and the bureau
obligated $9.4 million against it. The funding now identified eight
major study areas for the 2000 Census as indicated in table 2.
Table 2: 2000 Census Planning and Development Funding for Fiscal Year
1992 (dollars in millions):
Major study area: 1; Description: Simplify questionnaire; Amount: $1.0.
Major study area: 2; Description: Administrative records, modeling, and
estimation; Amount: 2.8.
Major study area: 3; Description: Technology options for questionnaire
distribution and collection; Amount: 3.5.
Major study area: 4; Description: Various uses of sampling; Amount: .9.
Major study area: 5; Description: Techniques for special areas and
subpopulations; Amount: .3.
Major study area: 6; Description: TIGER[B] enhancements; Amount: [A].
Major study area: 7; Description: Address list maintenance; Amount: .8.
Major study area: 8; Description: Administration; Amount: .8.
Description: Major study area : Total; Amount: Major study area :
$10.1.
[A] Activity or amounts were less than $.1 million.
[B] Topologically Integrated Geographic Encoding and Referencing
system.
Source: U.S. Census Bureau.
[End of table]
For fiscal year 1992, the bureau experienced almost a six-fold increase
in its funding received of $10.1 million over the $1.5 million for
fiscal year 1991. About half of the fiscal year 1992 funding was
obligated for personnel costs as a result of almost a five-fold
increase in FTE staff from 19 in fiscal year 1991 to 111 in fiscal year
1992 to work on decennial planning and development issues. Services,
including consultants, accounted for another quarter of the obligations
with the remaining quarter for space, supplies, travel, and other
costs. Technology options included a $1.7 million services contract to
develop emerging data capture technology to compile census statistics.
Fiscal Year 1993 Funding:
For fiscal year 1993, the Congress reduced the President‘s Budget
request of $19.4 million for 2000 Census planning and development to
$13.7 million,[Footnote 25] for a reduction of about 29 percent. As a
result of this $5.7 million reduction, the bureau made significant cuts
in its funding of techniques for special areas and subpopulations by
$2.2 million, or about 70 percent, and also eliminated activities to:
* establish contacts with state and local government budgeted for $1.6
million,
* assess customer needs budgeted for $1.0 million,
* survey public motivation budgeted for $.8 million, and:
* prepare infrastructure for a 1995 Census Test budgeted for $.5
million.
In a fiscal year 1993 conference report,[Footnote 26] the Congress
stated that the bureau should direct its resources towards a more cost-
effective census design that will produce more accurate results than
those from the 1990 Census. For example, the bureau‘s research in
fiscal year 1992 indicated that reducing the number of questions on the
census form is an important way to increase response, thereby
increasing accuracy and reducing cost.
Therefore, the Congress expected the bureau to focus on realistic
alternative means of collecting data, such as the use of existing
surveys, rolling sample surveys, or other vehicles and that cost
considerations should be a substantial factor in evaluating the
desirability of design alternatives.
In March 1993 we testified[Footnote 27] that time available for
fundamental census reform was slipping away and important decisions
were needed by September 1993 to guide planning for 1995 field tests,
shape budget and operational planning for the rest of the census cycle,
and guide future discussions with interested parties. The bureau‘s
strategy for identifying promising census designs and features was
proving to be cumbersome and time consuming, and the bureau had
progressed slowly in reducing the design alternatives for the next
census down to a manageable number.
Fiscal year 1993 funding received was $13.7 million and the bureau
obligated $13.5 million against it. The budget continued to identify
eight major study areas for the 2000 Census as indicated in table 3.
Table 3: 2000 Census Planning and Development Funding for Fiscal Year
1993 (dollars in millions):
Major study area: 1; Description: Simplify questionnaire; Amount: $1.2.
Major study area: 2; Description: Administrative records, modeling and
estimation; Amount: 4.0.
Major study area: 3; Description: Technology options for questionnaire
distribution and collection; Amount: 4.3.
Major study area: 4; Description: Various uses of sampling; Amount:
1.6.
Major study area: 5; Description: Techniques for special areas and
subpopulations; Amount: .9.
Major study area: 6; Description: TIGER[B] Support; Amount: .4.
Major study area: 7; Description: Address list maintenance; Amount:
[A].
Major study area: 8; Description: Administration; Amount: 1.3.
Description: Major study area : Total; Amount: Major study area :
$13.7.
[A] Activity or amounts were less than $.1 million.
[B] Topologically Integrated Geographic Encoding and Referencing
system.
Source: U.S. Census Bureau.
[End of table]
For fiscal year 1993, the bureau experienced a 36 percent increase in
its funding received of $13.7 million over the $10.1 million for fiscal
year 1992. About 53 percent of the fiscal year 1993 funding was
obligated for personnel costs as a result of a 48 percent increase in
FTE staff from 111 in fiscal year 1992 to 164 in fiscal year 1993 to
work on decennial planning and development issues. Services, including
consultants, accounted for about 11 percent of the funding with the
remaining 36 percent used for space, supplies, travel, and other costs.
Fiscal year 1993 was identified by the bureau as the beginning of a 3-
year period to identify the most promising changes to be integrated in
the 1995 Census Test.
Fiscal Year 1994 Funding:
For fiscal year 1994, the Congress reduced the President‘s Budget
request of $23.1 million for 2000 Census planning and development to
$18.7 million,[Footnote 28] for a reduction of about 19 percent. As a
result of this $4.4 million reduction, the bureau eliminated decennial
operational preparation for $2.5 million, and reduced funding for
questionnaire design and cost modeling by $1.6 million or 70 percent.
In May 1993 we testified[Footnote 29] that the U.S. Census Bureau had
altered its decision-making approach and refocused its 2000 Census
research and development efforts. Driven by its impending September
1993 deadline for deciding which designs to test in 1995 for the 2000
Census, the bureau recommended rejecting all 14 design alternatives
that had formed the framework of its research program that was under
study for a year. Instead, the bureau reverted to an earlier approach
of concentrating favorable features into the design for application in
the 2000 Census.
A fiscal year 1994 House Appropriations Committee report[Footnote 30]
cited our May 1993 testimony and stated that it was unacceptable for
the bureau to conduct the 2000 Census under a process that followed the
general plan used in the 1990 Census. A fiscal year 1994 conference
report[Footnote 31] expressed concern that the U.S. Census Bureau had
not adequately addressed cost and scope issues for the 2000 Census and
expected the Department of Commerce and OMB to take a more active role
in planning for the decennial census to ensure that data requirements
for federal agencies and state and local government were considered in
the planning effort.
In October 1993 we testified[Footnote 32] that the U.S. Census Bureau‘s
research and development efforts had been slowed by its changing
planning strategy and that the bureau still faced the difficult task of
integrating its Test Design Recommendation proposals into a detailed
implementation plan for the 1995 census test. We noted that the
bureau‘s plans to conduct research and evaluations for such promising
proposals as the one-number census,[Footnote 33] sampling for
nonresponse, and defining the content of the census were in a state of
flux. Other important research and planning activities, such as
improving the address list and using new automated techniques to
convert respondent answers to machine-readable format, were behind
schedule. Funding for research and test census preparation in fiscal
years 1994 and 1995 was in doubt as evidenced by the budget cuts
proposed by the House Appropriations Committee and the opinions
expressed in its report accompanying the fiscal year 1994
appropriations bill.[Footnote 34]
The bureau obligated the entire amount of its fiscal year 1994 funding
received of $18.7 million. Funding originally contained 6 design areas
for 2000 Census research and development, the 1995 Census test, and
decennial operational preparation but was later revised to present
funds received and obligated in 13 frameworks of effort as indicated in
table 4.
Table 4: 2000 Census Planning and Development Funding for Fiscal Year
1994 (dollars in millions):
Framework number: 1; Description: Program development and management
information; Amount: $1.1.
Framework number: 2; Description: Content requirements and public use
forms; Amount: .7.
Framework number: 3; Description: Test censuses & dress rehearsal;
Amount: 5.5.
Framework number: 4; Description: Decennial geographic support; Amount:
[A].
Framework number: 5; Description: Evaluation & development; Amount:
7.1.
Framework number: 6; Description: Address list compilation; Amount: .1.
Framework number: 7; Description: Precensus day operations & support
systems; Amount: [A].
Framework number: 8; Description: Stakeholder education and
consultation; Amount: .2.
Framework number: 9; Description: Puerto Rico & outlying areas; Amount:
[A].
Framework number: 10; Description: Tabulation, publication, & data user
services; Amount: [A].
Framework number: 11; Description: Automated/telecommunication
support; Amount: 4.0.
Framework number: 12; Description: Year 2001 and beyond; Amount: [A].
Framework number: 13; Description: Cooperation with the U.S Postal
Service; Amount: [A].
Description: Framework number : Total; Amount: Framework number :
$18.7.
[A] Activity or amounts were less than $.1 million.
Source: U.S. Census Bureau.
[End of table]
For fiscal year 1994, the bureau experienced a 36 percent increase in
its funding received of $18.7 million over the $13.7 million for fiscal
year 1993. About 44 percent of the fiscal year 1994 funding was
obligated for personnel costs as a result of a 34 percent increase in
FTE staff from 164 in fiscal year 1993 to 220 in fiscal year 1994 to
work on decennial planning and development issues. Services, including
consultants, accounted for another 13 percent of obligations with the
remaining 43 percent for space, supplies, travel, and other costs. We
noted that six frameworks received little or no funding and three
frameworks accounted for 89 percent of the fiscal year 1994 funds
received and obligated as follows:
Framework 5 - Evaluation and development consumed $7.1 million or 38
percent of funding received and obligated for research and
developmental work to support the 1995 census test. This included:
* research on the use of matching keys beyond just a person‘s residence
address to develop matching procedures that would allow the bureau to
make use of person-based administrative records files that do not have
a current residential address;
* research on various uses of sampling including technical and policy
issues on conducting the entire census on a sample basis and conducting
only the nonresponse follow-up portion of the census on a sample basis;
and:
* race and ethnicity studies including extensive consultation with
stakeholders, focus group testing, and planning of field tests.
Framework 3 - Test census and dress rehearsal consumed $5.5 million or
29 percent of funding received and obligated to increase 1995 Census
Test activities from preliminary studies and planning to the full-scale
preparatory level program. These included such activities as:
* completion of questionnaire content determination,
* analysis of a database of population characteristics by geographic
area to make selections of test sites,
* determination of evaluation program objectives for the test, and:
* determination of objectives for and design stakeholder consultation.
Framework 11 - Automation/telecommunication support consumed $4.0
million or 21 percent of funding received and obligated for automated
systems design and acquisition of data capture technology to upgrade
the 1990 Census system (FACT90) to a 2000 Census system (DCS 2000).
Fiscal Year 1995 Funding:
For fiscal year 1995, the Congress reduced the President‘s Budget
request of $48.6 million for 2000 Census planning and development to
$42.0 million for a reduction of about 14 percent. As a result of this
$6.6 million reduction, the bureau eliminated $9.0 million for
decennial operation preparation and $.8 million for 1996 testing while
increasing funding for program development and other areas by $3.2
million.
In January 1994 we testified[Footnote 35] that while we were encouraged
by the U.S. Census Bureau‘s recent focus on testing specific proposals
to modify the census methodology, we believed that the bureau must
aggressively plan for and carefully implement its research, testing,
and evaluation programs. Further, the results of those efforts must be
available to make fully informed and timely decisions and build needed
consensus among key stakeholders and customers for changes in the 2000
Census.
A fiscal year 1995 Senate Appropriations Committee report[Footnote 36]
strongly recommended that the bureau adopt more cost-effective means of
conducting the next census as the budgetary caps and strict employment
ceilings adopted by the President and the Congress would not
accommodate a repeat of the process used in the 1990 Census.
Fiscal year 1995 funding received was $42.0 million and the bureau
obligated $40.9 million against it. The number of frameworks increased
to 15 as indicated in table 5.
Table 5: 2000 Census Planning and Development Funding for Fiscal Year
1995 (dollars in millions):
Framework number: 1; Description: Program development and management
information; Amount: $2.5.
Framework number: 2; Description: Content requirements and public use
forms; Amount: 1.7.
Framework number: 3; Description: Test censuses & dress rehearsal;
Amount: 30.0.
Framework number: 4; Description: Decennial geographic products &
services; Amount: 1.3.
Framework number: 5; Description: Evaluation & development; Amount:
5.1.
Framework number: 6; Description: Address list compilation; Amount:
[A].
Framework number: 7; Description: Precensus day operations & support
systems; Amount: [A].
Framework number: 8; Description: Postcensus day operations; Amount:
[A].
Framework number: 9; Description: Census marketing, communications, &
partnership; Amount: .5.
Framework number: 10; Description: Puerto Rico & other island
territories; Amount: [A].
Framework number: 11; Description: Tabulation, dissemination, &
customer services; Amount: [A].
Framework number: 12; Description: Automation/telecommunication
support; Amount: [A].
Framework number: 13; Description: Year 2001 & beyond; Amount: [A].
Framework number: 14; Description: Cooperation with the U.S. Postal
Service; Amount: [A].
Framework number: 15; Description: Follow-on surveys; Amount: .9.
Description: Framework number : Total; Amount: Framework number :
$42.0.
[A] Activity or amounts were less than $.1 million.
Source: U.S. Census Bureau.
[End of table]
For fiscal year 1995, the bureau experienced a 125 percent increase in
its funding received of $42.0 million over the $18.7 million for fiscal
year 1994. About 51 percent of the fiscal year 1995 funding was
obligated for personnel costs as a result of a 211 percent increase in
FTE staff from 220 in fiscal year 1994 to 685 in fiscal year 1995 to
work on decennial planning and development issues. Services, including
consultants, accounted for about 7 percent of the obligations with the
remaining 42 percent for space, supplies, travel, and other costs. We
noted that eight frameworks received little or no funding and Framework
3 accounted for over 70 percent of fiscal year 1995 funds received and
obligated. The main focus of Framework 3 was conducting the 1995 Census
Test, in order to select by December 1995 the features to be used for
the 2000 Census. According to census plans and our discussions with
officials, the bureau focused on the following major areas.
* Complete preparation for the 1995 Census Test, conduct the test, and
begin evaluations in order to select the features to be used for the
2000 Census. In addition, the bureau would conduct a full-scale census
test in four district office areas that would be the culmination of the
research and development program.
* Investigate, develop, test, and evaluate components of a continuous
measurement system as a replacement for the 2000 Census sample data
questionnaire.
* Develop, test, and evaluate various matching keys for the automated
and clerical matching and unduplicating[Footnote 37] systems developed
under the direction of the matching research and specifications working
group.
* Conduct activities independent of the research and development
program; these are preparatory activities required to implement the
2000 Census regardless of the design. This included such activities as
planning the address list update activities as necessary to supplement
the Master Address File (MAF) for use in the 2000 Census and begin
initial planning of the field organization structure for the 2000
Census.
* Recommend the broad scope of content that should be included in the
2000 Census questionnaire based on consulting with both federal and
nonfederal data users, and begin planning for small special purpose
tests to supplement or follow up on the 1995 Census Test.
Fiscal Year 1996 Funding:
For fiscal year 1996, the Congress reduced the President‘s Budget
request of $60.1 million for 2000 Census planning and development to
$51.3 million,[Footnote 38] for a reduction of about 15 percent. As a
result of this $8.8 million reduction, the bureau reduced funding for
field data collection and support systems by $9.9 million or 43 percent
while increasing funding in other areas.
In October 1995 we testified[Footnote 39] that the U.S. Census Bureau
had decided to make fundamental changes to the traditional census
design such as shortening census questionnaires, developing an accurate
address list, and sampling households that fail to respond to
questionnaires. However, we noted that successful implementation of
these changes would require aggressive management by the bureau and
that the window of opportunity for the Congress to provide guidance on
these changes and applicable funding was closing.
A fiscal year 1996 conference report[Footnote 40] continued to express
concern about progress related to the next decennial census. It
cautioned the bureau that the cost of the 2000 Census had to be kept in
check and only through early planning and decision making could costs
be controlled. The report further recognized that fiscal year 1996 was
a critical year in planning for the decennial census, and that numerous
decisions will be made and preparations taken which will have a
significant bearing on the overall cost of conducting the census, as
well as the design selected.
The bureau obligated the entire amount of its fiscal year 1996 funding
received of $51.3 million. Beginning with fiscal year 1996, the number
of frameworks was reduced to eight as indicated in table 6 below.
Table 6: 2000 Census Planning and Development Funding for Fiscal Year
1996 (dollars in millions):
Framework number: 1; Description: Program development and management;
Amount: $8.2.
Framework number: 2; Description: Data content and products; Amount:
9.6.
Framework number: 3; Description: Field data collection and support
systems; Amount: 13.3.
Framework number: 4; Description: Address list development; Amount:
2.3.
Framework number: 5; Description: Automated data processing and
telecommunications support; Amount: 6.8.
Framework number: 6; Description: Testing, evaluation, and dress
rehearsal; Amount: 9.4.
Framework number: 7; Description: Puerto Rico, Virgin Islands, and
Pacific areas; Amount: .3.
Framework number: 8; Description: Marketing, communications, and
partnerships; Amount: 1.4.
Description: Framework number : Total; Amount: Framework number :
$51.3.
Source: U.S. Census Bureau.
[End of table]
For fiscal year 1996, the bureau experienced a 22 percent increase in
its funding received of $51.3 million over the $42.0 million for fiscal
year 1995. About 44 percent of the fiscal year 1996 funding was
obligated for personnel costs as a result of a 5 percent decrease in
FTE staff from 685 in fiscal year 1995 to 653 in fiscal year 1996 to
work on decennial planning and development issues. Services, including
consultants, accounted for about 13 percent of the obligations with the
remaining 43 percent for space, supplies, travel, and other costs.
Three frameworks incurred over 60 percent of funding received and
obligated for the following.
* Framework 3 - Field data collection and support systems incurred
costs of $13.3 million including $4.4 million to develop personnel and
administrative systems for field office enumeration; $3.1 million for
precensus day data collection activities; and $2.0 million for
automation acquisition and support for field offices.
* Framework 2 - Data content and products incurred costs of $9.6
million including $4.4 million to develop and produce questionnaires
and public use forms for the census including conduct of a National
Content Test; $2.9 million for race and ethnicity testing of concepts
and respondent understanding and wording of the race and ethnicity
questions; and $1.6 million for continued work with federal and
nonfederal data users in the content determination process to prepare
for the congressional submission by April 1, 1997.
* Framework 6 - Testing, evaluations, and dress rehearsals incurred
costs of $9.4 million including $3.3 million for an Integrated Coverage
Measurement (ICM) special test;[Footnote 41] $2.6 million for research
and development on sampling and sampling methods for the 2000 decennial
count; and $2.1 million for 1995 Census Test coverage and evaluation.
Fiscal Year 1997 Funding:
For fiscal year 1997, the Congress reduced the President‘s Budget
request of $105.9 million for 2000 Census planning and development to
$86.4 million,[Footnote 42] for a reduction of about 18 percent. As a
result of this $19.5 million reduction, the bureau reduced funding for
marketing, communications, and partnerships by $14.4 million or 76
percent, and field data collection and support systems by $23.6 million
or 53 percent, while increasing amounts in other areas by $18.5
million.
A fiscal year 1996 House Appropriation Committee report[Footnote 43]
expressed concern that the bureau appeared not to have developed
options and alternative plans to address issues of accuracy and cost.
In addition, sufficient progress had not been made on issues the
committee had highlighted many times--the number of questions on the
long-form and reimbursement from other agencies for inclusion of such
questions to assure that the question is important.
The bureau obligated the entire amount of its fiscal year 1997 budget
of $86.4 million. Planning continued in eight frameworks as indicated
in table 7.
Table 7: 2000 Census Planning and Development Funding for Fiscal Year
1997 (dollars in millions):
Framework number: 1; Description: Program development and management;
Amount: $5.4.
Framework number: 2; Description: Data, content, and products; Amount:
12.3.
Framework number: 3; Description: Field data collection and support
systems; Amount: 20.9.
Framework number: 4; Description: Address list development; Amount:
2.5.
Framework number: 5; Description: Automated data processing and
telecommunications support; Amount: 20.2.
Framework number: 6; Description: Testing, evaluation, and dress
rehearsal; Amount: 19.8.
Framework number: 7; Description: Puerto Rico, Virgin Islands, and
Pacific areas; Amount: .8.
Framework number: 8; Description: Marketing, communications, and
partnerships; Amount: 4.5.
Description: Framework number : Total; Amount: Framework number :
$86.4.
Source: U.S. Census Bureau.
[End of table]
For fiscal year 1997, the bureau experienced a 68 percent increase in
its funding received of $86.4 million over the $51.3 million for fiscal
year 1996. About 63 percent of the fiscal year 1997 funding was
obligated for personnel costs as a result of a 36 percent increase in
FTE staff from 653 in fiscal year 1996 to 891 in fiscal year 1997 to
work on decennial planning and development issues. Services, including
consultants, accounted for about 25 percent of the obligations with the
remaining 12 percent for space, supplies, travel, and other costs.
The bureau viewed fiscal year 1997 as pivotal, since this was the year
when research and testing activities culminated into operational
activities and marked the end of the planning and development phase of
the 2000 Census. For the fiscal year, four frameworks incurred about 85
percent of funding received and obligated as follows.
Framework 3 - Field data collection and support systems incurred $20.9
million for activities under precensus day operations and support
systems, and postcensus day operations. Projects included:
* $4.1 million for geographic patterns including questionnaire delivery
methodologies by area and corresponding automated control systems;
* $4.0 million for planning of data collection efforts including
activities for truncation and/or the use of sampling for nonresponse
follow-up and increased efforts to develop procedures for enumerating
special populations such as the military, maritime, institutional,
migrant, reservation, and those living in other than traditional
housing units;
* $3.8 million for direction and control by 12 regional offices that
would provide logistical support and direct enumeration efforts by
local census offices; and:
* $3.1 million for planning and developing personnel and administrative
systems to support 2000 Census data collection and processing
activities, such as types of positions, pay rates, personnel and
payroll processes, and systems, space, and security requirements.
Framework 5 - Automation/telecommunication support incurred $20.2
million for activities to include evaluating proposals for the
acquisition of automation equipment and related services, funding the
development of prototype systems, and moving toward awarding contracts
to implement such systems for the 2000 Census. Projects included
setting up data capture systems and support to process census
questionnaire responses and telecommunication systems required to
provide nationwide toll-free 800 number services to answer respondent
questions and to conduct interviews.
Framework 6 - Testing, evaluation, and dress rehearsal incurred $19.8
million for the following activities:
* $3.7 million to begin gearing up for the 1998 dress rehearsal in
order to prepare personnel to conduct the census testing efficiently
and effectively; and:
* $7.0 million to conduct activities for ICM special testing and
American Indian Reservation (AIR) test census such as:
* questionnaire delivery and mail return check-in operations,
* nonresponse followup,
* data capture operations,
* ICM computer-assisted personal visit interviews,
* computer and clerical matching,
* follow-up and after follow-up matching, and:
* evaluation studies.
Framework 2 - Data content and products incurred $12.3 million for
activities related to the development of computer programs and systems
for data tabulation and for the production of paper, machine-readable,
and on-line data products. Projects included:
* $4.5 million to move from research in fiscal year 1996 to
implementation in fiscal year 1997 of the Data Access and Dissemination
System (DADs), including development of the requirements for Census
2000 tabulations from DADs, and development of computer programs and
control systems that will format the processed Census 2000 data for use
in DADs; and:
* $2.2 million towards development of a redistricting program for
Census 2000.
[End of section]
Appendix III: Comments From the Department of Commerce:
THE SECRETARY OF COMMERCE Washington, D.C. 20230:
OCT 16 2002:
Mr. Gregory D. Kutz Director:
Financial Management and Assurance General Accounting Office
Washington, DC 20548:
Dear Mr. Kutz:
The Department of Commerce appreciates the opportunity to comment on
the General Accounting Office draft document entitled 2000 Census:
Lessons Learned for Planning a More Cost-Effective 2010 Census. The
Department‘s comments on this report are enclosed.
Sincerely,
Donald L. Evans:
Signed by Donald L. Evans:
Enclosures:
Comments from the U.S. Department of Commerce U.S. Census Bureau:
U.S. General Accounting Office draft report entitled 2000 Census:
Lessons Learned for Planning a More Cost-Effective 2010 Census:
Comments on the Text of the Report:
The U.S. Census Bureau has reviewed this report carefully and
appreciates this opportunity to respond prior to its publication.
We agree with the General Accounting Office (GAO) that Census 2000 was
very successful. However, this was not attributable to a sound planning
and development effort. Rather, it was due to a tremendous effort at
the time of execution, which resulted in a very costly census conducted
at an unacceptably high level of risk. Accordingly, we also agree with
the fundamental conclusion of the report, that ’thorough and
comprehensive planning and development efforts are crucial to the
ultimate efficiency and success of any large, long-term project,
particularly one with the scope, magnitude, and deadlines of the U.S.
decennial census.“:
We believe that our plan for reengineering the decennial census design
for 2010 directly addresses these issues (see Appendix 1,
’Reengincering the 2010 Census“). However, as GAO stresses, the success
of this effort hinges on our ability to conduct early planning,
development, and testing of all components of the census design. The
GAO points out that the Census Bureau only directed 4 percent of the
life-cycle costs for Census 2000 to early planning and development. For
the 2010 census, this has been increased to 8 percent of the life-cycle
costs of conducting a short-form-only census. This figure increases to
17 percent when the cost of implementing the American Community Survey
and the Master Address File/Topologically Integrated Geographic
Encoding and Referencing (MAF/TIGER) enhancements program is taken into
consideration. (These costs are summarized in Appendix 2, ’Life-Cycle
Savings of the 2010 Census,“ which is currently under revision.):
The GAO recommends that the Census Bureau ’provide comprehensive
information backed by supporting documentation in its future funding
requests for planning and development activities.“ The Census Bureau
wholeheartedly agrees with this recommendation. Consistent with
Department of Commerce and Office of Management and Budget guidelines,
the Census Bureau is expanding the documents justifying budgetary
requests. A primary example of this is the ’Capital Asset Plan and
Business Case“ (Exhibit 300), which outlines the Census Bureau‘s
planned information technology development and activities throughout
the decennial census cycle.
Appendix 2:
Reengineering the 2010 Census U.S. Census Bureau:
September 2002:
The reengineered 2010 census consists of three highly integrated
activities designed to dramatically improve upon an already very good
Census 2000. We will accomplish this by taking advantage of
opportunities for innovations made possible through the expanded use of
technology and targeting of coverage improvement procedures that will
enable the U.S. Census Bureau to:
1. Improve the relevance and timeliness of census long form data.
2. Reduce operational risk.
3. Improve the accuracy of census coverage.
4. Contain costs.
The three integrated components are:
1. Collect and tabulate long-form data every year throughout the decade
through a large household survey (the American Community Survey [ACS]).
2. Enhance and improve our existing address lists and geographic
information system (GIS) data base (Topologically Integrated Geographic
Encoding and Referencing [TIGER]) by bringing them into alignment with
true global positioning system (GPS) coordinates and converting our
TIGER to a commercial off-the-shelf (COTS) database environment.
3. A program of early planning, development, and testing designed to
completely restructure the management and conduct of a short-form-only
census in 2010. That will further reduce the differential undercount
measured since the 1940s without resorting to statistical adjustment
and will provide the savings needed to support this initiative.
Adopting the ACS as the planned replacement for the census long form
will allow the short-form-only census to focus more directly on meeting
the legally mandated collection and issuance of the apportionment and
redistricting data. This will transfer to the ACS the responsibility to
provide estimates of detailed demographic and housing data throughout
the decade. This more timely and therefore more relevant data will
greatly enhance the information currently provided by the once-in-a-
decade long form.
An updated master address file (MAF) and an accompanying improved TIGER
data base with GPS positional accuracy will allow the Census Bureau to
maintain the inventory and location of addresses and features. In
addition, we will greatly expand our ability to improve the accuracy
and completeness of our census GIS systems that process these data.
These MAF/TIGER enhancements are key to allowing the Census Bureau to
adopt the technology necessary to fully utilize GPS-equipped, hand-held
mobile computing devices to find, interview, and update data on persons
and housing units for the short-form-only census in 2010, thereby,
achieving the:
Appendix 2:
Census Bureau‘s constitutionally mandated objectives at a greatly
reduced cost.
These two components (the ACS and the MAF/TIGER enhancements) are truly
exciting and innovative in their own right. But unless they can be
translated into an improved 2010 census and done so without expanding
the cost of census taking, the goals of the reengineered census will
not be met.
The third component (early 2010 planning, development and testing) is
essential to complete the picture. The new short-form-only census,
which is the end goal of this component, is, in fact, the key component
to the success of this reengineering effort. Without it, we are left
with a census that improves relevance but at a greatly expanded cost
and with no serious improvements in operational risk or coverage
accuracy.
By taking advantage of no long-form requirements for the 2010 census
coupled with access to current data from the ACS for targeting areas
requiring special attention to improve coverage, the potential cost and
accuracy of the 2010 short-form-only census can be greatly improved.
Add to this the availability of a fully GPS-aligned MAF/TIGER system
allowing for a dramatic reduction in field infrastructure costs
resulting mostly from a near elimination of paper and the huge staff
and space required to handle that paper, we have the potential to
completely restructure the data collection, data capture, and data
processing of the 2010 census. This will result in a census that is
more focused on coverage issues, less operationally risky and less
costly.
This, however, will not happen automatically. A decennial census is a
very complex task involving hundreds of thousands of temporary staff
over a very short period of time and costing several billions of
taxpayer dollars.
To do this successfully, procedures must be fully tested under real
life conditions and refined well in advance of Census Day. You only get
one chance to get it right.
The early years of this component involve extensive planning,
development, testing, revising, and retesting of literally thousands of
procedures needed to complete a successful census. We are planning to
restructure many of these procedures to reduce costs and improve
accuracy while keeping operational risk to a minimum. To do this, we
plan a major field test in 2004, focusing primarily on improved
methodologies for data collection and coverage. In 2006, we plan a
second major field test. This time the test will be focused primarily
on the systems integration needed to carry out this new census design.
In 2008, we plan for a full dress rehearsal of the new census, setting
the stage for a 2010 census that delivers on all the goals of 2010
census reengineering.
In addition to improved accuracy and reduced operational risk, we
expect cost reductions in this component to be sufficient to pay for
all three components of the reengineered census. That is, all three
components will be carried out at a cost that is no greater and
probably somewhat less than repeating the process of Census 2000.
The following are GAO‘s comments on the letter dated October 16, 2002,
from the Department of Commerce.
GAO Comments:
1. The objectives of our report did not include assessing the degree of
success of the 2000 Census.
2. See ’Agency Comments and Our Evaluation“ section of this report.
[End of Section]
FOOTNOTES
[1] The bureau‘s use of major categories evolved from 1 activity of
general planning in fiscal year 1991, to 8 major study areas in fiscal
years 1992 and 1993, to 8 to 15 broad categories called frameworks
beginning in 1994. For internal management and reporting, the bureau
further identified program efforts by activities and projects that have
varied since fiscal year 1991.
[2] Stakeholders include the Congress, federal agencies, state and
local governments, the public, demographers, and others who rely upon
census information.
[3] Global Report of the Task Force for Planning the Year 2000 Census,
Reinventing the Decennial Census (Washington, D.C.: June 1995).
[4] U.S. General Accounting Office, Census Reform Needs Attention Now,
GAO/T-GGD-91-13 (Washington, D.C.: Mar. 12, 1991); Decennial Census:
1990 Results Show Need for Fundamental Reform, GAO/GGD-92-94
(Washington, D.C.: June 9, 1992); Decennial Census: Fundamental Reform
Jeopardized by Lack of Progress, GAO/T-GGD-93-6 (Washington, D.C.: Mar.
2, 1993); and Decennial Census: Focused Action Needed Soon to Achieve
Fundamental Breakthroughs, GAO/T-GGD-93-32 (Washington, D.C.: May 27,
1993).
[5] U.S. General Accounting Office, Decennial Census: Fundamental
Design Decisions Merit Congressional Attention, GAO/T-GGD-96-37
(Washington, D.C.: Oct. 25, 1995).
[6] U.S. General Accounting Office, The High-Risk Series, GAO/HR-97-2
(Washington, D.C.: Feb. 1997) is a special effort to review and report
on the federal program areas we have identified as high risk because of
their vulnerability to waste, fraud, abuse, or mismanagement.
[7] U.S. General Accounting Office, 2000 Census: Progress Made on
Design, but Risks Remain, GAO/GGD-97-142 (Washington, D.C.: July 14,
1997).
[8] Public Law 105-119, § 210, 111 Stat. 2483 (Nov. 26, 1997).
[9] The Census Address List Improvement Act of 1994 (Public Law 103-
430), required the U.S. Census Bureau to use the DSF and address lists
from local and tribal governments to build the Census 2000 address
list.
[10] MAF is a computer database of household addresses contained in the
database from the 1990 Census, various versions of the U.S. Postal
Service‘s DSF, and update information provided by state, local, and
tribal governments. The MAF was to be updated throughout the decade to
provide a basis for producing address labels needed to deliver 2000
Census questionnaires, to track questionnaires returned, and to
identify addresses for later site visits by enumerators.
[11] Questionnaires were available in Spanish, Chinese, Korean,
Vietnamese, and Tagalog.
[12] Cost-reimbursement contracts allow for payment of all allowable
incurred costs within a predetermined ceiling set in the contract.
Cost-reimbursement contracts place less cost and performance risk on
the contractor, as opposed to fixed-price contracts, which place more
responsibility on the contractor for performance costs and resulting
profit or loss.
[13] Title 13 U.S.C. § 9 prohibits (1) use of the information furnished
under Title 13 for any purpose other than the statistical purposes for
which it is supplied, (2) making any publication whereby the data
furnished by any particular establishment or individual under Title 13
can be identified, or (3) permitting anyone other than sworn officers
and employees of the Department of Commerce or agency thereof to
examine individual reports. Title 13 U.S.C. § 214 and 18 U.S.C. § 3551,
et seq., provides for a fine of not more than $250,000 or imprisonment
for not more than 5 years, or both, for disclosure of census
information prohibited by 13 U.S.C. § 9.
[14] U.S. Census Bureau, Prepared Statement of James F. Holmes, Acting
Director (Washington, D.C.: Mar. 26, 1998).
[15] U.S. Census Bureau, Census 2000 Dress Rehearsal Evaluation Summary
(Suitland, MD: 1999).
[16] GAO/GGD-97-142.
[17] U.S. House of Representatives, Making Appropriations for the
Departments of Commerce, Justice, and State, the Judiciary, and Related
Agencies for the Fiscal Year Ending September 30, 1993, Report 102-918
(Washington, D.C.: Sep. 28, 1992).
[18] GAO/T-GGD-93-6.
[19] U.S. Census Bureau, The Reengineered 2000 Census (Suitland, MD:
May 19, 1995).
[20] Public Law 105-18, Title VIII (June 12, 1997).
[21] The bureau distributed a revised and reissued version of this
report in August 1997.
[22] U.S. Census Bureau, Census 2000 Address List Reengineering,
(Suitland, MD: Sept. 24, 1997).
[23] For example, in fiscal year 2000, within the 8 decennial census
frameworks, the bureau identified 23 activities and 119 projects.
[24] GAO/T-GGD-91-13.
[25] $13.0 million of funding plus $.7 million for prior year
recoveries and carry-in.
[26] U.S. House of Representatives, Making Appropriations for the
Departments of Commerce, Justice, and State, the Judiciary, and Related
Agencies for the Fiscal Year Ending September 30, 1993, Report 102-918
(Washington, D.C.: Sep. 28, 1992).
[27] GAO/T-GGD-93-6.
[28] $8.1 million of funding plus $10.6 million for prior year
recoveries and carry-in.
[29] GAO/T-GGD-93-32.
[30] U.S. House of Representatives, Departments of Commerce, Justice,
and State, the Judiciary, and Related Agencies Appropriations Bill,
Fiscal Year 1994, Report 103-157 (Washington, D.C.: June 24, 1993).
[31] U.S. House of Representatives, Making Appropriations for the
Departments of Commerce, Justice, and State, the Judiciary, and Related
Agencies for the Fiscal Year Ending September 30, 1994, H.R. Conference
Report 103-293 (Washington, D.C.: Oct. 14, 1993).
[32] U.S. General Accounting Office, Decennial Census: Test Design
Proposals Are Promising, But Fundamental Reform is Still at Risk, GAO/
T-GGD-94-12 (Washington, D.C.: Oct. 7, 1993).
[33] A one-number census combines the features of both the traditional
head count and statistical methods to produce a single population
count.
[34] U.S. House of Representatives, Departments of Commerce, Justice,
and State, the Judiciary, and Related Agencies Appropriations Bill,
Fiscal Year 1994, Report 103-157 (Washington, D.C.: June 24, 1993).
[35] U.S. General Accounting Office, Decennial Census: Promising
Proposals, Some Progress, But Challenges Remain, GAO/T-GGD-94-80
(Washington, D.C.: Jan. 26, 1994).
[36] U.S. Senate, Departments of Commerce, Justice, and State, the
Judiciary, and Related Agencies Appropriation Bill, 1995, Report 103-
309 (Washington, D.C.: July 14, 1994).
[37] The bureau uses unduplication to refer to the process of detecting
duplicate census responses that contribute to a population overcount.
Causes of duplication include multiple responses for the same address,
college students counted both at school and at home, people with
multiple residences, and military residing outside their home state.
[38] $48.8 million of funding plus $2.5 million for prior year
recoveries and carry-in.
[39] GAO/T-GGD-96-37.
[40] U.S. House of Representatives, Making Appropriations for the
Departments of Commerce, Justice, and State, the Judiciary, and Related
Agencies for the Fiscal Year Ending September 30, 1996, H.R. Conference
Report 104-378 (Washington, D.C.: Dec. 1, 1995).
[41] The ICM Special Test used cognitive questionnaire testing methods
to refine the count interview instrument and to gather data from the
1995 Census Test to conduct estimation research.
[42] $84.1 million of funding plus $2.3 million for prior year
recoveries and carry-in.
[43] U.S. House of Representatives, Departments of Commerce, Justice,
and State, the Judiciary, and Related Agencies Appropriations Bill,
Fiscal Year 1997, Report 104-676 (Washington, D.C.: July 16, 1996).
GAO‘s Mission:
The General Accounting Office, the investigative arm of Congress,
exists to support Congress in meeting its constitutional
responsibilities and to help improve the performance and accountability
of the federal government for the American people. GAO examines the use
of public funds; evaluates federal programs and policies; and provides
analyses, recommendations, and other assistance to help Congress make
informed oversight, policy, and funding decisions. GAO‘s commitment to
good government is reflected in its core values of accountability,
integrity, and reliability.
Obtaining Copies of GAO Reports and Testimony:
The fastest and easiest way to obtain copies of GAO documents at no
cost is through the Internet. GAO‘s Web site ( www.gao.gov ) contains
abstracts and full-text files of current reports and testimony and an
expanding archive of older products. The Web site features a search
engine to help you locate documents using key words and phrases. You
can print these documents in their entirety, including charts and other
graphics.
Each day, GAO issues a list of newly released reports, testimony, and
correspondence. GAO posts this list, known as ’Today‘s Reports,“ on its
Web site daily. The list contains links to the full-text document
files. To have GAO e-mail this list to you every afternoon, go to
www.gao.gov and select ’Subscribe to daily E-mail alert for newly
released products“ under the GAO Reports heading.
Order by Mail or Phone:
The first copy of each printed report is free. Additional copies are $2
each. A check or money order should be made out to the Superintendent
of Documents. GAO also accepts VISA and Mastercard. Orders for 100 or
more copies mailed to a single address are discounted 25 percent.
Orders should be sent to:
U.S. General Accounting Office
441 G Street NW,
Room LM Washington,
D.C. 20548:
To order by Phone:
Voice: (202) 512-6000:
TDD: (202) 512-2537:
Fax: (202) 512-6061:
To Report Fraud, Waste, and Abuse in Federal Programs:
Contact:
Web site: www.gao.gov/fraudnet/fraudnet.htm E-mail: fraudnet@gao.gov
Automated answering system: (800) 424-5454 or (202) 512-7470:
Public Affairs:
Jeff Nelligan, managing director, NelliganJ@gao.gov (202) 512-4800 U.S.
General Accounting Office, 441 G Street NW, Room 7149 Washington, D.C.
20548: