Contract Management
Guidance Needed for Using Performance-Based Service Contracting
Gao ID: GAO-02-1049 September 23, 2002
Federal agencies spent $136 billion dollars in 2001 acquiring services ranging from clerical support and consulting services to information technology services, such as network support, and management and operations of government facilities, such as national laboratories. To achieve greater cost savings and better outcomes with this spending, Congress and the administration have encouraged greater use of performance-based contracting. Under this approach, the contracting agency specifies the outcome or result it desires and leaves it to the contractor to decide how best to achieve the desired outcome. Most of the 25 contracts GAO reviewed exhibited at least one or more performance-based attributes, but there was a range in the degree to which they exhibited these attributes.
Recommendations
Our recommendations from this work are listed below with a Contact for more information. Status will change from "In process" to "Open," "Closed - implemented," or "Closed - not implemented" based on our follow up work.
Director:
Team:
Phone:
GAO-02-1049, Contract Management: Guidance Needed for Using Performance-Based Service Contracting
This is the accessible text file for GAO report number GAO-02-1049
entitled 'Contract Management: Guidance Needed for Using Performance-
Based Service Contracting' which was released on October 23, 2002.
This text file was formatted by the U.S. General Accounting Office
(GAO) to be accessible to users with visual impairments, as part of a
longer term project to improve GAO products‘ accessibility. Every
attempt has been made to maintain the structural and data integrity of
the original printed product. Accessibility features, such as text
descriptions of tables, consecutively numbered footnotes placed at the
end of the file, and the text of agency comment letters, are provided
but may not exactly duplicate the presentation or format of the printed
version. The portable document format (PDF) file is an exact electronic
replica of the printed version. We welcome your feedback. Please E-mail
your comments regarding the contents or accessibility features of this
document to Webmaster@gao.gov.
Report to the Chairman, Subcommittee on Technology and Procurement
Policy, Committee on Government Reform, House of Representatives:
United States General Accounting Office:
GAO:
September 2002:
Contract Management:
Guidance Needed for Using Performance-Based Service Contracting:
GAO-02-1049:
Contents:
Letter:
Results in Brief:
Background:
How Contracts Exhibited Performance Attributes Varied:
Guidance on Performance-Based Contracting Needs Improvement:
Conclusions:
Recommendations for Executive Action:
Agency Comments:
Appendix I: Scope and Methodology:
Appendix II: Performance-Based Service Contracting in the Federal
Acquisition Regulation:
Appendix III: Major Performance-Based Service Contracting Events:
Appendix IV: GAO Contact and Staff Acknowledgments:
Tables:
Table 1: Contracts Maximizing Contractor Initiative to Achieve Desired
Outcomes:
Table 2: Contracts That Did Not Clearly Exhibit All Four Performance-
Based Attributes:
Table 3: Contracts That Were More Complex and Risky:
Table 4: Service Contracts Reviewed:
Abbreviations:
DOE: Department of Energy
FAR: Federal Acquisition Regulation
FPDS: Federal Procurement Data System
GAO: General Accounting Office
GSA: General Services Administration
NASA: National Aeronautics and Space Administration
OMB: Office of Management and Budget
OFPP: Office of Federal Procurement Policy
OMB: Office of Management and Budget
SEC: Securities and Exchange Commission:
Letter:
September 23, 2002:
The Honorable Tom Davis
Chairman, Subcommittee on Technology and
Procurement Policy
Committee on Government Reform
House of Representatives:
Dear Mr. Chairman:
Federal agencies spent roughly $136 billion last year acquiring
services ranging from clerical support and consulting services to
information technology services, such as network support, to management
and operations of government facilities, such as national laboratories.
To achieve greater cost savings and better outcomes with this spending,
the Congress and the administration have encouraged greater use of
performance-based service contracting. Under this approach, the
contracting agency specifies the outcome or result it desires and
leaves it to the contractor to decide how best to achieve the desired
outcome.
You requested that we evaluate whether service contracts characterized
by agencies as performance-based contain basic performance-based
attributes. These attributes include descriptions of what outcomes the
agency is looking for rather than descriptions of how services should
be performed; measurable performance standards; quality assurance plans
that describe how the contractor‘s performance will be evaluated; and
positive and negative incentives, when appropriate.
To respond to your request, we asked five major government agencies--
the Department of Energy (DOE), the Department of the Treasury, and the
Department of Defense; the National Aeronautics and Space
Administration (NASA); and the General Services Administration (GSA)--
to identify contracts that they considered to be models of performance-
based service contracting. On the basis of the contract type and
service provided, we reviewed 25 contracts to assess whether they
exhibited performance-based attributes and discussed our findings with
agency and contracting officials. Appendix I discusses our scope and
methodology.
Results in Brief:
Most of the 25 contracts we reviewed exhibited at least one of the
performance-based attributes but there was a range in the degree to
which they exhibited these attributes.
* On one end were nine contracts that clearly exhibited all of the
attributes. These were contracts for services widely performed in the
commercial sector, such as custodial services, building maintenance,
and advertising. These contracts lend themselves to performance-based
contracting because measuring and specifying intended outcomes is
relatively straightforward, and there is little need for the government
to specify a host of unique requirements or to play a strong role in
how the contract is executed.
* On the other end were four contracts, also for services widely
performed in the commercial sector, which did not clearly exhibit all
of the attributes. While the contracts included performance incentives,
they were very prescriptive in how the work should be carried out. By
being as prescriptive as they were, the agencies did not enable their
contractors to find better, more cost-effective ways of doing business
using performance-based contracting.
* In between this range were 12 contracts for more unique and complex
services. In most of these cases, agencies strived to build in
performance-based attributes but they appropriately found that they
still needed to be prescriptive and to exert strong oversight, because
the services themselves presented safety, cost, and/or technical risks.
Though our review focused on a small sample of contracts, it does raise
concern as to whether agencies have a good understanding of
performance-based contracting and how to take full advantage of it.
Agency officials themselves pointed to the need for better guidance on
performance-based contracting and better criteria on which contracts
should be called ’performance-based.“:
The Office of Federal Procurement Policy recognizes this is a problem
and is in the initial stages of developing new guidance examining how
to improve agency use of performance-based contracting. The
recommendations in this report focus on the office‘s need to consider
an in-depth evaluation of agencies‘ use of performance-based
contracting as it proceeds with this effort.
The Office of Federal Procurement Policy provided oral comments on a
draft of this report and concurred generally with the views expressed
in the draft.
Background:
Performance-based contracts clearly spell out the desired end result
expected of the contractor. The manner in which the work is to be
performed is left up to the contractor. Contractors are given as much
freedom as possible in figuring out how best to meet the government‘s
performance objective. Traditionally, government service contracts
have tended to emphasize inputs rather than outcomes. For example,
contracts typically have detailed the procedures and processes to be
used in delivering a service; amount and type of equipment; and/or time
and labor to be used.
Performance-based contracts offer significant benefits. Primarily,
they encourage contractors to be innovative and to find cost-effective
ways of delivering services. By shifting the focus from process to
results, they also promise better outcomes.
In view of the potential benefits, the Office of Management and Budget
(OMB) has been encouraging greater use of performance-based
contracting--setting a general goal of making performance-based
contracts 20 percent of all eligible service contracting
dollars.[Footnote 1] In 2001, agencies reported using performance-based
contracting methods on about $28.6 billion, or 21 percent of the $135.8
billion total obligations incurred for services. Specifically, of about
360,000 service contract actions during fiscal year 2001, agencies
reported that about 41,000 (approximately
11 percent) were performance-based.[Footnote 2]
According to Office of Federal Procurement Policy (OFPP) guidance,
performance-based contracts should have the following attributes.
1. Describe the requirements in terms of results required rather than
the methods of performance of the work. Agencies should structure
performance work statements in contracts around the purpose of the work
to be performed, that is, what is to be performed rather than how to
perform it. For example, instead of telling the contractor how to
perform aircraft maintenance or stating how many mechanics should be
assigned to a crew, the contract should state that the contractor is
accountable for ensuring that 100 percent of flight schedules are met
or that 75 percent of all aircraft will be ready for flight.
2. Set measurable performance standards. Standards should be set in
terms of quality, timeliness, and quantity among other things. Agencies
should ensure that each standard is necessary, carefully chosen, and
not unduly burdensome. Failure to do so can result in unnecessarily
increased contract costs. Agencies should also ensure that standards
are not set so high that they could drive up the cost of service or too
low that they may act as a disincentive to good contract performance.
3. Describe how the contractor‘s performance will be evaluated in a
quality assurance plan. A good quality assurance plan should include a
surveillance schedule and clearly state the surveillance methods to be
used. The plan should focus on the quality, quantity, and timeliness of
the performance outputs to be delivered by the contractor, among other
things, and not on the steps required or methods used to produce the
service.
4. Identify positive and negative incentives, when appropriate.
Incentives should be used when they will induce better quality
performance and may be either positive or negative, or a combination of
both. They should apply to the most important aspects of the work,
rather than every individual task.
How Contracts Exhibited Performance Attributes Varied:
Most of the 25 contracts we reviewed exhibited at least one of the
performance-based attributes, but there was a wide range in the extent
to which they did. On the one end were contracts for services widely
performed in the commercial sector that clearly exhibited all
attributes. On the other were contracts for similar services that did
not exhibit all of the attributes. In between were contracts for
services that were much more complex and sophisticated. Agencies
strived to build in performance-based attributes, but they found that
they still needed to be prescriptive and needed to exert strong
oversight because the services themselves presented considerable risks.
Contracts That Clearly Exhibited All Attributes:
Nine contracts clearly exhibited all four attributes. (See table 1.)
These contracts:
* described what outcomes the government was looking for and left it up
to the contractor to decide how best to achieve these outcomes,
* set measurable performance standards,
* subjected the contractor to a quality assurance plan, and:
* included performance penalties and incentives when appropriate.
Table 1: Contracts Maximizing Contractor Initiative to Achieve Desired
Outcomes:
1; Agency: Army; Service: On-line educational services to enable
service men and women to pursue post-secondary degrees and vocational-
technical certificates.
2; Agency: Navy; Service: Advertising campaign to support the Navy‘s
recruitment needs.
3; Agency: Air Force; Service: Custodial services at an Air Force base.
4; Agency: GSA/FTS; Service: Information technology support services
for the Securities and Exchange Commission.
5; Agency: GSA/PBS; Service: Janitorial services at two federal
buildings.
6; Agency: GSA/PBS; Service: Recurring maintenance and repair services
at two federal buildings.
7; Agency: GSA/PBS; Service: Systems and equipment operations and
maintenance at a federal building.
8; Agency: Treasury; Service: Tour guide services for the Bureau of
Engraving and Printing.
9; Agency: Treasury; Service: Firearms support services for the Federal
Law Enforcement Training Center.
Legend
FTS = Federal Technology Service
PBS = Public Buildings Service:
Source: GAO, based on information provided by the agencies.
[End of table]
The nine contracts were generally for types of services that are
performed widely in the commercial sector, such as custodial services,
building maintenance, or advertising. These types of services lend
themselves to performance-based contracting because measuring and
specifying outcomes for them are relatively straightforward. Moreover,
the services themselves do not present substantial risks to the
government, and they do not require the government to specify numerous
unique requirements or to play a strong role in how the contract is
executed.
Agencies still undertook considerable efforts to build performance
attributes into their contracts. For example, in contracting for
advertising services for its recruiting campaign, the Navy studied how
the service was performed successfully in the private sector and used
the results of its study to enhance its contract. In contracting for
janitorial services, GSA collected performance and cost data to make
sure it developed good measures of performance and incentives. The data
were also used to obtain competitive prices on subsequent contracts.
When performance-based attributes were incorporated into the contracts,
agencies generally reported positive results. For example, the
Securities and Exchange Commission (SEC) was very satisfied with a
contract that GSA awarded for information technology support services.
SEC officials reported that the contractor took a proactive approach to
improving the operations and efficiencies of their information
technology resources and formed an effective partnership with the
agency. In addition, the Navy found that the contractor running its
recruitment advertising campaign exceeded its expectations by
identifying 224,195 qualified leads in fiscal year 2001; the Navy‘s
goal was 208,500.
Contracts That Could Have Incorporated All Attributes but Did Not:
Four contracts could have incorporated all of the attributes but did
not. (See table 2.) Like the contracts above, these contracts were for
relatively uncomplicated services (dormitory management, food
services, military housing maintenance, and refuse collection) that
lend themselves to performance-based contracting. While contracts had
either positive or negative performance incentives, they were very
prescriptive in how the work should be carried out.
Table 2: Contracts That Did Not Clearly Exhibit All Four Performance-
Based Attributes:
1; Agency: Air Force; Service: Refuse collection and recycling at an
Air Force base.
2; Agency: Air Force; Service: Maintaining housing at an Air Force
base.
3; Agency: Treasury; Service: Dormitory management at Federal Law
Enforcement Training Center.
4; Agency: Treasury; Service: Food management at Federal Law
Enforcement Training Center.
Source: GAO, based on information provided by the agencies.
[End of table]
Examples of the prescriptive contracts are highlighted below.
* The $3 million Treasury dormitory management contract contained 47
pages of specifications that, among other things, detailed: the cotton/
polyester fiber content of towels, bed linens, and ironing board pads;
the components necessary for making up a bed; monogramming contractor
employee uniforms; minimum thickness standards for trash can liners;
and when and how to perform maintenance on water coolers and air
conditioning equipment.
* The $44.1 million food service contract, also at Treasury, contained
33 pages of specifications that detailed: the provisions for picnic
lunches (6-to 8-inch average length for corn-on-the-cob); specific
sandwiches to be served for each day of the week; and procedures to
maintain a technical library.
By being as prescriptive as they were, the agencies did not enable the
contractor to develop and implement better or more cost-effective ways
of doing business using performance-based contracting. As a result,
they missed out on an opportunity to achieve better outcomes with their
spending for services.
Twelve Contracts for More Complex, Risky Services Had Some Attributes:
The remaining contracts were for services that were either unique to
government, very complex and technical, and/or high risk. For example,
three contracts were for operating Navy tactical test ranges, one was
for launching and recovering the space shuttle, and one was for
operating a nuclear facility. (See table 3.) In these cases, agencies
strived to build in the attributes. However, because of the risk and
complexity involved, they found that they could not forego maintaining
a strong role in specifying how the work should be done as well as
overseeing the work. As a result, while the contracts had some
attributes, such as incentives and quality assurance plans and
performance measures, they also sometimes built in very detailed work
specifications, numerous performance measurements, and/or extensive
oversight controls.
Two examples of these more complex situations are highlighted below.
* In contracting for management and operation services at its Savannah
River Site Facility, the Department of Energy built in attributes such
as incentives tied to outcomes and performance measures. DOE noted that
it designed the contract to be more outcome-oriented than prior
contracts. However, because of the high-risk nature of the work being
done, the agency also put in 14 highly detailed ’work authorizations“
that required the contractor to follow many protocols and
specifications in conducting the work.
* In contracting for space shuttle services, NASA built in performance
measures that were tied to a quality assurance plan and built in
incentive and penalty provisions to foster better performance by the
contractor. NASA officials said the agency included fewer
specifications than it did for the prior contract. The contract‘s work
specifications, however, were still very detailed (107 pages), as were
the performance metrics (190). NASA officials believed that the
contract went as far as it could toward building in performance-based
attributes without putting its astronauts‘ lives at risk as well as
risking highly expensive equipment.
Such complex situations may require strong government oversight. Our
prior reports, particularly those on NASA and DOE, have called for more
effective oversight for operations similar to the ones we reviewed in
order to stem cost overruns, scheduling delays, and performance
problems.
Table 3: Contracts That Were More Complex and Risky:
1; Agency: Army; Service: * Technical and administrative support for a
DNA registry, forensic toxicology lab, pathology center, and museum.
2; Agency: Navy; Service: * Engineering, logistics, program management,
and finance support services for the Naval Sea Systems Command.
3,4,5; Agency: Navy; Service: * Operating and maintaining tactical test
ranges and equipment at three Navy installations; * Three separate
contracts.
6; Agency: DOE; Service: * Management and operations at Argonne
National Laboratory (research and development).
7; Agency: DOE; Service: * Management and operations at Savannah River
Site Facility.
8; Agency: NASA; Service: * Operations support for launch and recovery
of the space shuttle.
9; Agency: NASA; Service: * Avionics systems research & development and
engineering for the space shuttle and the international space station.
10; Agency: NASA; Service: * Scientific, engineering, information
technology, and administrative support at NASA‘s Laboratory of
Terrestrial Physics.
11; Agency: NASA; Service: * Contractor oversight to ensure that NASA‘s
technical contract requirements are met.
12; Agency: NASA; Service: * Logistical services for NASA‘s Goddard
Space Flight Center, headquarters, and other locations.
Legend
DNA = deoxyribonucleic acid:
Source: GAO, based on information provided by the agencies.
[End of table]
Guidance on Performance-Based Contracting Needs Improvement:
Though our review focused on a small sample of contracts, it raises
concern as to whether agencies have a good understanding of
performance-based contracting and how to take full advantage of it.
Some agency officials said that they would like better guidance on
performance-based contracting, particularly with respect to how it can
be applied in more complex situations. Agency officials also said that
there is a need for better criteria on which contracts should be
labeled as performance-based.
The Office of Federal Procurement Policy recognizes that this is a
problem and is in the initial stages of developing new guidance
examining how to improve agencies‘ use of performance-based
contracting. OFPP officials told us they believe that federal agencies
generally need a better understanding of performance-based contracting.
At present, OFPP plans to reexamine performance-based contracting for
agencies and created a task force to consider the issues surrounding
the definition and composition of performance-based contracting. OFPP
is currently reviewing the Task Force‘s recommendations.
Conclusions:
Performance-based contracting offers a viable way toward achieving
savings and getting better results from contractors. Our review
revealed that some agencies are taking full advantage of this
contracting method for services that are widely available in the
commercial sector and are finding that it is producing better outcomes.
For similar services, however, some agencies are only partially
applying performance-based methods and are missing opportunities to
find better ways of doing business. In addition, some agencies are
attempting to take the approach one step further by applying it to more
complex, risky, unique endeavors but still find that they need to
maintain strong government involvement in order to mitigate risks.
OFPP‘s effort to reexamine performance-based contracting is a good step
toward enhancing understanding. Nevertheless, more guidance and study
on agencies‘ use of this method may be needed to understand how
effectively agencies are applying this technique and what results they
are achieving.
Recommendations for Executive Action:
As part of the office‘s effort to reexamine performance-based
contracting, we recommend that the Administrator of OFPP clarify
existing guidance to ensure that performance-based contracting is
appropriately used, particularly when acquiring more unique and complex
services that require strong government oversight.
Because of the growing importance of performance-based contracting to
the executive branch, we also recommend that the Administrator of OFPP
work with agencies to periodically evaluate how well agencies
understand performance-based contracting, how they are applying it to
services that are widely available in the commercial sector as well as
more unique and complex services, and what results they are achieving-
-both in terms of outcomes and cost savings.
Agency Comments:
On September 15, 2002, OFPP officials provided us with oral comments on
the draft and generally concurred with the views and recommendations
expressed in the draft report. The officials stated that OFPP, through
its task force on performance-based contracting, is working on several
issues that were addressed in the report. In addition to definitional
issues, the task force is examining whether the expectation of cost
savings is a realistic goal and whether the participation goals for
fiscal year 2003 and beyond should be revisited. OFPP agrees that a
clear need exists for better criteria as to when service contracts
should be classified as ’performance-based.“:
As agreed with your office, unless you publicly announce its contents
earlier, we plan no further distribution of this report until 30 days
from the date of this letter. We will then send copies of this report
to the Secretaries of Defense, Energy, and the Treasury; the
Administrators of the National Aeronautics and Space Administration,
the General Services Administration, and the Office of Federal
Procurement Policy; the Director, Office of Management and Budget; and
interested congressional committees. We will also make copies available
to others on request. In addition, this report will be available at no
charge on the GAO web site at http://www.gao.gov.
If you have any questions about this report or need additional
information, please call me on (202) 512-4125.
Sincerely yours,
David E. Cooper
Director
Acquisition and Sourcing Management:
Signed by David E. Cooper:
[End of section]
Appendix I: Scope and Methodology:
To identify the extent to which agencies are using performance based
service contracts, we utilized the General Services Administration‘s
(GSA) Federal Procurement Data System (FPDS). The FPDS data set for
fiscal year 2001 provided us with the data necessary to determine the
total dollars obligated by all federal agencies for services. Using
these data, we identified the subset of contracts identified as
performance-based by all federal agencies. In order to determine
whether certain types of services or contract types are more likely to
be designated ’performance-based,“ we stratified the data by Federal
Supply Code and contract type. In addition, we used FPDS‘s third
quarter data for fiscal year 2001 to determine the largest service
procurers among federal agencies. Within this group, as shown in table
4, we identified five agencies that, in terms of dollars obligated,
were among the largest reported users of performance-based service
contracting: the Departments of Energy, the Treasury, and Defense
(Army, Navy, and Air Force), GSA, and the National Aeronautics and
Space Administration (NASA).
In order to determine whether service contracts characterized by
agencies as performance-based contained the attributes necessary to
ensure intended results, we reviewed government regulations and
guidelines regarding the definition and composition of performance-
based service contracting. These sources included the Federal
Acquisition Regulation (FAR), Office of Federal Procurement Policy
guidelines and policy letters, and agency-specific guidance. For
additional insight, we spoke with public policy and acquisition experts
regarding their views on the concept of performance-based service
contracting. We then asked each of the five agencies to provide us with
what they considered to be their best examples of performance-based
service contracts. We selected 20 of these contracts for examination on
the basis of contract type and service provided. In addition, taking
contract type and service provided into account, we randomly selected
five contracts designated as performance-based but not offered by the
agencies to determine if these contracts also contained essential
performance-based attributes. The 25 contracts we reviewed at the five
agencies are shown in table 4.
Table 4: Service Contracts Reviewed:
Dollars in millions: No.: 1; Agency: Army; Dollars
in millions: Contract number: DAMD17-00-C-0034;
Service: Technical and administrative support for a DNA registry,
forensic toxicology lab, pathology center, and museum; Contract type:
Cost;
Maximum contract value: $79.4;
Procured as commercial service: No.
Dollars in millions: No.: 2; Agency: Army; Dollars
in millions: Contract number: DASW01-01-D-0003;
Service: On-line educational services to enable enlisted men and women
to pursue post-secondary degrees and vocational-technical
certificates; Contract type: Fixed price; Dollars
in millions: Maximum contract value: 403.0;
Procured as commercial service: Yes.
Dollars in millions: No.: 3; Agency: Navy; Dollars
in millions: Contract number: N00600-00-D-6048;
Service: Advertising campaign to support the Navy‘s recruitment needs;
Contract type: Fixed price;
Maximum contract value: 330.0; Dollars in
millions: Procured as commercial service: Yes.
Dollars in millions: No.: 4; Agency: Navy; Dollars
in millions: Contract number: Multiple award contract; Dollars in
millions: Service: Engineering, logistics, program management, and
finance support for the Naval Sea Systems Command;
Contract type: Cost; Maximum contract value:
14,500.0; Procured
as commercial service: No.
Dollars in millions: No.: 5; Agency: Navy; Dollars
in millions: Contract number: N00244-99-C-0056[A];
Service: Operating and maintaining tactical test ranges and equipment
at Navy installations; Contract type: Cost;
Maximum contract value: 78.0;
Procured as commercial service: No.
Dollars in millions: No.: 6; Agency: Navy; Dollars
in millions: Contract number: N00244-99-C-0008[A];
Service: Operating and maintaining tactical test ranges and equipment
at Navy installations; Contract type: Cost;
Maximum contract value: 88.4;
Procured as commercial service: No.
Dollars in millions: No.: 7; Agency: Navy; Dollars
in millions: Contract number: N00244-00-C-0121[A];
Service: Operating and maintaining tactical test ranges and equipment
at Navy installations; Contract type: Cost;
Maximum contract value: 1.0;
Procured as commercial service: No.
Dollars in millions: No.: 8; Agency: Air Force;
Contract number: F45613-01-D-A001; Dollars in
millions: Service: Refuse collection and recycling at an Air Force
base; Contract type: Fixed price; Dollars in
millions: Maximum contract value: 3.8;
Procured as commercial service: Yes.
Dollars in millions: No.: 9; Agency: Air Force;
Contract number: F45613-99-D-0007[A]; Dollars in
millions: Service: Maintaining housing at an Air Force base; Dollars in
millions: Contract type: Fixed price; Maximum
contract value: 11.3; Dollars in
millions: Procured as commercial service: No.
Dollars in millions: No.: 10; Agency: Air Force;
Contract number: F45613-01-F-A001; Dollars in
millions: Service: Custodial services at Air Force base; Dollars in
millions: Contract type: Fixed price; Maximum
contract value: 6.2;
Procured as commercial service: No.
Dollars in millions: No.: 11; Agency: DOE; Dollars
in millions: Contract number: W-31-109-ENG-38;
Service: Management and operations of Argonne National Laboratory
(research and development); Contract type: Cost;
Maximum contract value: 3,000.0; Dollars in
millions: Procured as commercial service:
No.
Dollars in millions: No.: 12; Agency: DOE; Dollars
in millions: Contract number: DE-AC09-96SR18500;
Service: Management and operations at Savannah River Site Facility;
Contract type: Cost; Maximum
contract value: 8,400.0; Dollars in
millions: Procured as commercial service: No.
Dollars in millions: No.: 13; Agency: NASA;
Contract number: NAS9-20000;
Service: Operations support for launch and recovery of the space
shuttle; Contract type: Cost;
Maximum contract value: 9,700.0; Dollars
in millions: Procured as commercial service: No.
Dollars in millions: No.: 14; Agency: NASA;
Contract number: NAS9-01069[A]; Dollars in
millions: Service: Avionics systems research & development and
engineering for the space shuttle and the international space station.;
Contract type: Cost; Maximum
contract value: 17.0; Dollars in
millions: Procured as commercial service: No.
Dollars in millions: No.: 15; Agency: NASA;
Contract number: NAS5-99085;
Service: Scientific, engineering, information technology, and
administrative support at NASA‘s Laboratory of Terrestrial Physics;
Contract type: Cost; Maximum
contract value: 43.0; Dollars in
millions: Procured as commercial service: No.
Dollars in millions: No.: 16; Agency: NASA;
Contract number: NAS5-99200;
Service: Contractor oversight to ensure that NASA‘s technical contract
requirements are met; Contract type: Cost; Dollars
in millions: Maximum contract value: 34.3;
Procured as commercial service: No.
Dollars in millions: No.: 17; Agency: NASA;
Contract number: NAS5-01091;
Service: Logistical services for NASA‘s Goddard Space Flight Center,
headquarters, and other locations; Contract type:
Cost; Maximum contract value: 154.0; Dollars in
millions: Procured as commercial service:
No.
Dollars in millions: No.: 18; Agency: GSA/FTS;
Contract number: T0001AJM030;
Service: Information technology support services for the Securities and
Exchange Commission; Contract type: Cost; Dollars
in millions: Maximum contract value: 159.0;
Procured as commercial service: No.
Dollars in millions: No.: 19; Agency: GSA/PBS;
Contract number: GS-09P-99-KSC-0021; Dollars in
millions: Service: Janitorial services at two federal buildings;
Contract type: Fixed price;
Maximum contract value: 1.0; Dollars in
millions: Procured as commercial service: Yes.
Dollars in millions: No.: 20; Agency: GSA/PBS;
Contract number: GS-09P-98-KSD-0018; Dollars in
millions: Service: Recurring maintenance and repair services at two
federal buildings; Contract type: Fixed price;
Maximum contract value: 2.0;
Procured as commercial service: Yes.
Dollars in millions: No.: 21; Agency: GSA/PBS;
Contract number: GS-09P-97-KSC-0017; Dollars in
millions: Service: Systems and equipment operations and maintenance at
federal building; Contract type: Fixed price;
Maximum contract value: 2.0;
Procured as commercial service: Yes.
Dollars in millions: No.: 22; Agency: Treasury;
Contract number: TEP-01-13;
Service: Tour guide services for Bureau of Engraving and Printing;
Contract type: Fixed price;
Maximum contract value: 2.6; Dollars in
millions: Procured as commercial service: Yes.
Dollars in millions: No.: 23; Agency: Treasury;
Contract number: TFTC 00-03;
Service: Food management at Federal Law Enforcement Training Center;
Contract type: Fixed price;
Maximum contract value: 44.1; Dollars in
millions: Procured as commercial service: No.
Dollars in millions: No.: 24; Agency: Treasury;
Contract number: TFTC 01-19;
Service: Dormitory management at Federal Law Enforcement Training
Center; Contract type: Fixed price; Dollars in
millions: Maximum contract value: 3.0;
Procured as commercial service: No.
Dollars in millions: No.: 25; Agency: Treasury;
Contract number: TFTC 02-02;
Service: Fire arms support services for Federal Law Enforcement
Training Center; Contract type: Fixed price;
Maximum contract value: 2.4;
Procured as commercial service: No.
Legend
DNA = deoxyribonucleic acid
DOE = Department of Energy:
[A] Denotes contract randomly selected during site visits.
Source: GAO, based on information provided by the agencies.
[End of table]
In addition to speaking with agency officials at each location, we
spoke with 18 contracting officers and 12 contractors for their
perspectives. We then compared our contract specific findings with the
performance-based attributes with the assumption that a contract
containing these elements would have an increased likelihood of being
’performance-based.“:
We conducted our review from September 2001 to June 2002 in accordance
with generally accepted government auditing standards.
[End of section]
Appendix II: Performance-Based Service Contracting in the Federal
Acquisition Regulation:
The Federal Acquisition Regulation defines performance-based
contracting as structuring all aspects of an acquisition around the
purpose of the work to be performed with the contract requirements set
forth in clear, specific, and objective terms with measurable outcomes
as opposed to either the manner by which the work is to be performed or
broad and imprecise statements of work. The FAR establishes a policy
that agencies use performance-based contracting methods to the maximum
extent practicable for the acquisition of services (with certain
exceptions[Footnote 3]). In prescribing policies and procedures for use
of performance-based contracting methods, the FAR states that such
methods are intended to ensure that required performance quality levels
are achieved and that total payment is related to the degree that
services performed meet contract standards.
The FAR requires performance-based contracts to:
* describe the requirements in terms of results required rather than
the methods of performance of the work:
* use measurable performance standards (i.e. terms of quality,
timeliness, quantity, etc.) and quality assurance surveillance plans:
* specify procedures for reductions of fee or for reductions to the
price of a fixed-price contract when services are not performed or do
not meet contract requirements, and:
* include performance incentives where appropriate.
The FAR further addresses elements of performance-based contracting,
specifically statements of work, quality assurance, and contract type.
The FAR specifies that in preparing statements of work, agencies shall,
to the maximum extent practicable,
* describe the work in terms of ’what“ is to be the required output
rather than either ’how“ the work is to be accomplished or the number
of hours to be provided:
* enable assessment of work performance against measurable performance
standards:
* rely on the use of measurable performance standards and financial
incentives to encourage competitors to develop and institute innovative
and cost-effective methods of performing the work, and:
* avoid combining requirements into a single acquisition that is too
broad for the agency or a prospective contractor to manage effectively.
The FAR requires agencies to develop quality assurance surveillance
plans when acquiring services that recognize the responsibility of the
contractor to carry out its quality control obligations and contain
measurable inspection and acceptance criteria corresponding to the
performance standards contained in the statement of work. The FAR
states that the quality assurance surveillance plans shall focus on the
level of performance required by the statement of work, rather than the
methodology used by the contractor to achieve that level of
performance.
As to contract type, the FAR states that the contract types most likely
to motivate contractors to perform at optimal levels shall be chosen.
The FAR specifies that, to the maximum extent practicable, performance
incentives, either positive or negative or both, shall be incorporated
into the contract to encourage contractors to increase efficiency and
maximize performance. These incentives are required to correspond to
the specific performance standards in the quality assurance
surveillance plan and shall be capable of being measured objectively.
The FAR states that fixed-price contracts are generally appropriate for
services that can be defined objectively and for which the risk of
performance is manageable.[Footnote 4] The FAR has been revised to
implement the statutory preference for agencies to conduct acquisitions
using performance-based service contracting established by section 821
of the Floyd D. Spence National Defense Authorization Act for Fiscal
Year 2001 (P.L. 106-398). Specifically, there is now an order of
precedence for performance-based contracts that are firm, fixed-price,
then any other type of performance-based contract (such as a cost-
reimbursement type), and then any contract that is not performance-
based.[Footnote 5] The FAR further requires that acquisition plans for
service contracts describe the strategies for implementing performance-
based contracting methods or provide a rationale for not using those
methods.
[End of section]
Appendix III: Major Performance-Based Service Contracting Events:
Agencies began to implement performance-based service contracting as
early as 1978. However, implementation was not fully pursued until the
past few years when Congress and the Office of Management and Budget
(OMB) encouraged the use of performance-based service contracting
methods.
* OFPP Pamphlet #4 ’A Guide for Writing and Administering Performance
Statements of Work for Service Contracts“ (1980). Described how to
write performance into statements of work and addressed job analysis,
surveillance plans, and quality control.
* OFPP Policy Letter 91-2 (April 9, 1991). Established policy of
utilizing a performance-based approach to service contracting.
Prescribed policy aimed at correcting material weaknesses with service
contracting. It encouraged agency heads to implement policies and to
initiate any necessary staff training.
* Government Performance and Results Act (1993). Seeks to improve
federal program effectiveness by focusing on results, service quality,
and customer satisfaction.
* OFPP Performance-Based Service Contracting Pledge (October 1994).
Officials from 27 agencies signed pledge to participate in a project to
convert 26 contracts valued at about $585 million using performance-
based service contracting methods and measure effects on volunteered
projects.
* OFPP Performance-Based Service Contracting Checklist Memorandum
(August 1997). Lists minimum required elements that must be present for
an acquisition to be considered performance-based.
* Federal Acquisition Circular 97-01 (October 1997). Amended the
Federal Acquisition Regulation to implement OFPP policy letter 91-2.
FAR parts 7, 16, 37, 42, 46, and 52 were changed to establish in the
FAR the policy of government acquisition of services using performance-
based service contracting methods.
* OFPP Report on Performance-Based Service Contracting Pilot Project
(May 1998). Contract prices decreased by 15 percent after introduction
of performance-based service contracting. Customer satisfaction
improved by over 18 percent.
* OFPP Information on Best Practices for Performance-Based Service
Contracting (October 1998). Assists agencies in developing policies and
procedures for implementing performance-based service contracting.
Practices derived from government and industry.
* Statutory Preference for Performance-Based Service Contracting
(October 2000). Section 821 of the Floyd D. Spence National Defense
Authorization Act for Fiscal Year 2001 (P.L. 106-398) established a
preference for agencies to conduct service acquisitions using
performance-based contracting:
* OMB Memorandum on Performance Goals and Management Initiatives for FY
2002 Budget (March 2001). Goal is to award contracts over $25,000 using
performance-based service contracting techniques for not less than 20
percent of total eligible service contracting dollars.
* Federal Acquisition Circular 97-25 (May 2, 2001). Interim rule
revises the FAR to implement section 821 of the Fiscal Year 2001
Defense Authorization Act establishing a preference for agencies to
conduct service acquisitions using performance-based contracting.
* Federal Acquisition Circular 2001-07 (April 30, 2002). Adopted the
interim FAR rule as a final rule and amended FAR Part 7 (acquisition
planning) to require contracting officers to provide a rationale (in
the written acquisition plan) if performance-based service contracting
is not used.
[End of section]
Appendix IV: GAO Contact and Staff Acknowledgments:
GAO Contact:
Ralph C. Dawn, Jr. (202) 512-4544:
Acknowledgments:
In addition to the person named above, Cristina Chaplain, Odilon Cuero,
Michelle Dresben, Christopher Galvin, Adam Vodraska, William Woods, and
John Yakaitis made key contributions to this report.
[End of section]
FOOTNOTES
[1] Specifically, OMB established greater use of performance-based
contracts as one of several government-wide reforms to be highlighted
by the President for the fiscal year 2002 budget. Under OMB‘s guidance,
if an agency determined that greater use of performance-based contracts
would significantly enhance its operations, the agency was to include a
performance goal in its fiscal year 2002 performance plans as required
by the Government Performance and Results Act. For agencies that set a
goal of making greater use of performance-based service contracts, in
March 2001, OMB created a goal of awarding contracts over $25,000 using
performance-based methods for not less than 20 percent of total
eligible service contracting dollars awarded during fiscal year 2002.
[2] These data are based on information from the Federal Procurement
Data System. Since October 2001, the mandatory format for submitting
data to the system on each contract action exceeding $25,000 includes a
check box to indicate whether performance-based service contracting was
used.
[3] The FAR exempts from this requirement architect-engineer services,
construction, utility services, or services incidental to supply
purchases. The FAR addresses performance-based contracting generally in
subpart 37.6.
[4] A fixed-price contract provides for a firm pricing arrangement
established at the time of contract award. With a firm, fixed-price
contract, the contractor is paid a set price--one that is not adjusted
based on costs incurred while performing the contract.
[5] Generally, with cost-reimbursement contracts, the contractor is
paid based on allowable incurred costs plus a fee.
GAO‘s Mission:
The General Accounting Office, the investigative arm of Congress,
exists to support Congress in meeting its constitutional
responsibilities and to help improve the performance and accountability
of the federal government for the American people. GAO examines the use
of public funds; evaluates federal programs and policies; and provides
analyses, recommendations, and other assistance to help Congress make
informed oversight, policy, and funding decisions. GAO‘s commitment to
good government is reflected in its core values of accountability,
integrity, and reliability.
Obtaining Copies of GAO Reports and Testimony:
The fastest and easiest way to obtain copies of GAO documents at no
cost is through the Internet. GAO‘s Web site ( www.gao.gov ) contains
abstracts and full-text files of current reports and testimony and an
expanding archive of older products. The Web site features a search
engine to help you locate documents using key words and phrases. You
can print these documents in their entirety, including charts and other
graphics.
Each day, GAO issues a list of newly released reports, testimony, and
correspondence. GAO posts this list, known as ’Today‘s Reports,“ on its
Web site daily. The list contains links to the full-text document
files. To have GAO e-mail this list to you every afternoon, go to
www.gao.gov and select ’Subscribe to daily E-mail alert for newly
released products“ under the GAO Reports heading.
Order by Mail or Phone:
The first copy of each printed report is free. Additional copies are $2
each. A check or money order should be made out to the Superintendent
of Documents. GAO also accepts VISA and Mastercard. Orders for 100 or
more copies mailed to a single address are discounted 25 percent.
Orders should be sent to:
U.S. General Accounting Office
441 G Street NW,
Room LM Washington,
D.C. 20548:
To order by Phone:
Voice: (202) 512-6000:
TDD: (202) 512-2537:
Fax: (202) 512-6061:
To Report Fraud, Waste, and Abuse in Federal Programs:
Contact:
Web site: www.gao.gov/fraudnet/fraudnet.htm E-mail: fraudnet@gao.gov
Automated answering system: (800) 424-5454 or (202) 512-7470:
Public Affairs:
Jeff Nelligan, managing director, NelliganJ@gao.gov (202) 512-4800 U.S.
General Accounting Office, 441 G Street NW, Room 7149 Washington, D.C.
20548: