Small Business Administration
Actions Needed to Provide More Timely Disaster Assistance
Gao ID: GAO-06-860 July 28, 2006
Hurricanes Katrina, Rita, and Wilma (the Gulf Coast hurricanes) caused more than $118 billion in estimated property damages across the Gulf Coast region in 2005. The Small Business Administration (SBA) helps individuals and businesses recover from disasters through its Disaster Loan Program. GAO initiated work to determine how well SBA provided victims of the Gulf Coast hurricanes with timely assistance. This report, the first of two, focuses primarily on the Disaster Credit Management System (DCMS) and disaster loan process. Here, GAO evaluates (1) what affected SBA's ability to provide timely disaster assistance and (2) actions SBA took after the disasters to improve its response to disaster victims. In conducting this study, GAO analyzed data on loan applications and assessed key aspects of SBA's acquisition and implementation of DCMS.
Although DCMS provided SBA with a number of benefits, several factors affected SBA's ability to provide timely disaster assistance to victims of the Gulf Coast hurricanes. First, the large volume of applications SBA processed greatly exceeded any previous disaster, including the 1994 Northridge earthquake--the largest single disaster SBA previously faced. Second, SBA primarily used this earthquake as the basis for planning the maximum user capacity for DCMS and did not consider information available from catastrophe risk modeling firms and disaster simulations, such as the likelihood and severity of damages from potential catastrophes, to help predict the expected application volume from such events. SBA's limited planning contributed to insufficient DCMS user capacity, which restricted the number of staff that could access the system and process the large volume of applications in a timely manner. SBA also did not receive the correct computer hardware from its contractor, and the agency did not completely stress test DCMS before implementation, which contributed to the system instability, outages, and slow response times initially experienced by SBA staff. As a result of these and other factors, SBA faced significant delays and backlogs in processing loan applications, as depicted in the figure below. This backlog peaked at more than 204,000 applications 4 months after Hurricane Katrina. As of May 27, 2006, SBA processed applications, on average, in about 74 days compared with its goal of within 21 days. Some of the actions SBA took after the Gulf Coast hurricanes helped to improve its response to disaster victims. For example, SBA addressed system-related issues by increasing the number of users that could access DCMS, and it plans to further increase the system's maximum user capacity. SBA implemented other initiatives that had limited success. For example, SBA made only a few loan guarantees under its Gulf Opportunity Pilot Loan Program for small businesses in communities affected by the disasters. SBA would benefit by expediting its planned business process reengineering efforts to analyze ways to more efficiently process loan applications, such as implementing a secure Internet-based application feature for home loan applicants.
Recommendations
Our recommendations from this work are listed below with a Contact for more information. Status will change from "In process" to "Open," "Closed - implemented," or "Closed - not implemented" based on our follow up work.
Director:
Team:
Phone:
GAO-06-860, Small Business Administration: Actions Needed to Provide More Timely Disaster Assistance
This is the accessible text file for GAO report number GAO-06-860
entitled 'Small Business Administration: Actions Needed to Provide More
Timely Disaster Assistance' which was released on July 28, 2006.
This text file was formatted by the U.S. Government Accountability
Office (GAO) to be accessible to users with visual impairments, as part
of a longer term project to improve GAO products' accessibility. Every
attempt has been made to maintain the structural and data integrity of
the original printed product. Accessibility features, such as text
descriptions of tables, consecutively numbered footnotes placed at the
end of the file, and the text of agency comment letters, are provided
but may not exactly duplicate the presentation or format of the printed
version. The portable document format (PDF) file is an exact electronic
replica of the printed version. We welcome your feedback. Please E-mail
your comments regarding the contents or accessibility features of this
document to Webmaster@gao.gov.
This is a work of the U.S. government and is not subject to copyright
protection in the United States. It may be reproduced and distributed
in its entirety without further permission from GAO. Because this work
may contain copyrighted images or other material, permission from the
copyright holder may be necessary if you wish to reproduce this
material separately.
Report to Congressional Addressees:
July 2006:
Small Business Administration:
Actions Needed to Provide More Timely Disaster Assistance:
GAO-06-860:
GAO Highlights:
Highlights of GAO-06-860, a report to congressional addressees
Why GAO Did This Study:
Hurricanes Katrina, Rita, and Wilma (the Gulf Coast hurricanes) caused
more than $118 billion in estimated property damages across the Gulf
Coast region in 2005. The Small Business Administration (SBA) helps
individuals and businesses recover from disasters through its Disaster
Loan Program. GAO initiated work to determine how well SBA provided
victims of the Gulf Coast hurricanes with timely assistance. This
report, the first of two, focuses primarily on the Disaster Credit
Management System (DCMS) and disaster loan process. Here, GAO evaluates
(1) what affected SBA‘s ability to provide timely disaster assistance
and (2) actions SBA took after the disasters to improve its response to
disaster victims. In conducting this study, GAO analyzed data on loan
applications and assessed key aspects of SBA‘s acquisition and
implementation of DCMS.
What GAO Found:
Although DCMS provided SBA with a number of benefits, several factors
affected SBA‘s ability to provide timely disaster assistance to victims
of the Gulf Coast hurricanes. First, the large volume of applications
SBA processed greatly exceeded any previous disaster, including the
1994 Northridge earthquake”the largest single disaster SBA previously
faced. Second, SBA primarily used this earthquake as the basis for
planning the maximum user capacity for DCMS and did not consider
information available from catastrophe risk modeling firms and disaster
simulations, such as the likelihood and severity of damages from
potential catastrophes, to help predict the expected application volume
from such events. SBA‘s limited planning contributed to insufficient
DCMS user capacity, which restricted the number of staff that could
access the system and process the large volume of applications in a
timely manner. SBA also did not receive the correct computer hardware
from its contractor, and the agency did not completely stress test DCMS
before implementation, which contributed to the system instability,
outages, and slow response times initially experienced by SBA staff. As
a result of these and other factors, SBA faced significant delays and
backlogs in processing loan applications, as depicted in the figure
below. This backlog peaked at more than 204,000 applications 4 months
after Hurricane Katrina. As of May 27, 2006, SBA processed
applications, on average, in about 74 days compared with its goal of
within 21 days.
Some of the actions SBA took after the Gulf Coast hurricanes helped to
improve its response to disaster victims. For example, SBA addressed
system-related issues by increasing the number of users that could
access DCMS, and it plans to further increase the system‘s maximum user
capacity. SBA implemented other initiatives that had limited success.
For example, SBA made only a few loan guarantees under its Gulf
Opportunity Pilot Loan Program for small businesses in communities
affected by the disasters. SBA would benefit by expediting its planned
business process reengineering efforts to analyze ways to more
efficiently process loan applications, such as implementing a secure
Internet-based application feature for home loan applicants.
Figure: Backlog of Applicants in Loss Verification and Application
Processing:
[See PDf for Image]
Source: GAO analysis of SBA data.
[End of Figure]
What GAO Recommends:
GAO recommends four actions including reassessing DCMS‘s maximum user
capacity based on such things as lessons learned from the Gulf Coast
hurricanes, a review of information available from catastrophe risk
modeling firms and disaster simulations, and related cost
considerations. In comments on a draft of this report, SBA generally
agreed with our recommendations but said more credit should have been
given to its improvement efforts.
[Hyperlink, http://www.gao.gov/cgi-bin/getrpt?GAO-06-860].
To view the full product, including the scope and methodology, click on
the link above. For more information, contact William B. Shear at (202)
512-8678 or shearw@gao.gov
[End of Section]
Contents:
Letter:
Results in Brief:
Background:
Large Volume of Applications, Limited Planning, and Various System and
Processing Related Challenges Affected SBA's Ability to Provide Timely
Disaster Assistance:
SBA's Actions after the Gulf Coast Hurricanes Had Varying Degrees of
Success:
Conclusions:
Recommendations for Executive Action:
Agency Comments and Our Evaluation:
Appendixes:
Appendix I: Scope and Methodology:
Appendix II: SBA's Acquisition and Implementation of the Disaster
Credit Management System:
Appendix III: Comments from the Small Business Administration:
Appendix IV: GAO Contact and Staff Acknowledgments:
Tables:
Table 1: Significant U.S. Natural Disasters (1988-2005):
Table 2: SBA Application Statistics for Gulf Coast Hurricanes and
Previous Disasters:
Table 3: Other Changes SBA Made after Gulf Coast Hurricanes That
Improved Response to Disaster Victims:
Table 4: Other Changes SBA Made after Gulf Coast Hurricanes That Had
Limited Success:
Figures:
Figure 1: SBA's Disaster Loan Process:
Figure 2: Number of Disaster Loan Applications Processed and Average
Staffing Levels by Month, September 2005 to May 2006:
Figure 3: FEMA IA Applicants' Current Location by State as of April 10,
2006:
Figure 4: Backlog of Applications in Loss Verification and Application
Processing:
Figure 5: Average Processing Time Frames for Approval and Decline
Decisions, October 2005 to May 2006:
Figure 6: Time Line of DCMS Activities:
Abbreviations:
ALCS: Automated Loan Control System:
COTS: commercial-off-the-shelf:
DAO: Disaster Area Office:
DCMS: Disaster Credit Management System:
FEMA: Federal Emergency Management Agency:
IA: Individual Assistance:
IHP: Individuals and Households Program:
IV&V: Independent Verification and Validation:
IRS: Internal Revenue Service:
ODA: Office of Disaster Assistance:
PDC: Processing and Disbursement Center:
SBA: Small Business Administration:
July 28, 2006:
Congressional Addressees:
In 2005, Hurricanes Katrina, Rita, and Wilma battered the U.S. Gulf
Coast region, causing more than $118 billion in estimated property
damages and over 1,400 deaths.[Footnote 1] As the federal government's
primary lender to victims of disasters, the Small Business
Administration (SBA) provides financial assistance through its Disaster
Loan Program to help homeowners, renters, and businesses of all sizes
recover from disasters such as earthquakes, hurricanes, and terrorist
attacks. In this capacity, SBA plays a crucial role in the long-term
recovery of the Gulf Coast region. Nine months following Hurricane
Katrina, SBA had approved more than 148,700 disaster assistance loans
totaling $9.7 billion to individuals and businesses that suffered
losses from the Gulf Coast hurricanes.[Footnote 2] However, Congress
and press reports have expressed concerns that SBA's response has been
slow, leaving many disaster victims without the timely assistance that
they needed.
In January 2005, SBA began using its new Disaster Credit Management
System (DCMS) to process loan applications for all new disaster
declarations. SBA intended for DCMS to improve the quality and
timeliness of its disaster loan process and enhance its overall
response to disasters compared with SBA's previous system. However,
after the Gulf Coast hurricanes, both press reports and Congress were
critical of DCMS, citing system outages and slow response times as
contributing to delays that disaster victims experienced in receiving
assistance. We have prepared this report under the Comptroller
General's authority to conduct evaluations on his own initiative as
part of a continued effort to assist Congress in reviewing how well SBA
provided victims of the Gulf Coast hurricanes with timely assistance.
In this report, we evaluate: (1) what affected SBA's ability to provide
timely disaster assistance and (2) the actions SBA took after the
disasters to improve its response to disaster victims. This report
focuses primarily on DCMS and the disaster loan process. We plan to
issue a subsequent report that focuses on other factors not related to
DCMS or the disaster loan process that may have affected SBA's ability
to provide timely assistance.[Footnote 3]
In conducting this review, we visited the Gulf Coast region to observe
conditions and meet with federal, state, and local officials and
victims of the disasters. We obtained documents related to SBA's
disaster lending policy and procedures and SBA's acquisition and
implementation of DCMS. We also obtained and analyzed SBA's data on
disaster loan applications processed through May 27, 2006. In addition,
we interviewed officials from SBA's headquarters and its two Field
Operations Centers in California and Georgia, Customer Service Center
in New York, and Processing and Disbursement Center (PDC) in Texas. See
appendix I for a detailed description of our scope and methodology. We
conducted our work between November 2005 and July 2006 in accordance
with generally accepted government auditing standards.
Results in Brief:
We identified several factors that affected SBA's ability to provide
timely disaster assistance to Gulf Coast hurricane victims. The sheer
volume of applications was a significant challenge to SBA. For example,
SBA mailed more than 2.1 million disaster loan applications and
received over 418,000 in return as of May 27, 2006, which greatly
exceeded the volume from any previous disaster, including the 1994
Northridge earthquake--the single largest disaster SBA previously
faced. Although DCMS provided a number of benefits compared with its
previous system and process, such as allowing certain manual tasks to
be performed electronically, SBA's limited planning for the maximum
number of concurrent users in DCMS reduced its ability to provide
timely disaster assistance. Specifically, SBA used the volume of
applications received during the Northridge earthquake and other
historical data as the basis for planning the maximum number of
concurrent users that DCMS could accommodate. SBA did not consider
information available from catastrophe risk modeling firms and disaster
simulations, such as the likelihood and severity of damages from
potential catastrophes, to help predict the expected application volume
from such events and the concurrent user capacity needed to process
expected volumes. Insurance companies and some government agencies use
this information to plan for catastrophic events. SBA's limited
planning contributed to insufficient DCMS user capacity, which
restricted the number of staff that could access the system and process
the large volume of applications in a timely manner. If SBA had
considered information available from catastrophe risk modeling firms
and disaster simulations in planning for DCMS, the agency may have
acquired additional capacity that would have enabled it to reduce its
backlog of applications sooner. In addition, SBA's hosting contractor
provided incorrect computer hardware and ineffective technical support,
which contributed to the initial system instability, outages, and slow
response times SBA staff experienced with DCMS following the Gulf Coast
hurricanes.[Footnote 4] We also found that SBA did not completely
stress test DCMS before implementation. If SBA had conducted complete
stress testing, the agency might have detected that it did not receive
the correct equipment and had an opportunity to address this issue
before implementing the system.[Footnote 5] As a result of these and
other processing-related challenges, SBA developed a large backlog of
applications during the initial months following Hurricane Katrina.
This backlog peaked at more than 204,000 applications 4 months after
Hurricane Katrina. As of May 27, 2006, SBA processed applications on
average in about 74 days, compared with its goal of within 21
days.[Footnote 6]
Some of the actions SBA took to improve its response to disaster
victims after the Gulf Coast hurricanes were more successful than
others. For example, SBA enhanced its ability to provide more timely
disaster assistance by addressing DCMS's instability issues.
Specifically, in October 2005, SBA obtained the computer hardware as
agreed to with its contractor and increased the processing capacity of
the system. By November 2005, SBA added a second work shift for its
loan processing staff to better balance DCMS's workload. In November
2005, SBA also began to utilize DCMS to conduct preprocessing decline
decisions faster for applicants with credit scores that indicated a
high degree of default risk under a pilot program;
this enabled these applicants to be referred to the Federal Emergency
Management Agency (FEMA) for possible grant assistance sooner. SBA
implemented other initiatives with limited success, including the Gulf
Opportunity Pilot Loan Program (GO Loan Program) in November 2005 that
provided an 85 percent guaranty to qualified lenders, such as banks
that made expedited loans available up to $150,000 under the agency's
7(a) loan program to small businesses located in communities affected
by the disasters. Because these lenders could charge interest rates
significantly higher than SBA's disaster loan rates, these loans were
not very attractive to disaster victims, and SBA guaranteed only 222
loans under the program. During the course of our work, we also
identified other potential opportunities to help SBA improve its loan
processing, such as implementing a secure Internet-based application
feature for home loan applications.
To provide more timely assistance to disaster victims in the future,
this report makes four recommendations designed to improve the
efficiency and effectiveness of DCMS and the disaster loan process.
Specifically, we recommend that the Administrator of SBA direct the
Office of Disaster Assistance (ODA) to (1) reassess DCMS's maximum user
capacity and related loan processing resource needs based on such
things as lessons learned from the Gulf Coast hurricanes, a review of
information available from catastrophe risk modeling firms and disaster
simulations, and related cost considerations; (2) improve management
controls over assessing contractor performance through inspections of
equipment purchases for DCMS; (3) conduct complete stress testing to
ensure that DCMS can function at planned for maximum user capacity
levels; and (4) expedite plans to resume business process reengineering
efforts to analyze the disaster loan process and identify ways to more
efficiently process loan applications.
We obtained written comments on a draft of this report from SBA's
Associate Administrator for Disaster Assistance. SBA generally agreed
with our recommendations and said that it intends to improve the
delivery of its program for events of all sizes. However, SBA disagreed
with some of the report findings and conclusions. Specifically, SBA
disagreed with our conclusions that it performed limited planning and
that it would have been better prepared to reduce the backlog of
applications through the use of catastrophe risk models rather than
relying primarily on the Northridge earthquake to establish its
capacity needs. SBA also stated that we did not sufficiently recognize
the improvement it made before and after the Gulf Coast hurricanes.
Further, SBA challenged our finding regarding its expedited approval
process. We continue to believe that catastrophe risk modeling firms
and disaster simulations provide critical information, such as the
likelihood and severity of damages from potential catastrophes that
would have been useful in planning the maximum user capacity of DCMS.
If SBA had considered this information, it may have expanded the
maximum user requirement for DCMS and been better prepared to reduce
the backlog of loan applications more timely. We believe that our
report provides a fair and balanced presentation of SBA's performance
during a difficult period and that our recommendations are aimed at
helping the agency to be more prepared in the event of another large
disaster. The last section of this report provides a complete
assessment of SBA's comments, and its letter is presented in appendix
III.
Background:
The Gulf Coast hurricanes collectively represented the most costly
natural disaster in recent U.S. history. As table 1 shows, the
estimated property damage from these hurricanes exceeded $118 billion,
nearly five times greater than the damage from the 1994 Northridge
earthquake and more than two and one-half times greater than the damage
from the 2004 Florida hurricanes. Hurricane Katrina was the first of
these disasters, causing fatalities and damage in southern Florida in
late August 2005 before striking the northern Gulf Coast region. This
region received the brunt of the storm, including extensive damage and
significant loss of life in Louisiana and Mississippi. Damage from
Hurricane Katrina also extended into the Florida panhandle, Georgia,
and Alabama and covered approximately 90,000 square miles--an area
larger than the size of Great Britain. Hurricane Rita was the next
disaster to strike the Gulf Coast region, making landfall near the
Texas and Louisiana border on September 24, 2005, and causing a wide
swath of damage from eastern Texas to Alabama, flooding some areas in
Louisiana that had already been impacted by Hurricane Katrina about 1
month earlier. Hurricane Wilma was the last of these disasters to
strike the region, making landfall in southern Florida on October 24,
2005, and inflicting widespread damage across the state.
Table 1: Significant U.S. Natural Disasters (1988-2005):
Dollars in billions.
Event: Gulf Coast hurricanes;
Year: 2005;
Property damage: > $118.0[A].
Event: Severe drought/heat wave (central and eastern states);
Year: 1988;
Property damage: 59.3[B].
Event: Florida hurricanes[C];
Year: 2004;
Property damage: > 46.2[B].
Event: Hurricane Andrew;
Year: 1992;
Property damage: 35.0.
Event: Midwest flooding;
Year: 1993;
Property damage: 26.6.
Event: Northridge earthquake;
Year: 1994;
Property damage: 24.9[B].
Event: Hurricane Hugo;
Year: 1989;
Property damage: > 12.9.
Event: Severe drought (eastern, western, and Great Plains states);
Year: 2002;
Property damage: > 10.8.
Event: Severe weather and flooding (southeast and southwest states);
Year: 1995;
Property damage: > 7.3.
Event: Northern Plains flooding;
Year: 1997;
Property damage: 4.4.
Event: Southern California wildfires;
Year: 2003;
Property damage: > 2.6.
Source: National Oceanic and Atmospheric Administration, U.S.
Geological Survey.
Note: Damage amounts are adjusted to 2005 dollars using gross domestic
product price index.
[A] Preliminary estimate.
[B] Estimated damages.
[C] Includes Hurricanes Charley, Frances, Ivan, and Jeanne.
[End of table]
The federal government provides funding and assistance after disasters
through a variety of agencies and programs. Congress created FEMA to
coordinate response and recovery efforts under presidential disaster
declarations. FEMA works with other federal, state, and local agencies
to assist victims after major disasters, and volunteer organizations
such as the American Red Cross also participate in these efforts.
Following a presidential disaster declaration, FEMA will open Disaster
Recovery Centers where disaster victims can meet with representatives,
obtain information about the recovery process, and register for federal
disaster assistance. Victims may also register with FEMA by telephone
or via FEMA's Internet site. FEMA provides housing assistance to
disaster victims through the Individuals and Households Program
(IHP).[Footnote 7] Under the IHP, FEMA can make grants available to
repair or replace housing damaged in a disaster that is not covered by
insurance. However, the IHP is a minimal repair program that is
designed to make the victim's home habitable and functional, not to
restore the home to its predisaster condition. When disaster victims
register for FEMA assistance, they are asked to provide their
approximate household income. If the applicant's income exceeds certain
thresholds, FEMA automatically refers them to SBA's Disaster Loan
Program.[Footnote 8]
SBA's Disaster Loan Program is the primary federal program for funding
long-range recovery for private sector, nonfarm disaster victims and
the only form of SBA assistance not limited to small businesses. The
Small Business Act authorizes SBA to make available the following two
types of disaster loans:
* Physical disaster loans--These loans are for permanent rebuilding and
replacement of uninsured or underinsured disaster-damaged property.
They are available to homeowners, renters, businesses of all sizes and
nonprofit organizations. These loans are intended to repair or replace
the disaster victim's damaged property to its predisaster condition.
* Economic injury disaster loans--These loans provide small businesses
with necessary working capital until normal operations resume after a
disaster declaration. They cover operating expenses the business could
have paid had the disaster not occurred. The act restricts economic
injury disaster loans to small businesses only.
Under a presidential disaster declaration, SBA disaster assistance
staff members secure space within FEMA--established Disaster Recovery
Centers and begin meeting with victims to explain the agency's disaster
loan process, issue loan applications and, if requested, assist victims
in completing applications. Figure 1 illustrates SBA's disaster loan
process.
Figure 1: SBA's Disaster Loan Process:
[See PDF for image]
Source: GAO.
[End of figure]
During the application entry stage, SBA screens all incoming
applications to determine if they are acceptable.[Footnote 9] In
addition, SBA conducts a preliminary financial analysis of home loan
applications to determine whether the applicant's income falls below
the agency's minimum income thresholds or if repayment ability is
evident based on a review of the applicant's gross income and fixed
debts.[Footnote 10] SBA declines home loan applicants that do not meet
its minimum income requirements or demonstrate repayment ability. SBA
also obtains a credit bureau report for business and home loan
applicants, and SBA may decline an applicant based on information
contained in the report. SBA refers to denials made during the
application entry stage as preprocessing declines. SBA intended for
these declines to eliminate delays in notifying applicants about loan
denials. SBA will refer most home loan applicants denied a loan to FEMA
for possible grant assistance under a presidential disaster
declaration.[Footnote 11] After the application entry stage,
applications move to the loss verification stage, and SBA staff members
scan application documents into DCMS.[Footnote 12]
During the loss verification stage, loss verifiers conduct on-site
damage inspections for physical disaster loan applications to estimate
the cost of restoring damaged property to predisaster condition. Loss
verifiers use tablet personal computers with software tailored to
complete and submit reports electronically into DCMS. The verified loss
becomes the basis for the loan amount. Once the loss verification is
complete, an application moves to the application processing stage,
where loan officers check for duplication of benefits and assess the
applicant's credit history and ability to obtain credit
elsewhere.[Footnote 13] Loan officers also examine other applicant
eligibility criteria, including compliance with child support
obligations and history on other federal debt, such as student loans.
Loan officers use a financial analysis tool within DCMS to determine if
the applicant has the ability to repay the loan. As with preprocessing
declines, SBA generally refers home loan applicants denied a loan in
application processing to FEMA for possible grant assistance under
presidential disaster declarations.
For secured loans, legal staff members review the draft loan
authorization and agreement for sufficiency of collateral instruments
and other legal concerns.[Footnote 14] They also create a loan closing
checklist--a list of the requirements necessary to generate the loan
closing and other legal documents. Attorneys enter a legal concurrence
into DCMS, which obligates the loan funds through an interface with
SBA's accounting system. Legal support staff members prepare closing
documents and mail them to the applicant or nearest Disaster Recovery
Center. SBA can make a maximum initial disbursement, without
collateral, of up to $10,000 for physical disaster loans and $5,000 for
economic injury disaster loans, once the agency receives signed closing
documents from the applicant. SBA can make a maximum initial
disbursement of up to $25,000 for physical disaster loans with
collateral--preferably real estate.[Footnote 15] SBA generally makes
subsequent disbursements on physical disaster loans based on the
applicant's needs and how they spent prior disbursements.
DCMS replaced SBA's largely manual, paper-based loan process and its
Automated Loan Control System (ALCS), which it had used since the early
1990s. ALCS enabled SBA to track the movement of paper loan application
files from one stage of the process to another, but the manual loan
process required the movement and storage of large volumes of paper. In
December 1998, SBA began planning for a replacement disaster loan
system. SBA purchased a commercial-off-the-shelf package as the
foundation for DCMS in 2003 and had the package customized. SBA
intended for DCMS to help it move toward a paperless processing
environment by automating many of the functions staff members had
performed manually, such as obtaining FEMA referral data and credit
bureau reports, as well as completing and submitting loss verification
reports from remote locations. SBA began a phased implementation of
DCMS in November 2004 at its former Niagara Falls Disaster Area Office
(DAO).[Footnote 16] In January 2005, SBA began using DCMS to process
loan applications for all new disaster declarations and by March 2006,
SBA completed the migration of all data for disaster loan applications
processed since 2000 from ALCS to DCMS. According to SBA, the cost for
planning, acquiring, implementing, and operating DCMS totaled about $32
million through April 2006. See appendix II for a more detailed
discussion of SBA's acquisition and implementation of DCMS.
Large Volume of Applications, Limited Planning, and Various System and
Processing Related Challenges Affected SBA's Ability to Provide Timely
Disaster Assistance:
We identified several factors that affected SBA's ability to provide
timely disaster assistance, including a large volume of applications
that exceeded any previous disaster. In addition, although DCMS allowed
SBA to streamline the disaster loan process, SBA focused only on its
historical experience and did not consider the possibility of a single
or series of disasters of the magnitude of the Gulf Coast hurricanes
when planning the system's maximum user requirements. SBA's limited
planning contributed to insufficient DCMS user capacity, which
restricted the number of staff that could access the system and process
the large volume of applications in a timely manner. Further, SBA did
not completely stress test DCMS before implementation to help ensure
that it could function at its maximum user capacity and thus did not
detect that the wrong processors had been installed by its hosting
contractor and that the system could not support planned capacity. As a
result of these and other processing-related factors, SBA experienced
significant backlogs and delays in processing applications. Overall,
SBA processed disaster loan applications in 74 days, on average, as of
May 27, 2006, compared with its goal of within 21 days.
Large Volume of Loan Applications Affected SBA's Response to Hurricane
Victims:
According to SBA officials, the large volume of disaster loan
applications it processed for victims of the Gulf Coast hurricanes was
a significant challenge. The volume of applications associated with
these hurricanes greatly exceeded any disaster in SBA's history. As
table 2 shows, as of May 27, 2006, SBA had issued more than 2.1 million
applications to victims affected by the Gulf Coast hurricanes. This
represented almost four times as many applications as SBA issued to
victims of the Northridge earthquake--the single largest disaster SBA
had previously faced. In addition, our analysis showed that SBA
received a large influx of applications during the initial months
following Hurricane Katrina--at the same time that SBA hired and
trained a large number of temporary staff to process applications
received from victims of the disasters. Specifically, SBA received
about 280,000 applications during the first 3 months following
Hurricane Katrina, approximately 30,000 more applications than SBA
received over a period of about 1 year from victims of the Northridge
earthquake.
Table 2: SBA Application Statistics for Gulf Coast Hurricanes and
Previous Disasters:
Event: Gulf Coast hurricanes[B];
Applications issued: 2,152,793;
Applications received[A]: 418,157.
Event: Florida hurricanes[C] (2004);
Applications issued: 869,577;
Applications received[A]: 179,025.
Event: Northridge, California earthquake (1994);
Applications issued: 566,260;
Applications received[A]: 250,402.
Event: Hurricane Andrew, Florida (1992);
Applications issued: 110,539;
Applications received[A]: 40,568.
Event: Upper Midwest floods (1997);
Applications issued: 46,968;
Applications received[A]: 18,752.
Event: September 11 terrorist attacks (2001);
Applications issued: 66,893;
Applications received[A]: 25,825.
Source: SBA.
Note: According to SBA officials, in 1996, the agency implemented a
combined application for business physical disaster and economic injury
disaster loan applications from the same applicant. The number of
applications issued and received for Hurricane Andrew and the
Northridge earthquake has not been adjusted to reflect this change.
[A] Represents applications accepted into DCMS. According to SBA, these
numbers exclude applications that SBA declined during the application
entry stage where the applicant did not meet the agency's minimum
income thresholds or demonstrate repayment ability.
[B] Statistics for Hurricanes Katrina, Rita, and Wilma as of May 27,
2006.
[C] Includes Hurricanes Charley, Frances, Ivan, and Jeanne.
[End of table]
SBA officials told us that the large volume of applications that it
mailed and received resulted in part from the large number of referrals
FEMA made to SBA's Disaster Loan Program without applying SBA's income
thresholds, specifically for disaster victims who registered for
disaster assistance via FEMA's Internet site and did not report any
income. According to a FEMA official, disaster victims who register via
FEMA's Internet site can select the "Income Unavailable/Refused" option
if they do not wish to or cannot provide their income. The official
stated that these individuals are advised that selecting this option
will result in an SBA referral. The FEMA official also stated that, per
an SBA request, FEMA refers all applicants who claim self-employment as
their primary source of income to SBA's Disaster Loan Program,
regardless of their income, because the income tests are not a valid
measure of repayment ability for self-employed applicants. In both
cases, FEMA's registration system automatically fills $0 as the
disaster victim's income and refers these individuals to SBA's Disaster
Loan Program. The FEMA official stated that about 17 percent of the
individuals referred to SBA for Hurricanes Katrina and Rita refused to
provide their income, and another 17 percent indicated that they were
self-employed. SBA officials referred to these cases as "$0 income"
referrals.
In February 2006, SBA's Office of Inspector General issued an advisory
memorandum, stating that many $0 income referrals ultimately failed
SBA's criteria for disaster loan eligibility and were processed as
declines.[Footnote 17] SBA's Office of Inspector General added that
these referrals impacted SBA by:
* increasing the cost incurred by SBA in mailing loan applications to
disaster victims that normally would not be referred to SBA's Disaster
Loan Program;
* delaying response times for those applicants who did qualify for
SBA's Disaster Loan Program;
* lowering SBA's disaster loan approval rates;
and:
* increasing the transaction flow through DCMS, which was near maximum
capacity.
SBA's Office of Inspector General recommended that SBA improve its
screening processes within DCMS when processing $0 income referrals and
work with FEMA to reduce unnecessary online disaster referrals. In
commenting on a draft of the advisory memorandum, SBA agreed that it
should work with FEMA to improve their joint screening process prior to
referral and issuing an SBA disaster loan application.
Limited Planning for DCMS User Capacity Reduced SBA's Ability to
Provide Timely Disaster Assistance:
DCMS provided SBA with a number of benefits compared with its previous
system, such as the capability to complete loss verification reports
and other processing-related tasks electronically. However, SBA planned
DCMS's maximum user capacity based solely on the volume of applications
it received from victims of the Northridge earthquake and its other
historical data; it did not consider the information available from
catastrophe risk modeling firms or disaster simulations such as the
likelihood and severity of damages from potential catastrophes.
Although agencies are not specifically required to consider such
information in developing their system's user capacity requirements,
this information could have helped SBA predict the volume of loan
applications to expect and the necessary user capacity needed to
process such a volume. SBA officials acknowledged that they could have
considered this information in planning DCMS's user capacity
requirements but lacked the funding to do so. SBA's limited planning
and other system and processing related issues diminished the agency's
ability to provide disaster assistance in a timely manner.
Many insurance companies and government agencies currently use computer
programs offered by several modeling firms to estimate the financial
consequences of various natural catastrophe scenarios. Risk modeling
firms, which have existed since the late 1980s, rely on sophisticated
mathematical modeling techniques and large databases containing
information on past catastrophes, population densities, construction
techniques, and other relevant information to assess the severity of
potential catastrophes so that other organizations can plan
accordingly. For example, one modeling firm recently estimated that 1.5
million people were vulnerable to an earthquake on the San Andreas
Fault in the San Francisco area and that an earthquake similar to the
1906 earthquake would cause an estimated $260 billion in damages to
residential and commercial properties. This study also noted that the
U.S. Geological Survey estimated that there was a 21 percent
probability of a major earthquake on this fault occurring before
2032.[Footnote 18] Another modeling firm study of a strong hurricane
striking the densely populated Northeast region estimated this event
could cause more than $200 billion in economic losses, including
significant damage from flooding to properties and infrastructure in
lower Manhattan and Long Island.[Footnote 19] While SBA would not
utilize this information the way insurance companies do to assess the
financial consequences of potential disasters, catastrophe risk
modeling firms provide important information on the severity of damages
from such events. This information could be helpful in estimating the
potential number of loan applications that SBA could receive for
processing and the concurrent user capacity necessary to process such
applications in a timely manner if such an event were to occur.
Government agencies and other organizations also participate in
disaster simulation exercises to prepare for their response to natural
disasters. While SBA would not use this disaster simulation information
to plan a response to victims' immediate needs, the estimated number of
buildings damaged and number of people evacuated provides important
information that can be considered in planning the user capacity of a
disaster loan system. For example, FEMA brought together numerous
officials from local, state, federal, and volunteer organizations to
conduct an exercise referred to as Hurricane Pam in July 2004. This
exercise used realistic weather and damage information developed by the
National Weather Service, the U.S. Army Corps of Engineers, the
Louisiana State University Hurricane Center, and other state and
federal agencies to help officials develop joint response plans for a
catastrophic hurricane in Louisiana. This fictional hurricane brought
sustained winds of 120 miles per hour, up to 20 inches of rain in parts
of southeast Louisiana, and storm surge that topped levees in the New
Orleans area. Hurricane Pam, as projected, destroyed between 500,000
and 600,000 buildings and forced the evacuation of more than 1 million
residents from the New Orleans area.
In planning the maximum user capacity for DCMS, SBA relied solely on
the volume of applications it received from victims of the Northridge
earthquake and its other historical data, such as the average number of
applications processed for the previous 5 years. SBA did not plan for
the likelihood of a single disaster or series of disasters of the
magnitude of the Gulf Coast hurricanes. If SBA had considered the
information available from catastrophe risk modeling firms or disaster
simulations, such as the likelihood and potential damages from
catastrophic events, to help it predict the volume of loan applications
that might be expected and the user capacity needed to process this
volume, the agency may have acquired additional capacity that would
have enabled it to reduce its backlog of applications sooner. SBA's
limited planning contributed to insufficient DCMS user capacity, which
restricted the number of staff that could access the system and process
the large volume of applications in a timely manner.
Ineffective Technical Support Affected the Stability of DCMS and SBA's
Ability to Provide Timely Disaster Assistance:
SBA experienced instability with DCMS during the initial months
following Hurricane Katrina, as users experienced outages, difficulties
connecting to the system, and slow response times in completing loan
processing tasks. For example, our review of DCMS system logs showed
that between September and December 2005 SBA experienced the following
incidents:
* 19 incidents where DCMS was not available to all system users due to
an unscheduled outage, and:
* 26 incidents where DCMS was not available to various units due to an
unscheduled outage.
SBA officials told us that the longest period of time DCMS was
unavailable to users due to an unscheduled outage was 1 business day.
These unscheduled outages and other system-related issues slowed
productivity and affected SBA's ability to provide timely disaster
assistance; however, we could not determine the specific impact on the
agency's time frames for processing disaster loan applications received
from Gulf Coast hurricane victims.
According to SBA officials, ineffective technical support contributed
to the system instability experienced by users, as its hosting
contractor did not properly monitor the DCMS network as contractually
required and did not make the agency aware of incidents that could make
the system unstable prior to DCMS users being affected. In addition,
SBA officials told us that its hosting contractor did not provide the
agency with the correct computer hardware for DCMS as contractually
required, which further contributed to the instability users initially
experienced with the system and reduced processing power by about one-
third. Specifically, in developing DCMS, SBA planned for a maximum
capacity of 1,500 concurrent users. SBA officials told us that they
discovered that DCMS was operating near 100 percent capacity in
September 2005 before the agency had reached its maximum user capacity.
At that time, SBA discovered that the hosting contractor had not
provided the agency with the correct computer hardware required per its
contract in order to support 1,500 concurrent users.
However, SBA did not verify that its hosting contractor provided the
agency with the correct computer hardware specified in its contract.
Federal procurement policies require agencies to have trained and
experienced officials available to judge whether contractors are
performing according to contract terms and conditions, particularly
when contracting for highly specialized or technical services.[Footnote
20] In addition, SBA's internal procurement procedures require that the
agency inspect each item or service provided under a contract, report
capital equipment acquisitions immediately--including computer
equipment, and provide a serial number for capital equipment
acquisitions for tracking purposes. SBA officials did not have an
explanation for why the agency did not verify that the hosting
contractor provided the correct computer hardware. If SBA had verified
this equipment as required, the agency might have discovered this issue
prior to the Gulf Coast hurricanes and been able to take the
appropriate corrective action.
SBA Did Not Completely Stress Test DCMS to Ensure It Could Function at
Maximum Capacity:
Prior to implementation, SBA did not completely stress test DCMS to
ensure that the system could operate effectively at maximum capacity,
which contributed to the initial system instability SBA experienced. In
2003, SBA began testing various aspects of DCMS, including the core
application interfaces and additional components such as loss
verification and scanning. Although SBA conducted performance testing
for DCMS, we found that the agency only stress tested the system for up
to 120 concurrent users due to limitations with the hardware in the
testing environment. The testing environment simulated an increasing
number of concurrent users and exercised different functional
scenarios, but the hardware used in the simulation reached its capacity
earlier than anticipated. Even if the testing environment functioned as
planned, an estimate showed that DCMS could accommodate approximately
600 concurrent users at this time--significantly less than the system's
planned maximum capacity of 1,500.
According to leading information technology organizations, to be
effective, practices for testing software should be planned and
conducted in a structured and disciplined environment.[Footnote 21]
Typically, this involves testing increasingly larger increments of a
system until the complete system and all of its functionality are
tested and accepted. It also involves stress testing and fully
demonstrating the effectiveness and accuracy of the system.
Additionally, SBA's internal systems development manual requires that
the agency determine testing and acceptance criteria that must be met
for a system to be accepted as "fit for use" by the user or sponsoring
organization and requires user or sponsoring organization approval of
all acceptance criteria. Further, the manual identifies how acceptance
testing is to be conducted and reported to determine whether the system
meets its requirements upon completion of its development. In doing
limited stress testing of DCMS, SBA did not completely follow its own
requirements or industry best practices for systems testing. When these
requirements are not met, there is potential risk that the implemented
system will not meet the system requirements. If SBA had conducted
complete stress testing, the agency might have detected that it did not
receive the correct equipment and had an opportunity to address this
issue before implementing DCMS.
Other Processing Related Challenges Affected SBA's Ability to Provide
Timely Disaster Assistance:
Because of the unpredictable nature of disasters and the cost of
maintaining staff that it might not need, SBA hires and trains a large
number of temporary staff to help process loan applications following
any large scale disaster, such as the Gulf Coast hurricanes. SBA also
has a disaster reserve corps, a group of experienced individuals it
relies upon who have worked with the agency in responding to previous
disasters and are trained in its disaster loan process. SBA officials
told us that it generally took approximately 30 days for loan officers
without prior SBA experience to become fully productive. This slows
processing during the initial months following a disaster, as loan
officers become familiar with SBA's disaster loan process and DCMS. In
response to the Gulf Coast hurricanes, SBA also had to secure
additional space and equipment to support loan processing. According to
SBA officials, this process took approximately 30 to 60 days. As figure
2 shows, as the average number of loan processing staff increased, SBA
generally processed more applications than it did during the first 2
months following Hurricane Katrina.
Figure 2: Number of Disaster Loan Applications Processed and Average
Staffing Levels by Month, September 2005 to May 2006:
[See PDF for image]
Source: GAO analysis of SBA data.
[End of figure]
Because SBA normally relies on temporary staff to help process loan
applications after large disasters, it might be unrealistic to expect
the agency to process a large volume of applications quickly during the
initial period following such disasters.
The geographic dispersion of disaster victims--in particular for
Hurricanes Katrina and Rita--also affected SBA's ability to provide
timely disaster assistance. Figure 3 illustrates the location of
displaced applicants affected by these disasters that registered for
FEMA IA. These applicants relocated to all 50 states, with the largest
concentrations in Louisiana, Mississippi, and Texas. SBA officials told
us that FEMA referred many of these applicants to its Disaster Loan
Program, and their widespread geographic dispersion made it more
challenging to provide timely disaster assistance. Loan officers we met
with also told us that contacting applicants to discuss the status of
their loan application was difficult in some cases--particularly during
the initial months following the disasters, as some applicants had
moved or changed employment several times since applying for disaster
assistance. Thus, SBA did not always have an applicant's most current
information, which slowed the processing of their application.
Figure 3: FEMA IA Applicants' Current Location by State as of April 10,
2006:
[See PDF for image]
Source: Copyright Corel Corp. All rights reserved (map) and FEMA
(data).
[End of figure]
Note: These are applicants that registered for Hurricanes Katrina and
Rita only.
As a Result of These Factors, SBA Did Not Significantly Reduce Its
Backlog of Applications until Several Months after Hurricane Katrina:
Our analysis showed that it took SBA several months to significantly
reduce the backlog of applications that developed in various stages of
its disaster loan process because of the large volume of applications,
limited planning for DCMS, and other processing-related challenges. For
example, SBA did not clear the backlog in the application entry stage
until nearly 3 months following Hurricane Katrina. SBA nearly cleared
the backlog in the loss verification stage 8 months after the disaster
when the backlog was reduced to less than 1,800 applications. However,
at that time, SBA still needed to complete loan processing for about
25,000 applications.
As figure 4 shows, SBA's backlog in the loss verification and
application processing stages increased significantly during the first
3 months following Hurricane Katrina as SBA began receiving a large
volume of applications from victims of the other hurricanes. These
backlogs combined peaked at over 204,000 applications in late December
2005. Figure 4 also shows that, individually, SBA's backlog in the loss
verification stage peaked at almost 129,200 applications about 3 months
following Hurricane Katrina, and the backlog in the application
processing stage peaked at more than 121,700 applications nearly 6
months after the disaster. As a result of the backlogs, victims of the
Gulf Coast hurricanes waited about 74 days on average for SBA to
process their loan applications, compared with the agency's goal of
within 21 days.
Figure 4: Backlog of Applications in Loss Verification and Application
Processing:
[See PDF for image]
Source: GAO analysis of SBA data.
[End of figure]
Figure 5 shows SBA's average processing time frames for approval and
decline decisions made between mid-October 2005 and May 2006 compared
with its goal of within 21 days. Although SBA began to reduce the total
backlog in loss verification and application processing in late
December 2005, average processing time frames for approval and decline
decisions generally increased through May 2006 because of the average
age of applications in the backlog. For example, SBA reduced the
backlog in application processing to less than 4,500 by late May 2006;
however, average processing time frames were still significantly higher
than its goal because loan applications had been in the application
processing queue for a long time--about 63 days on average.
Figure 5: Average Processing Time Frames for Approval and Decline
Decisions, October 2005 to May 2006:
[See PDF for image]
Source: GAO analysis of SBA data for 2005 Gulf Coast hurricanes.
[End of figure]
SBA's processing average for approvals does not include additional time
frames for loan closings and initial disbursements. For example, SBA
received signed closing documents from borrowers about 35 days, on
average, after making the approval, as of May 27, 2006. According to
SBA officials, delays in closing loans were mostly the result of
factors beyond their control. For example, SBA officials stated that
they scheduled loan closings at the convenience of the borrower. These
officials added that because of the displacement of Gulf Coast
hurricane victims, SBA had closed about 50 percent of disaster loans by
mail, a higher percentage than previous disasters, which generally
takes more time than closings done in person. SBA officials also stated
that there were a significant number of disaster victims who had not
returned to the affected area and who had expressed uncertainty about
rebuilding their homes and businesses. As a result, these victims had
been reluctant to quickly close on their loans. SBA's disaster lending
procedures generally require applicants to close loans within 60 days
of the date on the loan authorization and agreement. These procedures
also allow SBA to accept loan closing documents after 60 days on a
discretionary basis. SBA officials told us they had allowed Gulf Coast
hurricane victims additional time to determine if they really wanted
the loan. To facilitate loan closings, SBA officials also told us they
used staff to conduct follow-up calls with borrowers after closing
documents were mailed.
In addition, our analysis of an SBA data extract further showed that
the agency made an initial disbursement for approved loans on average
about 9 days after the receipt of closing documents. As of May 27,
2006--9 months after Hurricane Katrina--SBA had disbursed about $1.4
billion or 14 percent of the $9.7 billion approved loan dollars. As of
the same date, about 73,000 approved loans had not been fully disbursed
to disaster victims. As with loan closings, SBA officials stated that
the length of time it took to disburse disaster loans was primarily
determined by the borrower. SBA's disaster lending procedures require
borrowers to arrange for and obtain all loan funds within 12 months
from the date of the loan agreement. However, SBA officials told us
that it might be difficult for some disaster victims to meet this
requirement. In our subsequent report on SBA's response to the Gulf
Coast hurricanes, we plan to discuss the perspectives of disaster
victims related to the disaster loan process.
SBA's Actions after the Gulf Coast Hurricanes Had Varying Degrees of
Success:
Although SBA took several actions after the Gulf Coast hurricanes to
improve its response to disaster victims, our analysis showed that some
of these actions were more successful at reducing the backlog of loan
applications than others. For example, SBA increased the number of
concurrent users that could access DCMS by acquiring additional
computer hardware and adding a second work shift for loan processing
staff to better balance the system's workload. In addition, SBA
initiatives to relax filing requirements for applicants whose business
records were destroyed and establish a satellite office to process
disaster loans at its former Sacramento DAO allowed SBA to improve its
response to disaster victims. However, SBA did not experience as much
success with its initiatives to expedite small business financing to
communities affected by the disasters and use private sector banks to
process disaster loan applications. As a result, some of SBA's
initiatives did not significantly reduce the backlog of loan
applications or the time victims waited for SBA to process their
disaster loan applications.
SBA Took Actions to Address DCMS Instability and Other System-Related
Issues:
As previously discussed, SBA initially experienced instability and
other issues with DCMS. However, the agency took actions to address
these issues. In October 2005, SBA obtained the computer hardware, as
agreed to with its contractor, that increased DCMS's capacity to about
2,000 concurrent users. SBA also obtained additional support from its
hosting contractor, at no additional cost, to ensure adequate
monitoring of the DCMS network. By November 2005, because DCMS
continued to operate near its maximum capacity, SBA added a second
shift for loan processing staff at its Fort Worth processing facility
to better balance DCMS's workload. According to SBA officials, DCMS had
been stable since January 2006, and users reported having a greater
comfort level and more success in processing applications using the
system. The officials added that the hosting contractor had provided
better oversight over DCMS compared with the initial months following
Hurricane Katrina. In April 2006, SBA officials advised us that the
agency had not made any payments to its hosting contractor since August
2005 because it did not satisfy contract requirements, and negotiations
were under way to determine the amount of any subsequent payments.
In preparation for the 2006 hurricane season, SBA awarded a new
contract in April 2006 for up to $54 million to its integration
contractor to provide project management and information technology
support for DCMS over the next 5 years. This contractor will continue
to upgrade the system to support increased loan processing activity by
implementing software changes and hardware upgrades, providing ongoing
support to DCMS users, and supporting all information technology
operations associated with the system under the contract. In addition,
SBA has plans to increase DCMS's maximum user capacity to at least
8,000 concurrent users by the summer of 2006. However, we could not
determine how SBA selected this number or whether the agency considered
the information available from catastrophe risk modeling firms or
disaster simulations in determining the planned for increase in maximum
user capacity. To facilitate this planned capacity increase, SBA added
on to and extended the contract with its hosting contractor in February
2006. Although SBA had experienced problems with the initial oversight
provided by this hosting contractor, according to agency officials, the
contractor's performance had improved. For example, the contractor had
dedicated a project manager to this effort. Because of these
improvements and the contractor's familiarity with SBA's needs, agency
officials decided that the contractor could provide a hardware solution
for the expanded capacity within the agency's time frames.
SBA's Processing Changes and Other Initiatives Had Varied Success:
After the Gulf Coast hurricanes, SBA made several changes to its
disaster loan process and implemented other initiatives intended to
improve its response to victims. While some of these initiatives
improved SBA's ability to process large numbers of disaster loan
applications, others did not. For example, in October 2005, SBA
established a satellite office to process disaster loans at its former
Sacramento DAO.[Footnote 22] SBA increased the number of loan
processing staff in this Sacramento satellite office from approximately
40 in late August 2005 to more than 250 by February 2006. According to
SBA, 8 months after Hurricane Katrina, the Sacramento satellite office
had processed about 95,500 home and 4,800 business applications through
DCMS for Gulf Coast hurricane victims.[Footnote 23] Table 3 describes
other SBA changes or initiatives that improved its response to disaster
victims by making the application process easier or referring some
applicants to FEMA for grant assistance sooner.
Table 3: Other Changes SBA Made after Gulf Coast Hurricanes That
Improved Response to Disaster Victims:
Name: Revised filing requirements for business applications[A];
Date: October 2005;
Description: Reduced filing requirements for all business applicants,
such as tax returns for past three years and monthly sales analysis
because these records may have been destroyed. This initiative enabled
victims to file their applications sooner.
Name: Alternate loss verification methods;
Date: October 2005;
Description: Authorized loss verification staff to perform
verifications for home loan applicants using third party documentation
in certain areas and to verify property damages without the applicant
being present in certain cases.
Name: Revised preprocessing decline procedures;
Date: November 2005;
Description: Used DCMS to automatically decline applicants with credit
scores indicating a high degree of default risk to refer applicants to
FEMA for possible grant assistance sooner than the normal process.
Source: GAO analysis of SBA data.
[A] Change made for Hurricanes Katrina and Rita only.
[End of table]
In contrast to these actions, SBA implemented other initiatives that
had more limited success. For example, in November 2005, SBA
implemented the GO Loan Program. SBA intended for this program to
expedite small business financing for communities severely impacted by
Hurricanes Katrina and Rita. This program provided an 85 percent
guaranty to qualified lending partners, such as banks, that agreed to
make expedited loans available under the agency's 7(a) loan program up
to $150,000 to small businesses located in communities affected by the
disasters. Under the GO Loan Program, small businesses applied directly
to qualified lenders, who evaluated their creditworthiness and
determined if they required an SBA guaranty to make the loan. SBA
agreed to make a decision on whether to apply a guaranty to the loan
within 24 hours. While SBA prescribed the maximum interest rate lenders
could charge, the lender and borrower negotiated the actual rate. For
loans of $50,000 or less, lenders could charge a maximum interest rate
of 6.5 percentage points over the prime rate and a maximum rate of 4.5
percentage points over the prime rate for loans over $50,000. Thus,
lenders could charge disaster victims interest rates that were
significantly higher under the GO Loan Program than the rates SBA
charged under the Disaster Loan Program. For example, a disaster victim
applying for a $60,000 GO Loan could have been charged an interest rate
up to 11.5 percent in November 2005 when the prime rate was 7 percent.
In contrast, a business owner not able to obtain credit elsewhere would
have received a 4 percent rate under the Disaster Loan Program. SBA
only guaranteed 222 GO Loans totaling $19 million through May 2006. The
higher interest rates lenders could charge under the GO Loan Program
made these loans less attractive than SBA disaster loans and likely
contributed to the small number of loans made under the program.
In December 2005, SBA implemented a pilot program to expedite the
processing of disaster loan applications. Under this program, DCMS made
automatic approval recommendations for applicants with credit scores
indicating that they were less likely to default on a loan, and loan
officers did not have to conduct the lengthy repayment analysis for
these applications. According to SBA, loan officers processed 8 to 10
home loan applications per day, on average, under the pilot program--
about twice as many applications as under the normal process. However,
loan officers did not review DCMS-generated approval recommendations
until after the loss verification stage under the program. In addition,
when SBA implemented the pilot program, the agency faced a significant
backlog of 115,000 applications in the loss verification stage, and
these applications had been in the queue for 39 days on
average.[Footnote 24] As a result, SBA's data showed that the agency
actually took longer to process expedited approvals compared with SBA's
average processing time frames for all approvals. Specifically, SBA
processed expedited approvals in about 104 days on average between
December 2005 and April 2006, compared with 94 days for all approvals
processed through the end of April 2006. If SBA had implemented this
initiative sooner when the backlog in loss verification was not so
large or if the agency had implemented an expedited loss verification
process for these applications, the pilot program may have been more
effective in reducing the amount of time disaster victims waited for a
decision on their application. Table 4 describes other SBA actions or
initiatives that did not significantly reduce the backlog of loan
applications because they were either not implemented in a timely
manner or did not fully incorporate the use of DCMS to process
applications.
Table 4: Other Changes SBA Made after Gulf Coast Hurricanes That Had
Limited Success:
Name: Give a Lending Hand Initiative;
Date: November 2005;
Description: Requested volunteers from the business lending community
to help process business disaster loan applications. SBA hired only 14
individuals under the initiative.
Name: District office processing of disaster home loan applications;
Date: January 2006;
Description: Used district office staff to manually process home loan
applications using paper copies of the loan applications. This was a
labor and time intensive process because district office staff did not
have access to DCMS, and SBA's Fort Worth PDC staff had to compile and
ship files, make corrections to files returned, and input completed
decisions into DCMS.
Name: Presolicitation notice for loss verification services[A];
Date: January 2006;
Description: Issued a presolicitation notice for contractors to perform
loss verifications nearly 5 months after Hurricane Katrina. SBA decided
not to issue a solicitation because the agency had significantly
reduced the backlog of applications in loss verification by February
2006.
Name: Disaster Loan Partners;
Date: February 2006;
Description: Solicited proposals from local banks and other entities to
process disaster loan applications. Similar proposal made by private
sector banking association in October 2005. According to SBA, the
agency decided to make three separate awards but received requests for
debriefings from several unsuccessful entities. SBA determined it could
not move forward on awarding specific task orders under the initiative
until the agency conducted the debriefings, and the protests were
resolved.
Source: GAO analysis of SBA data.
[A] Change made for Hurricanes Katrina and Rita only.
[End of table]
SBA May Be Able to Process Applications More Efficiently:
DCMS provided SBA with opportunities to help the agency move toward a
paperless processing environment by automating many of the functions
the agency previously performed manually, such as obtaining FEMA
referral data and credit bureau reports as well as completing and
submitting loss verification reports from remote locations. SBA
officials also told us that DCMS improved its ability to process
disaster loans, and the agency would have experienced even greater
processing delays using its previous system and loan process. However,
we found other potential opportunities during our review that might
help SBA to process loans more efficiently and move closer to its goal
of processing loan applications within 21 days when faced with
disasters.
For example, SBA may be able to increase the efficiency of its
application entry process by implementing a secure Internet-based
application feature for home loan applicants. Currently, SBA accepts
only paper loan application documents from disaster victims, and data-
entry staff manually input application data into DCMS. According to the
Direct Loan Systems Requirements issued by the Joint Financial
Management Improvement Program, federal agency loan systems "should
provide for an electronic application process using various media, such
as a secure Internet application."[Footnote 25] SBA could reduce the
number of paper application documents it receives, the number of
documents it subsequently scans into DCMS, and the resources and time
required to input application data by capturing much of this
information electronically. According to SBA officials, DCMS has the
capability to interface with a secure Internet-based application
feature where this data could be captured electronically. However, SBA
did not attempt to add this functionality after the Gulf Coast
hurricanes because of the instability it initially experienced with
DCMS. SBA officials added that the agency concentrated its efforts on
expanding the capacity of DCMS and would examine adding this
functionality to the system in the future.
SBA officials told us that, prior to the Gulf Coast hurricanes, the
agency initiated a business process reengineering effort within ODA to
reevaluate the disaster loan process. As part of this effort, ODA
planned to (1) determine what type financial analysis would be
performed for applicants with credit scores indicating a high degree of
default risk, (2) design a streamlined loan application (both paper and
electronic), and (3) identify policy and legislative changes required
to implement the new process. However, ODA postponed this effort after
the Gulf Coast hurricanes because of the resources needed to meet the
demands of the disaster loan program. Business process reengineering
can help organizations identify, analyze, and redesign their core
business processes with the aim of achieving dramatic improvements in
critical performance measures such as cost, quality, service, and
speed. According to SBA officials, it has plans to resume this effort
in 2006 in order to identify ways to more efficiently process disaster
loan applications and to maximize the benefits of DCMS.
Conclusions:
The Gulf Coast hurricanes presented SBA with unprecedented challenges
that, in combination, led to significant backlogs and delays in
processing disaster loan applications. For example, SBA faced the
largest volume of disaster loan applications in its history, as the
United States experienced three extremely destructive natural disasters
over a period of about 2 months. This large volume was due in part to
the large number of applicants automatically referred to SBA by FEMA's
Internet site, many of whom ultimately did not qualify for disaster
loans. We also agree that SBA should improve its screening process
within DCMS when processing "$0 income" referrals and continue to work
with FEMA to reduce unnecessary online disaster referrals, as
recommended by SBA's Office of Inspector General. In addition, various
system and processing-related issues also challenged SBA, such as a new
disaster loan system that was not designed to effectively respond to a
disaster of this magnitude and that was unable to operate at the
planned maximum capacity. Moreover, SBA based the maximum number of
concurrent users for DCMS solely on its historical experience rather
than considering information available from catastrophe risk modeling
firms and disaster simulations, such as the likelihood and severity of
damages from potential catastrophes to help predict the volume of
applications that it might expect from such events. While SBA has plans
to greatly expand its capacity of concurrent users for DCMS and should
be more capable of processing larger volumes of loan applications once
it achieves this increased capacity, it is not clear how the agency
determined the new maximum number of concurrent users and whether this
new capacity will be appropriate to handle future large scale disasters
like the Gulf Coast hurricanes. If SBA had considered information
available from catastrophe risk modeling firms and disaster simulations
to help predict the volume of loan applications it could expect to
receive, SBA could have made better informed decisions and might have
acquired additional capacity that could have enabled SBA to reduce the
backlog of applications in a more timely manner. Such an analysis would
also better position SBA to determine its loan processing capacity for
future disasters. SBA's limited planning was further exacerbated by the
lack of complete stress testing and the ineffective technical support
provided by the hosting contractor. If SBA had appropriately stress
tested the system before implementation, it might have discovered
before the Gulf Coast hurricanes struck that it had received the
incorrect computer hardware. Going forward, SBA would benefit from
improving its process for verifying that the equipment provided by
contractors meets all required specifications.
While some of SBA's initiatives improved its response to disaster
victims, other efforts did not help the agency significantly reduce the
large backlog of applications because they were either not implemented
in a timely manner, not attractive to the applicant, or did not fully
incorporate the use of DCMS to process applications. If some of these
initiatives had been implemented soon after the Gulf Coast hurricanes
struck, they might have enhanced SBA's ability to process a large
volume of loan applications in a timely manner. In addition, DCMS has
the capability to interface with an Internet-based application feature
that could reduce the resources and time required to input application
data for home loan applicants by capturing much of this information
electronically. As the 2006 Atlantic hurricane season has already
begun, SBA would benefit by expediting its plans to resume its business
processing reengineering efforts to analyze ways to more efficiently
process loan applications, including an evaluation of implementing an
Internet-based application feature.
Recommendations for Executive Action:
In order to provide more timely disaster assistance in the future, we
recommend that the Administrator of SBA direct the Office of Disaster
Assistance to take the following four actions:
* reassess DCMS's maximum user capacity and related loan processing
resource needs based on such things as lessons learned from the Gulf
Coast hurricanes, a review of information available from catastrophe
risk modeling firms and disaster simulations, and related cost
considerations;
* conduct complete stress testing to ensure that DCMS can function at
planned for maximum user capacity levels;
* improve management controls over assessing contractor performance
through inspections of all equipment purchased or leased to support
DCMS; and:
* expedite plans to resume business process reengineering efforts to
analyze the disaster loan process and identify ways to more efficiently
process loan applications including an evaluation of the feasibility of
implementing a secure Internet-based application feature for home loan
applicants.
Agency Comments and Our Evaluation:
We provided SBA with a draft of this report for review and comment. The
Associate Administrator for Disaster Assistance provided written
comments that are presented in appendix III. In these comments, SBA
provided additional context regarding the magnitude of the disasters
and the impact on the Disaster Loan Program. SBA stated that it
generally agreed with our recommendations and intended to improve the
delivery of the Disaster Loan Program for events of all sizes. However,
SBA disagreed with the following four findings and conclusions in our
draft.
First, SBA disagreed with our conclusions that it performed limited
planning and that it would have been better prepared to reduce the
backlog of applications through the use of catastrophe risk models
rather than relying primarily on the Northridge earthquake to establish
its capacity needs. As we noted in our report, SBA planned the maximum
user capacity for DCMS based on the volume of applications it received
from victims of the Northridge earthquake--the single largest disaster
SBA had previously faced--and did not anticipate the likelihood of a
single disaster or series of disasters of the magnitude of the Gulf
Coast hurricanes. We continue to believe that catastrophe risk modeling
firms and disaster simulations provide critical information, such as
the likelihood and severity of damages from potential catastrophes.
Combined with other elements of a comprehensive planning process, such
information would have been useful in planning the maximum user
capacity of DCMS. If SBA had considered this information, the agency
may have concluded that the likelihood of large scale disasters
exceeding the magnitude of the Northridge earthquake was significant
enough to expand its maximum concurrent user requirement. This
additional capacity would have better prepared SBA to reduce the
backlog of loan applications more rapidly because additional staff in
all phases of the loan application process would have been able to
access DCMS.
Second, SBA stated in its comments that our draft report does not
include an analysis of the difference between using DCMS and ALCS--
SBA's previous system. SBA also highlighted in its comment letter many
of the benefits offered by DCMS. While it was not in the scope of our
work to conduct a comparative analysis of ALCS and DCMS, our report
recognized some of the benefits realized by adopting DCMS. For example,
we noted that ALCS tracked the movement of paper loan application files
from one stage of the loan process to another and required the movement
and storage of large volumes of paper. We also noted that DCMS helped
SBA move toward a paperless processing environment by automating many
of the functions staff members had performed manually using ALCS such
as obtaining FEMA referral data and credit bureau reports, as well as
completing and submitting loss verification reports from remote
locations.
Third, SBA stated that the draft report does not indicate that the
specific computer components, which the hosting contractor incorrectly
provided, were processing chips that were embedded subcomponents of the
computer servers, which SBA personnel could only detect by opening and
dismantling the computer hardware. We agree that the hardware was
embedded in the computer servers and could have been verified by
physical inspection. SBA conducted such an inspection in September
2005. However, alternative ways of verifying the computer hardware were
possible. For example, SBA staff could have used its system utilities
to view details of the hardware and operating system after the
processors were installed and may have detected the incorrect
processors and taken corrective actions in a more timely manner.
Finally, SBA took issue with our finding that it actually took longer
to process expedited approvals under a pilot program, compared with its
average processing time frames for all approvals. SBA stated that our
interpretation of the data was misleading because it did not adjust for
the length of time an application was in the loss verification
inventory before being assigned to the loan department for processing.
We disagree that our interpretation of the data was misleading because
all physical disaster loan applications had to go through loss
verification before a decision was made, regardless of whether the
application was part of the expedited pilot program. While the
expedited approval pilot program may have reduced the amount of time
for loan officers to complete the underwriting decision, our intent,
consistent with our overall objective, was to show the total time
disaster victims waited for SBA to make a decision on their
application. This includes the time an application is in other stages
of the disaster loan process, such as application entry and loss
verification. As we noted in our report, SBA implemented the pilot
program when the agency faced a significant backlog of 115,000
applications in the loss verification stage, and these applications had
been in the queue for 39 days on average. SBA's data showed that the
agency actually took longer to process expedited approvals, about 104
days on average, compared with 94 days on average for all approvals. We
continue to believe that it is appropriate to consider the total
processing time frames when comparing applications approved under the
pilot program with all approved applications.
SBA also provided other technical corrections and comments, which have
been incorporated in this report, where appropriate.
We are sending copies of this report to appropriate congressional
committees, the Administrator of the Small Business Administration, and
other interested parties and will make copies available to others upon
request. In addition, the report will be available at no charge on the
GAO Web site at [Hyperlink, http://www.gao.gov.]
If you or your staff have any questions regarding this report, please
contact me at (202) 512-8678 or shearw@gao.gov. Contact points for our
Offices of Congressional Relations and Public Affairs may be found on
the last page of this report. GAO staff who made major contributions to
this report are listed in appendix IV.
Signed by:
William B. Shear:
Director, Financial Markets and Community Investment:
List of Addressees:
The Honorable William Thad Cochran:
Chair:
Committee on Appropriations:
United States Senate:
The Honorable Susan M. Collins:
Chair:
The Honorable Joseph I. Lieberman:
Ranking Minority Member:
Committee on Homeland Security and Governmental Affairs:
United States Senate:
The Honorable Olympia J. Snowe:
Chair:
The Honorable John F. Kerry:
Ranking Minority Member:
Committee on Small Business and Entrepreneurship:
United States Senate:
The Honorable Richard C. Shelby:
Chair:
The Honorable Barbara A. Mikulski:
Ranking Minority Member:
Subcommittee on Commerce, Justice, and Science:
Committee on Appropriations:
Unites States Senate:
The Honorable Tom Davis:
Chair:
The Honorable Henry A. Waxman:
Ranking Minority Member:
Committee on Government Reform:
House of Representatives:
The Honorable Donald Manzullo:
Chair:
The Honorable Nydia M. Velazquez:
Ranking Minority Member:
Committee on Small Business:
House of Representatives:
The Honorable Frank R. Wolf:
Chair:
The Honorable Alan B. Mollohan:
Ranking Minority Member:
Subcommittee on Science, State, Justice, Commerce, and Related
Agencies:
Committee on Appropriations:
House of Representatives:
The Honorable Dianne Feinstein:
United States Senate:
The Honorable Mary L. Landrieu:
United States Senate:
[End of section]
Appendix I: Scope and Methodology:
In this report, we evaluate: (1) what affected the Small Business
Administration's (SBA) ability to provide timely disaster assistance
and (2) the actions SBA took after the disasters to improve its
response to disaster victims. This report focuses primarily on the
Disaster Credit Management System (DCMS) and the disaster loan process.
We visited the Gulf Coast region to observe conditions and meet with
federal, state, and local officials and victims of the disasters. We
also interviewed officials from the Office of Disaster Assistance at
SBA's headquarters and officials from the Processing and Disbursement
Center in Texas, Field Operations Centers East and West in Georgia and
California, Customer Service Center in New York, DCMS Operations Center
in Virginia, and Georgia District Office. We reviewed SBA's standard
operating procedures for approving, declining, and withdrawing disaster
loans. In addition, we reviewed documents related to the agency's
response to the Gulf Coast hurricanes, congressional testimony, and
other program documentation.
We reviewed documents related to SBA's acquisition and implementation
of DCMS. In addition, we discussed the acquisition process with
officials from SBA's DCMS Operations Center, which provides technical
and program management support for the system. We also reviewed SBA's
standards for system development and compared the acquisition process
for DCMS with industry standards for effective information technology
acquisition. Further, we interviewed officials from SBA's Office of
Inspector General and reviewed their reports related to the
implementation of DCMS and SBA's Disaster Loan Program. We did not
conduct a comparative analysis of DCMS and ALCS--SBA's previous system-
-as part of our work. To obtain the perspectives of system users, we
interviewed loan processing staff at various SBA locations. We also
obtained SBA's total costs for planning, acquiring, and implementing
DCMS through April 2006. However, we did not audit the reported costs
and thus cannot attest to their accuracy or completeness.
We obtained documents related to the performance of DCMS, including
system status reports, troubleshooting reports, and system change
requests. We reviewed these documents to assess the extent to which
system-related problems detailed in the documents affected SBA's
ability to provide timely disaster assistance. In addition, we obtained
various reports on SBA's disaster lending activity for victims of
Hurricanes Katrina, Rita, and Wilma. We used these reports to calculate
descriptive statistics on the number of applications mailed and
received, the number and amount of approved loans, the backlog of
applications in various stages, and other characteristics for
applications processed through May 27, 2006. For comparative purposes,
we also obtained summary statistical reports related to SBA's disaster
lending for past significant disasters. We also obtained data extracts
from DCMS of disaster loan applications SBA received from victims of
Hurricanes Katrina, Rita, and Wilma for various dates. We used the
extracts to calculate average time frames for various stages of the
disaster loan process.
In assessing the reliability of SBA's data, we reviewed documents such
as the DCMS Privacy Act Assessment and met with appropriate SBA
officials. To increase our confidence in the reliability of SBA's data,
we compared information from selected hard copy application files with
the information recorded in DCMS. We also performed various tests of
the information in the data extracts we obtained to ensure the
completeness of the data. We concluded that SBA's data were
sufficiently reliable for the purposes of our report.
To evaluate actions SBA took after the disasters to improve its
response to disaster victims, we reviewed documents related to changes
SBA made to DCMS and changes SBA planned to make to the system. We
discussed these changes with officials from SBA's DCMS Operations
Center. In addition, we obtained and reviewed documents related to
changes SBA made to the disaster loan process and other initiatives
intended to improve SBA's response to disaster victims. We discussed
these changes and initiatives with the appropriate SBA officials and
obtained data on the impact of these efforts where available.
We reviewed documents related to the Federal Emergency Management
Agency's (FEMA) Individuals and Households Program, which makes
assistance available to victims of major disasters. We also contacted
FEMA to obtain additional information regarding the agency's process
for referring applicants to SBA's Disaster Loan Program.
We performed our work in Atlanta, Ga; Buffalo, N.Y; Fort Worth, Tex;
New Orleans and Metarie, La; Sacramento, Calif; Bay St. Louis, Biloxi,
Gulfport, and Waveland, Miss; Herndon, Va; and Washington, D.C. We
conducted our work between November 2005 and July 2006 in accordance
with generally accepted government auditing standards.
[End of section]
Appendix II: SBA's Acquisition and Implementation of the Disaster
Credit Management System:
Since the early 1990s, SBA utilized its Automated Loan Control System
to track the movement of paper application files from each stage of the
process until it made a decision on the application, disbursed funds
for approved applications, and transferred the application file to
servicing. SBA also obtained data manually from external data sources,
including FEMA, the Internal Revenue Service (IRS), and the credit
reporting agencies. In December 1998, after using a significant number
of resources in response to victims of Hurricane Georges, which struck
Puerto Rico that previous September, SBA began an effort to modernize
its manual and paper-based disaster loan process.
SBA intended for its new disaster loan system to support: (1) a
"paperless" electronic loan application and loan process, (2) loan
processing from any location where the system is implemented, (3)
multiple interaction methods between loan applicants and the Office of
Disaster Assistance (e.g., by Internet or telephone), and (4) access to
external data sources. The modernization effort entailed the following
actions:
* documenting SBA's current loan process and proposed future loan
process;
* performing requirements analysis, conducting a commercial-off-the-
shelf (COTS) market survey, and developing a business case;
and:
* acquiring, customizing, and implementing the system.
In March 1999, SBA completed a business process reengineering study to
document the current process and proposed future process. In August
2000, SBA completed the initial development of the new system
requirements. Subsequently, SBA contracted for a COTS survey of
products meeting its requirements and leveraging its other information
technology resources. The survey identified two products that met a
significant number of SBA's requirements, with some customization and
integration of additional products needed to meet all requirements.
After the contractor completed the survey, SBA's information technology
investment review board required the agency to complete a business case
analysis for the proposed disaster loan system. SBA's analysis involved
researching the existing requirements, evaluating potential
alternatives, and providing a recommendation. In March 2001, SBA
completed the analysis, which evaluated three alternatives: (1) develop
a custom solution, (2) acquire a COTS product, or (3) stay with the
current environment. SBA determined that the COTS product represented
the best solution after considering the costs and time frames
associated with each alternative.
In June 2002, a SBA contractor developed more specific requirements for
the project because a considerable amount of time had passed since the
first survey and because of the uniqueness of certain aspects of the
disaster loan process, such as loss verification and a check for
duplication of benefits. Later that year, SBA contracted for a separate
COTS survey that utilized the Carnegie Mellon University's Software
Engineering Institute process for evaluating COTS products.[Footnote
26] SBA evaluated products from 10 different vendors, and after
narrowing the selection to two products, received vendor demonstrations
in January 2003. In March 2003, the contractor recommended a COTS
product for SBA to use as the foundation for the Disaster Credit
Management System (DCMS).
In September 2003, SBA completed an analysis of the DCMS design to
identify potential gaps between the recommended COTS product and the
requirements for the system. For example, SBA recognized that the COTS
product did not have the functionality to perform loss verification
activities; therefore, SBA decided to implement a custom loss
verification application and link the application to the core system.
This ensured that loss verification data would automatically
synchronize with DCMS.
In 2003, SBA also began to test various aspects of its new system. In
November 2003, the agency began testing the core application,
interfaces, and additional components (loss verification, scanning,
etc.) User validation readiness testing was conducted between December
2003 and March 2004. In October 2004, SBA contracted for an Independent
Verification and Validation (IV&V) of an initial release of DCMS. An
IV&V can help provide reasonable assurance that a system satisfies its
intended use and user needs, and its use is recognized as an industry
best practice. The IV&V conducted for DCMS found that the system was
supported by strong requirements, test plans, test cases, and other
supporting documentation. In addition, the IV&V found that DCMS was
developed with a high level of user involvement. However, the IV&V did
not evaluate performance testing, including tests to help ensure that
the system could function at its maximum user capacity, because these
tests were not completed until December 2004 after the agency had begun
implementation. This performance testing was conducted with only up to
120 concurrent users due to problems with the hardware associated with
the testing environment. If the testing environment had functioned as
planned, it was estimated the system could accommodate approximately
600 concurrent users.
SBA used a phased approach for implementing DCMS. In November 2004, SBA
first implemented DCMS in its Niagara Falls, New York, Disaster Area
Office. In January 2005, SBA implemented DCMS in its Fort Worth, Texas,
and Sacramento, California DAO. SBA also began using DCMS to process
applications for all new disaster declarations. As figure 6
illustrates, SBA's process of moving from its former manual, paper-
based disaster loan process to a more automated process using DCMS took
about 6 years. SBA's costs for planning, acquiring, implementing, and
operating DCMS totaled about $32 million through April 2006.
Figure 6: Time Line of DCMS Activities:
[See PDF for image]
Source: GAO.
[End of figure]
[End of section]
Appendix III: Comments from the Small Business Administration:
U.S. Small Business Administration:
Washington, D.C. 20416:
July 17, 2006:
William B. Shear:
Director:
Financial Markets and Community Investment:
United States Government Accountability Office:
441 G Street N.W.
Washington, DC 20545:
Dear Mr. Shear:
We appreciate the opportunity to provide comments on the U.S. Small
Business Administration's (SBA) response to the catastrophic Hurricanes
Katrina, Rita and Wilma in 2005 as articulated in the Government
Accountability Office's (GAO) draft report entitled Small Business
Administration, Actions Needed to Provide More Timely Disaster
Assistance.
In reviewing SBA's performance to this unprecedented series of events
we think it is helpful to fully appreciate the context of these
hurricanes as well as the long-term recovery efforts of the Agency. In
the summer and fall of 2005, Hurricanes Katrina, Rita and Wilma
destroyed significant portions of Louisiana, Mississippi, Alabama,
Florida and Texas. These hurricanes wrecked devastation on home and
business owners and collectively represent the worst natural disaster
in American history. The declared disaster area was approximately
90,000 square miles, covering an area equivalent to that of Great
Britain. The after-effects of the hurricanes, including the devastation
of critical infrastructure, damage to roads and bridges, loss of basic
utilities (i.e., electrical, gas, water), hampered communications, and
the inability to access parts of the disaster area in order to perform
damage inspections also adversely affected the speed at which SBA was
able to deliver its Disaster Loan Program.
The magnitude of these disasters caused over 420,000 home and business
owners to apply for SBA assistance. To date, SBA has approved over
154,000 disaster loans for over $10.2 billion to victims of these
horrific storms. Put into context 20 percent of all the disaster loan
dollars approved in the 53-year history of SBA occurred this past
disaster season. The Gulf Coast hurricanes represent the largest
collection of disasters the Agency has ever faced, vastly surpassing
our previous largest disaster, the Northridge earthquake in 1994, where
we received approximately 250,000 applications and approved over $4
billion in disaster loans.
To build from the lessons learned from 2005, and in preparation for the
2006 Hurricane season. SBA convened an Agency-wide Disaster Oversight
Council comprised of Agency leadership as well as other key senior
personnel. The purpose of-the Disaster Oversight Council was to better
leverage the resources of the Agency as a whole, and incorporate new
ideas and best practices from SBA program areas into our disaster
preparedness capability. To pre-position the Agency, SBA has completed
a series of process improvements and reengineering initiatives to
improve service delivery, which include the following:
* Upgraded System Capacity. Today the Disaster Credit Management System
(DCMS) has been tested and verified to support a minimum of 8,000
concurrent users. This represents a four-fold increase in capacity over
peak usage during the 2005 Gulf Coast hurricanes.
* Enhanced Disaster Workforce. SBA's Disaster Assistance capability
expands and contracts in size based on level of disaster activity.
Prior to Hurricane Katrina making landfall, SBA had about 800 employees
on the payroll but quickly surged to over 4,300 employees in response
to these unprecedented storms. Today, SBA's Disaster Loan Program has
roughly 3,500 employees across all key functions. Additionally, SBA has
selected over 1,000 employees in the expansion of the Disaster reserve
corps. The number of trained employees on board and in the reserve core
increases the Agency's capacity to quickly respond to catastrophic
events in 2006 if required.
* Partnered with Private Sector. As a result of the unprecedented
application volume received. SBA created the Disaster Loan Partners
Initiative and selected three private sector contracts to assist with
SBA's loan processing and loan closing activities. This unique
partnership with the private sector provides the Agency with additional
experienced personnel to enhance program delivery to disaster victims.
* Leveraged SBA's Nationwide Infrastructure. During the 2005 Hurricane
season, the Agency utilized SBA's nationwide District Office
infrastructure to handle increased disaster activity.
* Expanded Agency Footprint. The Agency has secured over 400,000 sq.
ft. of space for the current disaster season in multiple locations
across the country. SBA estimates that this should be sufficient to
accommodate infrastructure needs for the 2006 Hurricane season.
However, maintaining this high level of overhead is costly given the
variable nature of disasters. SBA has a fiscal responsibility to the
taxpayers and must evaluate if the resources required to maintain this
space on a continual basis are realistic, cost-effective, or if other
alternatives exist.
* Bolstered Forecasting Ability and Risk Monitoring Procedures. The
Agency has enhanced its capability to immediately forecast application
volumes when disasters strike. This new model - which includes a
flexible tool for forecasting purposes - provides a more robust
methodology for predicting application volume based on assets at risk
and disaster characteristics.
* Developed Disaster Scalability Preparedness Tool. The Agency now
possesses the capability to determine resource needs - financial, human
capital (by function), and logistics - required to maximize SBA's
response against a number of different application volume scenarios.
Action plans that support the requirements outlined in each scenario
continue to be refined.
* Enhanced Communications. The SBA is focused on a two pronged
communications strategy for the current disaster season-emphasizing the
need for disaster preparedness, and outreach to the public and the
media about available resources once a disaster is declared-:
In reviewing the draft report, it seems to place an unreasonable and
unwarranted emphasis on some key points. More specifically, we disagree
with the auditors' conclusions SBA performed limited planning,
resulting in insufficient DCMS user capacity, and that through the use
of catastrophe risk models we would have been better prepared to reduce
the backlog of applications. Additionally, the draft report focuses on
the challenges SBA faced during the response to the 2005 Hurricanes
without recognizing the improved capability afforded by implementation
of our recently released new technological platform.
The draft report indicates that SBA should have used results of data
from catastrophe risk modeling to plan for the appropriate level of
DCMS maximum users. Further the draft report indicates that SBA should
use catastrophic modeling to predict the capacity needed to process the
volume of activity as a result of such events. However, the report
provides little guidance on how SBA could use such modeling to
determine the system requirements. Additionally, the report fails to
reflect that SBA did design the DCMS to handle the largest disaster it
had ever faced, the Northridge earthquake, which had produced
application volume far greater than SBA's usual demand, SBA's only
failure was to be unable to anticipate a disaster that doubled that
extraordinary demand SBA strongly suggests that report reflect this set
of facts.
The draft report also fails to offer an analysis of the difference
between using the DCMS system and using SBA's prior, antiquated
Automated Loan Control System (ALCS) in response to such to such
catastrophic events. Such a comparison would have revealed that SBA was
able to handle a disaster twice the size of the Northridge earthquake
in the same amount of time or less. As a result, the report only
responds to the potential adverse impact of DCMS related issues to the
response, and not to the positive contributions offered by the new
technology. While it is difficult to perform a comparative analysis to
quantify the benefits of the new technology, there are opportunities
throughout the report to demonstrate a better balance between the
benefits of the new system and the problems with the old.
We suggest that GAO include the immediate improvements of DCMS response
times to ODA's loan making function in the report, such as:
* Electronic case files versus paper case files:
* Automated workflow within DCMS eliminates hundreds of staff who
performed file control processes:
* Automated credit report pull for every application eliminates manual
process.
* Loss verification assignments are sent and completed inspections
returned through data sync via secure internet connection eliminating
file shipping costs and time associated with loss verifier deployment.
* Loss verification process automated with pre-defined data and
formulas to eliminate manual steps.
* Scanning component integrates into the electronic data file to
provide access to multiple users without need to physically transport
paper records.
* Implemented automated loan closing checklist eliminates manual
creation of document for each case.
* New interface with the Federal Emergency Management Agency (FEMA) for
automated Duplication of Benefits retrieval eliminates manual access
and printing of multiple pages of data.
* New interface with SBA loan accounting system for automated queries
on previous loan history of loan applicants eliminates manual search
and printing of records.
* New interface to update SBA co-borrower and guarantor data eliminates
manual data entry.
* Implemented certain achievable process improvements such as
reengineered application screening process, pre-processing decline and
referral process, auto-decline process, expedited approval process, and
other policy changes relative to system enabled improvements.
The draft report states that SBA did not verify whether the hosting
contractor provided the correct computer equipment in contradiction to
Federal procurement policies. It is true that SBA acquired leased
equipment which did not contain all of the correct components. However,
the report fails to point out that the specific components that were
not correctly provided were the processing chips, embedded
subcomponents of the servers that could not be detected unless SBA
personnel had actually opened and dismantled the servers.
We also believe that the findings in the draft report are misleading
regarding SBA's pilot of "expedited approvals." We believe that GAO's
interpretation of the data is misleading because it does not adjust for
the length of time a file was in loss verification inventory before
being assigned to the loan department for processing. The conclusion
that applications took longer to process under the expedited rules is
not an accurate representation due to the fact that these applications
were in loss verification and an inspection of the disaster-damaged
property had to be scheduled and completed before performing the
financial analysis in loan processing. Once the damage inspection was
completed, the amount of time to complete the underwriting decision was
substantially decreased, thus resulting in a shorter wait for a loan
decision. We believe a more accurate comparison would have been the
amount of time it took to process "expedited loan approvals" versus
applications that were processed in the normal manner from the date the
application was assigned to the loan department to the date of loan
decision. Inclusion of the days an application was in departments such
as loss verification prior to loan processing does not accurately
reflect the positive impact of the pilot program to notify applicants
of approval decisions faster.
We note that the comments in the recommendations section in the draft
report suggest several ways to better improve our program performance.
We generally agree with the recommendations and intend to improve the
delivery of our program for events of all sizes. Our response to the
recommendations is as follows:
Recommendation 1, Reassess DCMS maximum user capacity. SBA agrees with
the need to reassess the DCMS maximum user capacity and related
processing resource needs. To a large extent, this process began during
the response to the 2005 hurricanes and achievement of an immediate
step has recently been completed through the implementation of the
upgraded DCMS hardware which will support in excess 48,000 concurrent
users. The new hardware was put into production use an June 12, 2006,
Further efforts to enhance productivity and overall system capacity are
on-going. The utilization of catastrophe risk models and disaster
simulations is being considered as part of the disaster planning
process, and to the extent these processes are useful, SBA will
incorporate best practices.
Recommendation 2, Improve management controls over assessing contractor
performance. SBA has management controls in place to assess contractor
performance through daily, weekly, and monthly reviews of the technical
and operational requirements. These repeatable processes were put in
place during the 2005 disaster response and have been maintained ever
since. In addition, the DCMS hardware upgrade project was completed
with a comprehensive and thorough detailed inspection of all equipment
acquired to support DCMS. Even with these controls in place, the Agency
will look for additional ways we can improve DCMS contractor oversight.
Recommendation 3, Conduct complete stress testing on DCMS. The new DCMS
hardware has undergone significant performance testing prior to release
to production. The capabilities of the new system are substantially
improved beyond the previous production environment. SBA will continue
to enhance the DCMS software and hardware components to further
optimize performance and capabilities, and will perform additional
stress testing; as necessary, to assess the impact of these changes to
the new baseline.
Recommendation 4, Expedite plans to resume business process
reengineering. SBA intends to resume its efforts to reengineer its
business processes in the disaster program, including revised process
flows for applications and to provide a secure internet-based
application feature for home and business disaster loan applicants.
We appreciate the opportunity to provide clarifying comments and have
included our specific requests for clarifications and/or changes within
the attachment herein.
Sincerely,
Signed by:
Herbert L. Mitchell:
Associate Administrator for Disaster Assistance:
[End of section]
Appendix IV: GAO Contact and Staff Acknowledgments:
GAO Contact:
William B. Shear, (202) 512-8678, s [Hyperlink, shearw@gao.gov]
hearw@gao.gov:
Staff Acknowledgments:
In addition to the individual named above, Daniel Blair, Assistant
Director; Barbara Oliver, Assistant Director; Bernice Benta; Tania
Calhoun; Marshall Hamlett; Marc Molino; David Pittman; Jennifer
Popovic; Rhonda Rose; and Eric Trout made key contributions to this
report.
(250263):
FOOTNOTES
[1] Preliminary estimates as reported by the National Oceanic and
Atmospheric Administration.
[2] In this report, we refer to Katrina, Rita, and Wilma collectively
as the Gulf Coast hurricanes.
[3] The objectives of this subsequent review are to determine (1) the
extent to which SBA has a comprehensive disaster response plan and, if
so, how it affected the agency's ability to provide timely assistance
to Gulf Coast hurricane victims; (2) how work force transformation
affected SBA's ability to respond to victims; (3) how SBA's efforts to
modify its regulatory and programmatic authority compared with previous
major disasters; and (4) what outreach strategy SBA used to inform
victims about the disaster loan program.
[4] SBA's hosting contractor provides services such as monitoring the
DCMS network and providing support for leased computer hardware.
[5] Stress testing refers to measuring a system's performance and
availability in times of particularly heavy or peak load.
[6] In this report, we refer to 21 days as the goal because SBA tells
disaster victims that it will try to make a decision on each completed
application within this time frame. According to SBA, the agency's
Government Performance and Results Act goal for fiscal year 2006 is to
process 85 percent of home loan applications within 14 days and 85
percent of business applications within 16 days.
[7] FEMA also refers to the IHP program as Individual Assistance (IA).
[8] SBA provides the income thresholds to FEMA, which vary based on the
applicant's household size and are adjusted annually for inflation. For
example, SBA's minimum income threshold for fiscal year 2005 was
$13,965 for a household size of one;
the threshold increased to $14,355 for fiscal year 2006. If the
applicant's household income falls below the income thresholds, FEMA
will automatically refer them to its Other Needs Assistance Program.
This program provides financial assistance to individuals and
households who have other disaster-related necessary expenses or
serious needs, such as medical expenses.
[9] According to SBA's procedures, an acceptable application is one
that has a signed and reasonably completed application form and a fully
completed and signed Tax Information Authorization (Internal Revenue
Service Form 8821) for each required taxpayer or entity. SBA returns
unacceptable applications and requests the information needed to make
the application acceptable.
[10] SBA does not conduct the preliminary financial analysis for home
loan applicants indicating that they (1) are the sole proprietor of a
business; (2) have household income which includes rents, farms, or
other nonsalary sources (not including disability, social security
pension, etc.); or (3) have household income in excess of $50,000.
According to SBA officials, the preliminary financial analysis is not a
valid measure of repayment ability for these individuals because their
financial circumstances are more complex or their income may be able to
support a higher debt level. In these cases, SBA officials stated that
a more thorough financial analysis is warranted, and these applications
go through the normal process.
[11] FEMA does not provide assistance to cover business-related losses.
[12] Economic injury loan applications move directly to the application
processing stage after application entry.
[13] SBA is required to determine whether applicants are able to obtain
financial assistance at reasonable rates and terms from nongovernment
sources prior to assigning an interest rate. A higher interest rate
applies for physical disaster loan applicants determined to have credit
elsewhere, and business physical disaster loan applicants are subject
to a maximum 3-year term for repayment. Economic injury disaster loan
applicants are not eligible for disaster loans if SBA determines they
can obtain credit elsewhere. For the Gulf Coast hurricanes, disaster
victims unable to obtain credit elsewhere were assessed an interest
rate of 2.687 percent for home loans and 4 percent for business loans
and nonprofit organizations. Disaster victims that could obtain credit
elsewhere were assessed an interest rate of 5.375 percent for home
loans, 6.557 percent for business loans, and 4.75 percent for nonprofit
organizations.
[14] According to SBA procedures, legal review staff members generally
do not review draft loan authorization and agreements for unsecured
loans.
[15] For victims of the Gulf Coast hurricanes, SBA increased to
$50,000, the maximum initial disbursement for physical disaster loans
with collateral.
[16] SBA reorganized its Office of Disaster Assistance in 2005 as part
of its workforce transformation initiative. SBA centralized all loan
processing functions for account application and account processing at
its former Ft. Worth (Texas) DAO, which became its PDC. SBA
consolidated field operations, verification, congressional, and public
information office functions at its former Atlanta (Georgia) DAO and
Sacramento (California) DAO, which became its Field Operations Centers
East and West. SBA centralized all victim-related support functions at
its former Niagara Falls DAO, which became its Buffalo (New York)
Customer Service Center.
[17] SBA Office of Inspector General, "Disaster Application Referrals
with $0 Income from FEMA Online Registration Have Increased Costs and
the Demand for SBA Resources," Advisory Memorandum 06-12 (Feb. 17,
2006).
[18] Risk Management Solutions, "The 1906 San Francisco Earthquake and
Fire: Perspectives on a Modern Super Cat" (2006).
[19] AIR Worldwide Corporation, "Insuring and Mitigating the Risk of
Large-Scale Natural Disasters" (2006).
[20] Office of Management and Budget, "Management Oversight of Service
Contracting," Policy Letter No. 93-1 (May 18, 1994).
[21] For more information, see GAO, Aviation Security: Secure Flight
Development and Testing Under Way, but Risks Should Be Managed as
System Is Further Developed, GAO-05-356 (Washington, D.C.: Mar. 28,
2005).
[22] SBA had planned to phase out loan processing operations at this
office by the end of October 2005, as it became the Field Operations
Center West under SBA's transformation initiative.
[23] SBA also used the Sacramento satellite office to process about
10,700 home loan applications for smaller disaster declarations.
[24] Applications for Hurricanes Katrina and Rita only.
[25] The Joint Financial Management Improvement Program is a joint and
cooperative initiative to improve financial management practices in the
government and was authorized under the Budget and Accounting
Procedures Act of 1950. The program promotes strategies and guides
financial management improvement across government; reviews and
coordinates central agencies' activities and policy promulgations; and
acts as a catalyst and clearinghouse for sharing and disseminating
information. See JFMIP Direct Loan System Requirement: June 1999.
[26] The Software Engineering Institute has identified specific
processes and practices that have proven successful in fostering
quality software development. The processes and practices identified
focus on software development and acquisition activities. The institute
has constructed models for developing and acquiring software,
developing and implementing software process improvement programs, and
integrating hardware and software. The institute created the models to
provide general guidance for software development and acquisition
activities that programs can tailor to meet their needs (See GAO,
Defense Acquisitions: Stronger Management Practices Are Needed to
Improve DOD's Software-Intensive Weapon Acquisitions, GAO-04-393
(Washington, D.C.: Mar. 1, 2004).
GAO's Mission:
The Government Accountability Office, the investigative arm of
Congress, exists to support Congress in meeting its constitutional
responsibilities and to help improve the performance and accountability
of the federal government for the American people. GAO examines the use
of public funds;
evaluates federal programs and policies;
and provides analyses, recommendations, and other assistance to help
Congress make informed oversight, policy, and funding decisions. GAO's
commitment to good government is reflected in its core values of
accountability, integrity, and reliability.
Obtaining Copies of GAO Reports and Testimony:
The fastest and easiest way to obtain copies of GAO documents at no
cost is through the Internet. GAO's Web site ( www.gao.gov ) contains
abstracts and full-text files of current reports and testimony and an
expanding archive of older products. The Web site features a search
engine to help you locate documents using key words and phrases. You
can print these documents in their entirety, including charts and other
graphics.
Each day, GAO issues a list of newly released reports, testimony, and
correspondence. GAO posts this list, known as "Today's Reports," on its
Web site daily. The list contains links to the full-text document
files. To have GAO e-mail this list to you every afternoon, go to
www.gao.gov and select "Subscribe to e-mail alerts" under the "Order
GAO Products" heading.
Order by Mail or Phone:
The first copy of each printed report is free. Additional copies are $2
each. A check or money order should be made out to the Superintendent
of Documents. GAO also accepts VISA and Mastercard. Orders for 100 or
more copies mailed to a single address are discounted 25 percent.
Orders should be sent to:
U.S. Government Accountability Office
441 G Street NW, Room LM
Washington, D.C. 20548:
To order by Phone:
Voice: (202) 512-6000:
TDD: (202) 512-2537:
Fax: (202) 512-6061:
To Report Fraud, Waste, and Abuse in Federal Programs:
Contact:
Web site: www.gao.gov/fraudnet/fraudnet.htm
E-mail: fraudnet@gao.gov
Automated answering system: (800) 424-5454 or (202) 512-7470:
Public Affairs:
Jeff Nelligan, managing director,
NelliganJ@gao.gov
(202) 512-4800
U.S. Government Accountability Office,
441 G Street NW, Room 7149
Washington, D.C. 20548: