Tax Administration

IRS's 2003 Filing Season Performance Showed Improvements Gao ID: GAO-04-84 October 31, 2003

During the tax filing season, millions of taxpayers file their returns and seek assistance by calling or visiting IRS's offices or Web site. GAO was asked to assess IRS's 2003 filing season performance in five areas: processing returns, refunds and remittances; electronic filing; telephone service; walk-in assistance, and Web site. We assessed for each of those five areas (1) IRS's performance in 2003, including any factors that helped or impeded its efforts, (2) any new initiatives that were intended to improve IRS's performance in 2003, and (3) IRS's performance over past filing seasons.

Available data for each of five key filing season activities indicates that IRS's performance showed some improvements in 2003 compared to 2002 and IRS met or exceeded many of its 2003 performance goals. IRS processed returns and issued refunds more timely and accurately and increased the rate of electronic filing, although not at a rate that would allow IRS to meet its long-term goal. While IRS provided significantly more accessible telephone service, the accuracy rate of IRS responses declined. The accuracy of tax law assistance provided at walk-in sites improved, although the number of taxpayers assisted at IRS's walk-in sites declined, in part because taxpayers made greater use of the return-preparation assistance offered by volunteer organizations. In addition, IRS did not consolidate or disseminate data on how long taxpayers waited for walk-in assistance, making it difficult to balance quality and service. Finally, IRS's Web site performed well and was more user friendly than last year. IRS attributes improved performance, in part, to (1) fewer tax law changes that affected taxpayers and (2) continued emphasis on performance measures, a key part of IRS's strategy to improve its performance in processing returns and providing taxpayer assistance. IRS implemented initiatives in 2003 intended to improve filing season performance. For example, IRS entered into an agreement with a consortium of 17 tax preparation companies to offer free on-line tax preparation, established new toll-free telephone numbers to better target different taxpayers, and began certifying walk-in staff to answer tax law questions. Over a longer period of time, available data, although limited in some areas, also show that IRS's filing season performance has improved. Since the mid-1990s, the growth of electronic filing has allowed IRS to close one paper processing center and the accuracy and accessibility of telephone assistance has improved. While the Congress and taxpayers expect further progress, the improvements to date are a payoff from IRS's ongoing modernization.

Recommendations

Our recommendations from this work are listed below with a Contact for more information. Status will change from "In process" to "Open," "Closed - implemented," or "Closed - not implemented" based on our follow up work.

Director: Team: Phone:


GAO-04-84, Tax Administration: IRS's 2003 Filing Season Performance Showed Improvements This is the accessible text file for GAO report number GAO-04-84 entitled 'Tax Administration: IRS's 2003 Filing Season Performance Showed Improvements' which was released on October 31, 2003. This text file was formatted by the U.S. General Accounting Office (GAO) to be accessible to users with visual impairments, as part of a longer term project to improve GAO products' accessibility. Every attempt has been made to maintain the structural and data integrity of the original printed product. Accessibility features, such as text descriptions of tables, consecutively numbered footnotes placed at the end of the file, and the text of agency comment letters, are provided but may not exactly duplicate the presentation or format of the printed version. The portable document format (PDF) file is an exact electronic replica of the printed version. We welcome your feedback. Please E-mail your comments regarding the contents or accessibility features of this document to Webmaster@gao.gov. This is a work of the U.S. government and is not subject to copyright protection in the United States. It may be reproduced and distributed in its entirety without further permission from GAO. Because this work may contain copyrighted images or other material, permission from the copyright holder may be necessary if you wish to reproduce this material separately. Report to the Chairman, Subcommittee on Oversight, Committee on Ways and Means, House of Representatives: October 2003: Tax Administration: IRS's 2003 Filing Season Performance Showed Improvements: [Hyperlink, http://www.gao.gov/cgi-bin/getrpt?GAO-04-84] GAO-04-84: GAO Highlights: Highlights GAO-04-84, a report to Chairman, Subcommittee on Oversight, Committee on Ways and Means, House of Representatives Why GAO Did This Study: During the tax filing season, millions of taxpayers file their returns and seek assistance by calling or visiting IRS‘s offices or Web site. GAO was asked to assess IRS‘s 2003 filing season performance in five areas: processing returns, refunds and remittances; electronic filing; telephone service; walk-in assistance, and Web site. We assessed for each of those five areas (1) IRS‘s performance in 2003, including any factors that helped or impeded its efforts, (2) any new initiatives that were intended to improve IRS‘s performance in 2003, and (3) IRS‘s performance over past filing seasons. What GAO Found: Available data for each of five key filing season activities indicates that IRS‘s performance showed some improvements in 2003 compared to 2002 and IRS met or exceeded many of its 2003 performance goals. IRS processed returns and issued refunds more timely and accurately and increased the rate of electronic filing, although not at a rate that would allow IRS to meet its long-term goal. While IRS provided significantly more accessible telephone service, the accuracy rate of IRS responses declined. The accuracy of tax law assistance provided at walk-in sites improved, although the number of taxpayers assisted at IRS‘s walk-in sites declined, in part because taxpayers made greater use of the return-preparation assistance offered by volunteer organizations. In addition, IRS did not consolidate or disseminate data on how long taxpayers waited for walk-in assistance, making it difficult to balance quality and service. Finally, IRS‘s Web site performed well and was more user friendly than last year. IRS attributes improved performance, in part, to (1) fewer tax law changes that affected taxpayers and (2) continued emphasis on performance measures, a key part of IRS‘s strategy to improve its performance in processing returns and providing taxpayer assistance. IRS implemented initiatives in 2003 intended to improve filing season performance. For example, IRS entered into an agreement with a consortium of 17 tax preparation companies to offer free on-line tax preparation, established new toll-free telephone numbers to better target different taxpayers, and began certifying walk-in staff to answer tax law questions. Over a longer period of time, available data, although limited in some areas, also show that IRS‘s filing season performance has improved. Since the mid-1990s, the growth of electronic filing has allowed IRS to close one paper processing center and the accuracy and accessibility of telephone assistance has improved. While the Congress and taxpayers expect further progress, the improvements to date are a payoff from IRS‘s ongoing modernization. What GAO Recommends: GAO recommends that IRS consolidate and disseminate available wait- time information to field managers. In commenting on a draft of this report, IRS partially agreed with our recommendation, stating that it will require walk-in sites equipped with a system to report wait-time information quarterly and that this information would provide valuable data for assessing overall trends and relationships in timeliness and quality. However, IRS did not agree to disseminate this consolidated wait-time information to field managers, but without it, managers would have difficulty balancing timeliness and quality. www.gao.gov/cgi-bin/getrpt?GAO-04-84 To view the full product, including the scope and methodology, click on the link above. For more information, contact James R. White at (202) 512-9110 or whitej@gao.gov. [End of section] Contents: Letter: Results in Brief: Scope and Methodology: Background: IRS's Processing of Returns And Refunds Improved, and IRS Closed One Paper Processing Center: Electronic Filing Grew in 2003, but at Current Growth Rate IRS Will Not Achieve Long-Term Goal: Telephone Service Showed Improvement in Accessibility but Not Accuracy: Quality of Walk-In Assistance Improved in 2003, but Assessing Long-Term Improvements Is Difficult Because of Lack of Data: IRS's Web Site Performance Showed Some Improvement: Conclusions: Recommendation for Executive Action: Agency Comments and Our Evaluation: Appendixes: Appendix I: Data on IRS's Processing Performance Relative to Fiscal Year 2001-2003 Performance and Fiscal Year 2003 Goals: Appendix II: Advance Payment of Child Tax Credit Had Minimal Impact on 2003 Filing Season: Appendix III: Comments from the Internal Revenue Service: Appendix IV: GAO Contacts and Staff Acknowledgments: Tables: Table 1: IRS Tax Filing Season Telephone Assistance Performance, 2000- 2003 Filing Seasons: Table 2: IRS's 2001-2003 Tax Filing Season Processing Performance: Figures: Figure 1: IRS's Primary Activities During the 2003 Filing Season: Figure 2: Growth Rate in the Number of Individual Tax Returns Filed Electronically, 1996-2003: Figure 3: Projected Percentage of Individual Tax Returns Filed Electronically, 2004-2007: Figure 4: Reasons Taxpayers Called for Telephone Assistance during the 2003 Filing Season: Figure 5: How IRS Handled Calls for Telephone Assistance during 2003 Filing Season: Figure 6: Assistance Provided by IRS Walk-in and Volunteer Sites, 2000- 2003 Filing Seasons: Letter October 31, 2003: The Honorable Amo Houghton: Chairman, Subcommittee on Oversight: Committee on Ways and Means: House of Representatives: Dear Mr. Chairman: In response to your request, this report discusses the Internal Revenue Service's (IRS) performance during the 2003 tax filing season.[Footnote 1] It is during the filing season that most taxpayers have their only contact with IRS, filing their individual income tax returns, and if needed, seeking assistance or resolving simple problems, such as computational errors or missing Social Security numbers (SSN). Because of the millions of income tax returns processed and refunds issued and the crucial role that the filing season plays in the collection of revenue that finances the federal government, IRS's performance during the filing season is important to taxpayers and the Congress. This report discusses IRS's performance in five key filing season activities (1) processing individual income tax returns, refunds, and remittances; (2) receiving returns electronically; (3) assisting taxpayers over the telephone; (4) providing face-to-face assistance at its walk-in locations; and (5) providing services via its Internet Web site. For each of the five areas the report discusses (1) IRS's performance in 2003 compared to 2002 and 2003 goals, including any factors that significantly affected performance, (2) any new initiatives that were intended to improve IRS's performance in 2003, and (3) significant trends in IRS's performance over the past several years resulting from modernization efforts. Results in Brief: Overall, IRS's performance during the 2003 filing season improved compared to its performance in 2002 for each of the five filing season activities we reviewed, and IRS met many of its 2003 performance goals. However, the accuracy of telephone assistance declined, the growth of electronic filing is slowing, and the timeliness of walk-in assistance is unknown. Processing--IRS's performance improved in 2003 relative to 2002 for seven of the eight measures it uses to judge its performance in processing individual income tax returns, refunds, and remittances, and IRS exceeded most of its performance goals. Other evidence, such as testimony from representatives of the tax practitioner community, indicated IRS's processing performance was smooth and without significant disruptions. IRS officials attributed improvements in processing performance to efforts to build upon its largely successful 2002 filing season and the relatively small effect of tax law changes on taxpayers filing during the 2003 filing season. The growth of electronic filing and other improvements in processing returns, refunds, and remittances over the past several filing seasons has allowed IRS to eliminate paper processing at one location and reduce staff devoted to paper processing. Electronic Filing--The number of individual income tax returns that IRS received electronically continued to grow, from about 47 million in 2002 to an estimated 53 million in 2003, and the percentage of returns filed electronically reached an estimated 41 percent. However, the current rate of growth of electronic filing is slowing and will not allow IRS to achieve its long-term electronic filing goal of 80 percent by 2007, despite a number of initiatives over the years to reduce barriers and encourage more electronic filing. Electronic filing is important because it allows IRS to shift resources out of paper processing and improve customer service. Telephone Service--IRS performance data showed that it provided more accessible telephone service in 2003 and exceeded its 2003 performance goal for providing service to taxpayers trying to reach a Customer Service Representative (CSR). However, various measures show that IRS's performance in providing accurate responses to taxpayer questions declined, and IRS did not achieve most of its 2003 performance goals for accuracy. IRS implemented several initiatives in 2003--including the establishment of new toll-free telephone numbers targeting different types of taxpayers--that likely contributed to improved accessibility. Since the mid-1990s, IRS has significantly improved its telephone service. Although telephone service is not yet at the level desired by taxpayers and the Congress, the improvements to date represent a payoff from IRS's modernization efforts. Walk-in Assistance--The quality of services IRS provides at its walk-in sites showed some improvement in 2003, and IRS met some of its 2003 performance goals. For example, the accuracy of tax law assistance provided at walk-in sites improved from 2002 to 2003. In addition, IRS continued its initiative to shift return preparation work to its community-based coalitions and other volunteer organizations, contributing to a decline in the number of taxpayers assisted at IRS's walk-in sites. With respect to accessibility, IRS did not consolidate or disseminate available data to managers on how long taxpayers waited for assistance in 2003. Without such data, managers may not be able to balance the attention given to accuracy and accessibility. Over the last several years, IRS has made efforts to standardize and improve its walk-in assistance, but a lack of historical performance data makes it impossible for IRS and us to quantify improvements. Internet Web Site--Overall Web site usage increased in 2003, and the site performed well in terms of availability and average delivery time, according to an independent Web site rater. However, IRS's performance in responding to questions received via the Internet from taxpayers declined in 2003. IRS did resolve one of our key concerns from prior years about the search functions on the Web site, enabling taxpayers to find references to publications more easily. Also, in a major initiative in 2003, IRS provided the capability for taxpayers to check the status of their refunds on-line for the first time, and 11 million taxpayers did so. Over the past several filing seasons, usage of IRS's Web site and the number of services provided have increased. The increases are another example of payoffs from IRS's ongoing modernization effort. We are making a recommendation to the Commissioner of Internal Revenue that IRS consolidate and disseminate wait-time information to field managers on the basis of information from walk-in sites equipped with an automated system that can capture wait-time data in order to assess this important aspect of quality. In commenting on a draft of this report (see app. III), the Commissioner of Internal Revenue partially agreed with our recommendation, stating that IRS will require walk-in sites equipped with Q-Matic to report wait-time information quarterly. However, the Commissioner did not agree to disseminate this consolidated wait-time information to field managers. For years, as we report, IRS has contended that past experience has shown that employee reaction to timeliness measures adversely affected quality. At the same time, the Commissioner noted that some monitoring of wait time occurs by local managers for walk-in sites equipped with the automated reporting system. However, routine monitoring does not provide overall performance data, and data is only available to some managers whose walk-in sites have the automated system. In our view, there needs to be a balance between measuring quality and timeliness, and too much focus on either could create inappropriate incentives for IRS's walk-in staff. As noted in our report, timeliness is part of IRS's suite of balanced measures for telephone performance. We agree that too much focus on timeliness could create inappropriate incentives for IRS's walk-in staff, but without consolidated timeliness information, field managers would have a difficult time balancing quality and timeliness. We discuss the Commissioner's comments in the "Agency Comments and Our Evaluation" section of the report. Scope and Methodology: Our assessment of IRS's 2003 filing season performance was based on analyses of IRS data and data obtained from sources outside IRS, interviews with IRS officials and private sector tax preparers, and observations of IRS operations. We testified before the Subcommittee on Oversight on the interim results of our assessment in April 2003.[Footnote 2] Our assessment of filing season performance over a longer period of time was based, in part, on our past filing season reports. To assess IRS's performance in the five key filing season activities covered by this report, we: * reviewed and analyzed IRS documents and data, including workload data and data from IRS's current suite of balanced performance measures, which we used to assess performance this year and relative to 2003 goals;[Footnote 3] * reviewed historical data that preceded the current performance measures to assess longer term improvements and performance; * interviewed IRS officials about current operations, performance relative to the past filing season and 2003 performance goals, and significant factors and initiatives that affected performance; * observed operations at two of the eight processing centers operated by IRS's Wage and Investment Operating Division (W&I) and three of IRS's walk-in locations; * observed operations at three sites that offer free return preparation as part of IRS's Volunteer Income Tax Assistance (VITA) and Tax Counseling for the Elderly (TCE) programs; * analyzed information posted to IRS's Internet Web site, specifically assessing the ease of finding information on the site (i.e., navigation) and the accuracy and currency of data on the site (i.e., content) based on our work reviewing IRS's Web site for years and as experienced Internet Web users; * reviewed information from a recognized authority on Internet performance that assessed various aspects of IRS's Web site; * interviewed representatives of various large private organizations that prepare tax returns and trade organizations that represent both individual preparers and tax preparation companies; * reviewed staff year data for the paper processing, telephone assistance, and walk-in assistance activities; and: * reviewed related congressional testimony and work performed by the Treasury Inspector General for Tax Administration (TIGTA). This report discusses performance measures that reflect the continuing interest of the Subcommittee--including the quality, accessibility, and timeliness of IRS's performance during the filing season. In November 2002, we assessed the methodologies IRS used for computing its current suite of performance measures and the appropriateness of the performance goals.[Footnote 4] At that time, we reported that some of the performance measures that IRS and we use to assess various aspects of IRS's filing season performance had attributes of successful performance measures including objectivity and reliability, although in some cases, the measures could be further refined. Even recognizing the limitation of these measures, we have determined that the data we are reporting are sufficiently reliable and useful for assessing IRS's filing season performance. We did our work at IRS headquarters in Washington, D.C; W&I headquarters and the Joint Operations Center in Atlanta, Ga;[Footnote 5] and W&I processing centers in Atlanta, Ga, and Holtsville, N.Y; and walk-in and volunteer locations in Georgia and Louisiana. We selected these offices for a variety of reasons, including the location of key IRS managers and operations. We also selected the Brookhaven Submission Processing Center to visit because IRS was phasing out processing operations at that center, which represents a significant initiative related to both paper processing and electronic filing. We performed our work from January through September 2003 in accordance with generally accepted government auditing standards. Background: IRS's filing season is an enormous and critical undertaking that includes two key activities--returns processing and taxpayer assistance. As figure 1 shows, during the 2003 filing season, IRS processed an estimated 77 million individual income tax returns filed on paper, an estimated 53 million returns filed electronically, and issued an estimated 99 million refunds to taxpayers. At the same time, IRS provided extensive assistance to millions of taxpayers via phone, walk-in contact, and over its Web site. Figure 1: IRS's Primary Activities During the 2003 Filing Season: [See PDF for image] Note: GAO analysis of IRS data. The number of paper and electronic returns and refunds are estimated for the time period January 1, 2003, to October 24, 2003; toll-free calls for the time period January 1, 2003, to July 12, 2003; walk-in contacts, which include returns prepared at volunteer sites, for the time period January 1, 2003, to April 19, 2003; and Internet downloads for the time period January 1, 2003, to July 31, 2003. We use different dates for the various areas because those dates best reflect IRS's filing season workload in that area. [End of figure] To process individual returns in 2003, IRS had eight geographically dispersed W&I submission processing centers that were responsible for processing returns filed on paper, three of which were also responsible for processing tax returns filed electronically; correcting errors made on tax returns; and forwarding the data through a data processing and telecommunications infrastructure to two computing centers, which maintain IRS's primary taxpayer account databases. To help taxpayers comply with their tax obligations, IRS provides various services at its call sites, walk-in sites, volunteer sites, and on the Web site. For example, taxpayers can call IRS toll-free to get answers to tax law questions and order tax forms and publications; get information or help in preparing their returns at IRS walk-in sites; get their returns prepared at community-based coalition and other volunteer organization sites in partnership with IRS; and get information, including answers to tax law questions, through IRS's Web site. Since the IRS Restructuring and Reform Act of 1998[Footnote 6] (RRA 98), IRS has been particularly focused on improving taxpayer service. To help achieve this, in 2001, IRS established a suite of balanced performance measurements in accordance with RRA 98 and the Government Performance and Results Act of 1993.[Footnote 7] The performance measurement system emphasizes accountability for achieving specific results and reflects IRS's priorities, which are articulated in its mission and strategic goals--top quality service to all taxpayers through fair and uniform application of the law, top quality service to each taxpayer in every interaction, and productivity through a quality work environment. IRS has defined three elements of balanced measures to ensure balance among its priorities, such as providing timely and accurate service: (1) customer satisfaction, (2) employee satisfaction, and (3) business results (quality and quantity measures). IRS establishes goals each fiscal year for its performance measures and uses them to hold managers and frontline staff more accountable for improving filing season performance.[Footnote 8] IRS's W& I operating division is one of four divisions that IRS established as part of a reorganization that took effect in October 2000. The other three divisions are Small Business and Self-Employed, Large and Mid-Size Businesses, and Tax Exempt and Government Entities. IRS's Processing of Returns And Refunds Improved, and IRS Closed One Paper Processing Center: We found that on the basis of a comparison of IRS's performance in 2003 and 2002, IRS's processing of individual income tax returns and refunds generally improved in 2003 and IRS exceeded most of its 2003 processing goals. In addition, the growth in electronic filing has enabled IRS to close paper processing operations at one location and reduce the total number of staff devoted to paper processing. Processing Performance Improved in 2003 Compared To Last Year: IRS's performance improved in 2003 relative to 2002 for seven of the eight measures that are part of its suite of balanced measures it uses to judge its performance in processing individual income tax returns, refunds, and remittances.[Footnote 9] For example, IRS's measure of the percentage of refunds on returns filed on paper issued within 40 days or less (refund timeliness--paper) increased from 98.2 percent in 2002 to 98.8 percent in 2003. In addition, IRS's measure of the percentage of notices issued to taxpayers that had an error on the notice (notice error rate) decreased from 18.7 percent in 2002 to 9.7 percent in 2003. IRS also exceeded its fiscal year 2003 performance goals for five of the eight measures (including refund timeliness--paper), although it missed its goals for two measures (deposit error rate and letter error rate). We could not compare performance for one measure (refund interest paid) to prior years or its 2003 performance goal, because IRS implemented a programming change that changed the way it calculated the measure for the 2003 filing season and did not have the necessary data to revise the goal for the 2003 filing season. Table 2 in appendix I describes these eight measures and shows the results IRS reported for each of the measures. Other information supports the conclusion that the 2003 filing season went smoothly and without significant disruptions, as the following examples illustrate. * Production data that IRS uses to monitor operations and identify and resolve issues that could disrupt operations showed IRS met processing deadlines and did not experience significant disruptions in 2003. These data showed that, on average, IRS met or exceeded its goal for the number of days it takes to process individual income tax returns. * Directors, managers, and staff at the Atlanta and Brookhaven Submission Processing centers voiced similarly positive views about the filing season and processing, and the Director of Submission Processing attributed improvements during the 2003 filing season to efforts to build upon a largely successful 2002 filing season and the small effect of tax law changes on taxpayers during the 2003 filing season. Appendix II provides more detailed information about the Jobs and Growth Tax Relief Reconciliation Act of 2003[Footnote 10] and its impact on the 2003 filing season and potential impact in 2004. * The Commissioner of IRS testified in May 2003, before the annual Joint Congressional Review held as part of RRA 98, that IRS had made progress during the 2003 filing season, although he acknowledged that IRS has yet to provide the level of service that taxpayers, the Congress, and IRS agree is necessary. * The then Acting Commissioner of Internal Revenue testified in April 2003 before the Subcommittee that, among other things, the filing season was going smoothly, with no significant delays in processing returns and issuing refunds. Representatives from the National Association of Enrolled Agents,[Footnote 11] National Association of Accountants, and H&R Block--the largest tax preparation firm--all expressed positive feedback about IRS's processing operations during this filing season. * According to TIGTA's report on the 2003 filing season, IRS processed most returns accurately and on time and the filing season went well.[Footnote 12] TIGTA reported that most of the key tax law changes that affected taxpayers in 2003 were correctly implemented or subsequently corrected after processing began. However, TIGTA identified some areas of the tax laws that were not correctly implemented and could result in loss of taxpayer entitlements and erroneous tax assessments.[Footnote 13] Closing of Paper Processing Operations at One Center Is a Key Initiative and Represents Payoff From Modernization: The growth in electronic filing and resulting reduction in the number of paper returns received in recent years has enabled IRS to close the paper processing operations at its Brookhaven Submission Processing Center--one of its eight centers for processing individual income tax returns filed on paper. The closure is a key processing initiative in 2003. IRS's long-term strategy for paper processing is to continue closing its processing centers as electronic filing grows and shift the processing of paper returns to the remaining centers. IRS picked Brookhaven for the initial closure based on several factors, including paper return volume, personnel costs, labor availability, and real estate costs. As we noted in our interim testimony on IRS's filing season performance, this closing represents a significant consolidation of IRS's processing operations and a key payoff from modernization, specifically the growth in electronic filing.[Footnote 14] IRS officials attributed not meeting the goal for the percentage of letters issued to taxpayers with errors (letter error rate), in part, to the loss of experienced and knowledgeable personnel as a result of IRS's announcement that it would be closing some processing centers. In addition to closing paper processing operations at one of its centers, IRS has seen other improvements in its processing operations over the past several filing seasons. For example, in 1996, the average number of days it took processing centers to process individual tax returns ranged between 8 and 11 days. In 2003, the average number of days ranged between 6 and 8 days. In addition, IRS's measure of the percentage of refunds with IRS-caused errors in the entity information (e.g., name or Social Security number) or refund amount declined from 9.8 percent in 2001 to 5.4 percent in 2003. IRS officials also told us that, since 2001, the eight submission processing centers that process individual tax returns each met or exceeded the established deposit program completion date--the date by which the processing centers must finish processing all tax receipts associated with the April peak processing period. According to IRS officials, the improvements in processing performance have resulted from a combination of factors, including better data processing equipment and more emphasis on performance management. For example, in the late 1990s, IRS began replacing two key data processing systems, which allowed for faster processing. In addition, IRS officials told us that they now rely more heavily on technology to communicate with employees, which they believe allows for faster and more accurate dissemination of information from headquarters to field staff and vice versa. As a result of RRA 98, IRS also has stressed the importance of reaching the goals for its balanced measures as compared to prior years, when IRS placed less importance on these types of measures. The improvements in processing performance also have enabled IRS to reduce the number of staff devoted to its paper processing operations, while employee satisfaction has increased. According to IRS officials, the number of staff years used in paper processing operations has decreased from 11,542 in fiscal year 2001 to 10,619 in fiscal year 2003, a decrease of about 8 percent.[Footnote 15] At the same time, the level of employee satisfaction has increased, as 63 percent of the staff assigned to processing expressed being satisfied with their job in 2003, an increase from 54 percent in 2001. Electronic Filing Grew in 2003, but at Current Growth Rate IRS Will Not Achieve Long-Term Goal: The number of individual income tax returns that IRS received electronically continued to grow and IRS met its goal for the percentage of returns filed electronically. However, the current rate of growth of electronic filing will not allow IRS to achieve its long- term electronic filing goal of 80 percent by 2007,[Footnote 16] despite numerous initiatives to reduce barriers to and encourage more electronic filing. Despite Growth in Electronic Filing In 2003, IRS is Not on Track to Achieve Its Long-Term Goal: The number of individual returns filed electronically continued to grow in 2003. IRS received an estimated 53 million individual tax returns electronically in 2003, an increase of about 13 percent from 46.9 million in 2002. The percentage of individual tax returns filed electronically reached an estimated 41 percent in 2003, up from 35.9 percent in 2002. While the number of tax returns filed electronically in 2003 fell just short of IRS's performance goal of 54 million, IRS met its performance goal for the percentage of individual tax returns filed electronically. Although electronic filing continues to grow, IRS is not on track to reach its long-term electronic filing goal of 80 percent by 2007. As figure 2 shows, the growth rate from 1996 through 2003 has generally been decreasing. More significantly, the growth rate in 2003 represents the smallest percentage increase in the number of individual tax returns filed electronically since 1996. Some slowing of the growth rate might be expected because, for example, taxpayers most easily attracted to electronic filing have already converted. Figure 2: Growth Rate in the Number of Individual Tax Returns Filed Electronically, 1996-2003: [See PDF for image] Note: GAO analysis of IRS data. The growth rate for 2003 is estimated. [End of figure] The current growth rate will not enable IRS to meet its long-term goals. We estimate, on the basis of the data in figure 3, that about 64 percent of individual tax returns will be filed electronically by 2007, assuming annual growth rates for individual tax returns filed electronically (about 13 percent) and total number of individual tax returns filed (0.66 percent)[Footnote 17] continue through 2007. IRS estimated an even lower percentage (54.4 percent) of returns would be filed electronically by 2007.[Footnote 18] In order to achieve the long-term goal of 80 percent, IRS would have to average more than a 19 percent growth rate in electronic filing from 2004 to 2007. However, in its June 30, 2003, report to the Congress, the Electronic Tax Administration Advisory Committee (ETAAC) [Footnote 19] said that the trend of electronic filing is clearly toward lower annual growth rates and as a result, IRS will have difficulty achieving its long-term goal unless it finds additional ways to overcome taxpayer and tax practitioner barriers to electronic filing. To the extent that IRS misses the goal, more resources will have to be devoted to processing paper returns. Figure 3: Projected Percentage of Individual Tax Returns Filed Electronically, 2004-2007: [See PDF for image] Note: GAO analysis of IRS data. [End of figure] IRS Has Taken Various Steps to Encourage More Electronic Filing, which Is Key to Continued Modernization: In 2003, IRS took various steps to encourage taxpayers and practitioners to file electronically. These steps included the following: * IRS entered into an agreement with the Free File Alliance, a consortium of 17 tax preparation companies, which requires the Alliance to offer free on-line tax preparation and filing services for at least 60 percent (78 million) of all taxpayers during the filing season. Taxpayers access the Alliance from a link on IRS's Web site. As of July 31, 2003, about 2.8 million taxpayers used the free on-line filing services offered by the Alliance, which exceeded IRS's goal of 2.5 million taxpayers.[Footnote 20] However, IRS officials estimated that only about 1 million of these taxpayers were filing electronically for the first time. * IRS continued to focus the electronic filing marketing campaign on taxpayers and practitioners who file computer-prepared tax returns on paper. In 2003, IRS planned to spend $15 million, the same as the marketing budget in 2002. * IRS mailed a package to about 32,000 tax practitioners who prepare either some or all of their tax returns over the computer but submit paper tax returns. The package explains the benefits of electronic filing and encourages taxpayers to file all of their tax returns electronically. This built on an initiative last year where IRS sent letters to selected tax practitioners to encourage them to file returns electronically. According to IRS officials, these steps contributed to the growth in the number of returns filed electronically in 2003; however, the officials told us that they were unable to link the initiatives to a specific increase in the growth of individual returns filed electronically, with the exception of the Free File initiative. The growth of electronic filing has been, and continues to be, a key part of IRS's modernization strategy because it allows IRS to control costs, shift resources out of labor-intensive paper return processing, improve customer service, and as previously discussed, consolidate submission processing operations at fewer centers. Electronic filing has grown from almost 12 million returns in 1995 to an estimated 53 million in 2003, due to numerous initiatives implemented over the years. For example, in 1999, IRS made electronic filing more appealing by enabling taxpayers who owe money to pay their balance due either by credit card or by direct debit from a checking or saving account. Also, in response to concerns voiced by practitioners that electronic filing was not entirely paperless, IRS began testing alternative signature options that allowed certain electronic filers to sign their returns electronically and thus avoid having to send any paper to IRS and expanded those initiatives in 2000. Additionally, each year IRS has expanded the list of forms and schedules that can be filed electronically. As a result, according to IRS, 99 percent of all individual forms and schedules can be filed electronically today. Telephone Service Showed Improvement in Accessibility but Not Accuracy: IRS provided more accessible telephone service in 2003; however, its performance in providing accurate responses to taxpayers declined, and IRS did not achieve most of its 2003 performance goals, primarily related to accuracy. IRS implemented several initiatives in 2003 that likely contributed to improved accessibility. Over a longer period of time, IRS has significantly improved both the accessibility and accuracy of its telephone service, which represents a payoff from its modernization efforts. Telephone Service Was More Accessible, Although Not More Accurate in 2003: IRS receives millions of calls to its toll-free network during the filing season when taxpayers, inquire about tax law issues, the status of their refunds, or issues regarding their accounts, among other things. As figure 4 shows, IRS received about 72 million calls in 2003, about 31 percent fewer calls than it received in 2002. Figure 4 also shows that calls about the status of refunds accounted for almost half of total calls received through mid-July 2003. Figure 4: Reasons Taxpayers Called for Telephone Assistance during the 2003 Filing Season: [See PDF for image] Note: GAO analysis of IRS data. The "Other" category includes special telephone numbers, such as the one for victims of the September 11, 2001, terrorist actions, and calls that were abandoned or that reach a busy signal from IRS's automated-service-only (TeleTax) number. In this figure, total calls to IRS refer to the number of callers that tried to reach a Customer Service Representative (CSR) or IRS's TeleTax number. Data cover January 1 through July 12, 2003. [End of figure] Figure 5 shows that of the 72 million calls to IRS during the 2003 filing season (1) less than half of the calls resulted in the caller receiving automated service, (2) about one third of the calls were handled by a Customer Service Representative (CSR), and (3) about one fourth of the calls resulted in the caller hanging up or being disconnected without receiving service. Figure 5: How IRS Handled Calls for Telephone Assistance during 2003 Filing Season: [See PDF for image] Note: GAO analysis of IRS data. [End of figure] IRS's overall performance in answering calls during the 2003 filing season was mixed. As table 1 shows, IRS provided more accessible telephone service in 2003 compared to 2002 as (1) a greater percentage of callers attempting to reach a CSR received service, (2) a greater percentage of callers attempting to access automated service completed their calls, (3) a greater percentage of callers reached a CSR within IRS's threshold of 30 seconds or less, and (4) callers spent less time waiting for assistance on average. However, table 1 also shows that IRS's performance on various accuracy measures declined in 2003 as compared to 2002. Table 1: IRS Tax Filing Season Telephone Assistance Performance, 2000- 2003 Filing Seasons: Accessibility measures[A]: CSR level of service[B]; 2000: Actual: [J]; 2001: Actual: 68%; 2002: Actual: 71%; 2003: Actual: 85%; Goals: 72%. Accessibility measures[A]: Automated completion rate[C]; 2000: Actual: 47%; 2001: Actual: 47%; 2002: Actual: 36%; 2003: Actual: 59%; Goals: N/ A[K]. Accessibility measures[A]: Assistor response level[D]; 2000: Actual: 39%; 2001: Actual: 39%; 2002: Actual: 51%; 2003: Actual: 56%; Goals: N/ A[K]. Accessibility measures[A]: Average speed of answer[E]; 2000: Actual: 237 seconds; 2001: Actual: 337 seconds; 2002: Actual: 268 seconds; 2003: Actual: 159 seconds; Goals: N/A[K]. Accessibility measures[A]: Accuracy measures[A]; 2000: Actual: 2001: Actual: 2002: Actual: 2003: Actual: Goals: [Empty]. Accessibility measures[A]: Tax law quality rate[F]; 2000: Actual: 73%; +/-2%; 2001: Actual: 75%; +/-1%; 2002: Actual: 82%; +/-1%; 2003: Actual: 80%; +/-1%; Goals: 84%. Accessibility measures[A]: Accounts quality rate[F]; 2000: Actual: 59%; +/-2%; 2001: Actual: 69%; +/-1%; 2002: Actual: 76%; +/-1%; 2003: Actual: 70%; +/-1%; Goals: 76%. Accessibility measures[A]: Tax law customer accuracy rate[G]; 2000: Actual: [J]; 2001: Actual: 79%; +/-1%; 2002: Actual: 85%; +/-1%; 2003: Actual: 81%; +/-1%; Goals: 87%. Accessibility measures[A]: Accounts customer accuracy rate[G]; 2000: Actual: [J]; 2001: Actual: 88%; +/-1%; 2002: Actual: 91%; +/-1%; 2003: Actual: 89%; +/-1%; Goals: 91%. Accessibility measures[A]: Tax law timeliness rate[H]; 2000: Actual: [J]; 2001: Actual: [J]; 2002: Actual: [J]; 2003: Actual: 99%; +/-1%; Goals: N/A[K]. Accessibility measures[A]: Accounts timeliness rate[H]; 2000: Actual: [J]; 2001: Actual: [J]; 2002: Actual: [J]; 2003: Actual: 97%; +/-1%; Goals: N/A[K]. Accessibility measures[A]: Tax law professionalism rate[I]; 2000: Actual: [J]; 2001: Actual: [J]; 2002: Actual: [J]; 2003: Actual: 100%; +/-1%; Goals: N/A[K]. Accessibility measures[A]: Account professionalism rate[I]; 2000: Actual: [J]; 2001: Actual: [J]; 2002: Actual: [J]; 2003: Actual: 100%; +/-1%; Goals: N/A[K]. Source: IRS. [A] Accessibility measures are based on actual counts from January 1 through mid-July. Accuracy measures are based on representative samples and are estimated at the 90-percent confidence level and cover the period from January through June. BThis measure is intended to show the percentage of callers who wanted to speak to a customer service representative (CSR) that got through and received service. CThis measure is intended to show the percentage of total callers who completed a selected automated service. IRS did not establish a goal for 2003 because the indicator is not an official measure. DIRS uses the word "assistor" interchangeably with CSR. This measure shows the percentage of callers that waited 30 seconds or less before speaking to a CSR. IRS did not establish a goal for 2003 because the indicator is not an official measure. [E] The average number of seconds callers waited before speaking to a CSR. IRS did not establish a goal for 2003 because the indicator is not an official measure. [F] The percentage of calls in which CSRs followed all IRS procedures for the call type and provided correct answers. [G] The percentage of calls in which CSRs provided correct answers for the call type and took the appropriate follow-up resolution action. [H] The percentage of calls in which CSRs used their time efficiently when responding to taxpayers inquires. IRS did not establish goals for 2003 for these measures because they were new in 2003. [I] The percentage of calls in which CSRs used effective communication techniques to promote a positive IRS image when responding to taxpayer inquires. IRS did not establish goals for 2003 for these measures, because they were new in 2003. [J] Comparable data do not exist. [K] Not applicable. [End of table] IRS exceeded its goal for CSR level of service during the 2003 filing season. However, IRS did not set goals for the three other workload indicators of accessibility shown in table 1 because it did not consider these indicators to be performance measures. We believe these three indicators are important because they measure taxpayers' access to automated service and gauge the taxpayer's experience when attempting to reach a CSR.[Footnote 21] As we reported in November 2002, IRS removed the automated completion rate as a measure of the effectiveness of serving taxpayers through automation.[Footnote 22] IRS did not agree with our recommendation to reinstate this measure as a means of determining the level of service provided by automation.[Footnote 23] In December 2002, we also reported that IRS stopped using the assistor response level and average speed of answer measures to assess its performance in providing telephone service because IRS's telephone call sites had no control over these measures.[Footnote 24] In response to our recommendation that IRS reinstate a telephone assistance caller wait-time measure, IRS plans to reintroduce a wait-time measure for fiscal year 2004. This measure-- average speed of answer--is intended to gauge the customer's experience when attempting to reach a CSR. IRS officials attributed the improvement in the accessibility of telephone service to several factors. For example, IRS experienced a lower than expected number of calls in 2003--about 72 million calls received in 2003 as compared to more than 104 million in 2002. IRS officials told us that there were relatively few tax law changes that had an impact on taxpayers during the 2003 filing season as compared to last year, when IRS received a significant number of calls related to the rate reduction credit. Another possible reason for the improvement in accessibility could be the fact that IRS began using CSRs to route tax law related calls in 2003. IRS made this change because in 2002 (1) some callers spent up to 2 minutes navigating the menu options, (2) other callers spent up to 3 minutes talking to one CSR only to be transferred to another CSR for assistance, and (3) more than 50 percent of the calls received by CSRs were re-routed to other CSRs for some tax law topics. IRS officials told us that they made this change to improve performance during the filing season and improve the customer experience since many customers with tax-law-related calls had difficulty using the menu options. IRS did not meet its goals for any of its accuracy measures during the 2003 filing season, and its performance relative to these measures declined compared to last year. IRS also began establishing baseline data for four new accuracy measures and has not yet set goals for these measures. These new measures assess how well CSRs manage their time and whether CSRs promote a positive IRS image when communicating with telephone callers. IRS plans to replace its existing tax law and account quality measures and use the new timeliness and professionalism measures and current customer accuracy measures to assess the accuracy of its performance in providing telephone assistance beginning in fiscal year 2004. According to IRS, the new timeliness and professionalism measures are based on what customers indicated mattered most to them and they are designed with consideration to industry best practices. Although IRS began an analysis to determine whether there is a correlation between how IRS rates its CSRs on these new measures and how taxpayers report being treated in the customer satisfaction surveys, the analysis was not completed when we completed our field work. IRS attributed the lack of improvement in the accuracy of telephone service to several factors. For example, IRS officials attributed the decline in the accounts quality rate to the training of newly hired CSRs on account-related topics instead of the easier refund topics. In addition, with the introduction of the Internet "Where's My Refund" feature, IRS received fewer refund inquires, which resulted in more complex calls being answered by CSRs. This feature is discussed in more detail in the "IRS's Web Site Performance Showed Some Improvement" section. IRS identified several items that contributed to the decrease in the tax law customer accuracy rate, including the fact that CSRs had difficulty adapting to the changes in the guide they use to query callers. IRS officials also said another explanation for the lack of improvement in providing accurate information to callers is that some of IRS's telephone call sites were transferred from one operating division to another division, which resulted in CSRs moving from one area of expertise to another area and needing to be retrained. IRS Implemented Several Initiatives in 2003 to Improve Telephone Service: IRS implemented several initiatives to improve telephone service in 2003. According to IRS officials, these initiatives were instrumental in IRS improving access to telephone service during the 2003 filing season, although it is difficult to determine specific cause/effect relationships between the initiatives and improvements in telephone service. Examples include the following. * IRS established six new toll-free telephone numbers to better reflect operating division responsibility and accountability--the Refund Hotline, Refund Callback Line, Business and Specialty Tax Line, and three new customer response numbers. These new numbers are part of IRS's new toll-free strategy to improve the customer's experience by targeting customer segments and creating more accountability for the operating divisions. According to IRS officials, the three new customer response numbers replaced one number that IRS used in the past and more closely correspond to the operating division responsible for a particular notice. * IRS implemented a new feature on its Web site that enabled taxpayers to find out if IRS received their returns and whether their refunds had been processed, as discussed in the "IRS's Web Site Performance Showed Some Improvement" section of this report. The new feature provides taxpayers with another option to receive assistance while reducing the demand for toll-free refund calls. According to IRS's analysis for the period of January 1 to June 30, 2003, this new feature handled 32 percent of all IRS contacts from taxpayers with refund questions and reduced the toll-free refund call demand. Telephone Service Has Improved over the Past Several Filing Season Partly as a Result of Modernization: Since the mid-1990s, IRS has significantly improved its telephone service. Although telephone service is not yet at the level desired by taxpayers and the Congress, the improvements to date represent payoffs from IRS's modernization efforts. For example, in 1997, about 49 percent of calls to IRS primary assistance lines either received a busy signal or were abandoned before being answered, as compared to about 32 percent of calls in 2003. In addition, the percentage of calls where taxpayers attempted to reach a CSR and received service increased from about 68 to 85 percent between the 2001 and 2003 filing seasons. With regard to accuracy, the percentage of tax-law-related calls in which CSRs followed all IRS procedures and provided the correct answer increased from 73 percent in 2000 to 80 percent in 2003, while the percentage of account-related-calls in which CSRs followed all IRS procedures and provided the correct answer also increased from 59 to 70 percent between the 2000 and 2003 filing seasons. IRS's telephone service improvements over the years are, in part, the result of numerous modernization initiatives sustained over time, although limited data exist to link specific initiatives to improvements. In 1998, IRS revised its method of distributing calls, shifting from an area-code-based routing system to a nationwide call allocation system. In 1999, IRS centralized its toll-free telephone operation at the Joint Operations Center to enable it to route calls on the basis of availability of CSRs. Similarly, from 2000 through 2003, IRS made several business process changes and implemented new technology. For example, in 2001, IRS shifted millions of calls to an automated answering system in order to free CSRs to answer more complex calls. IRS also enhanced its call routing ability in 2002 by implementing "network call screening" where callers, through the use of menu options, indicated their subject matter prior to being routed to a call site. Regarding accuracy, IRS began centralized monitoring of account-and tax-law-related calls in 1998. In addition, a desktop electronic version of IRS's guide used to answer tax-law-related questions was made available to all CSRs. The guide has been improved and now contains automated links to on-line research material. Using this same technology, in 2002, IRS automated the guide that CSRs use to answer account-related questions. Finally, because of modernization, IRS's telephone service has improved over the years while maintaining about the same workforce level in its telephone operations. For example, IRS expended about 8,285 staff years in fiscal year 1999 providing toll-free telephone service compared to 8,340 staff years in fiscal year 2002. Quality of Walk-In Assistance Improved in 2003, but Assessing Long-Term Improvements Is Difficult Because of Lack of Data: The quality of service provided at IRS's walk-in sites showed some improvement in 2003, and IRS met some of its 2003 performance goals.[Footnote 25] In addition, IRS continued its initiative to shift return preparation work to its community-based coalitions and other volunteer organizations, which contributed to a decline in the number of taxpayers assisted at IRS's walk-in sites. However, our assessment was limited by the fact that IRS did not report performance for the timeliness of walk-in assistance or the accuracy of account assistance in 2003. Over the last several years, IRS has made efforts to standardize and improve walk-in assistance, but a lack of long-term performance data makes it impossible to quantify improvements. Tax Law Accuracy and Volunteer Assistance Increased in 2003, but IRS Did Not Report on Timeliness and Account Assistance: The accuracy of tax law assistance provided at walk-in sites improved between 2002 and 2003 on the basis of reviews conducted by TIGTA.[Footnote 26] From January through April 2003, TIGTA found that about 70 percent of its questions were answered correctly, an increase of 20 percentage points over the same time period last year, but less than IRS's 2003 performance goal of 80 percent. TIGTA also found that the number of times IRS employees referred TIGTA auditors to a publication instead of answering tax law questions--which had been an issue last year--declined by about 87 percent. TIGTA attributed the increased accuracy rates to IRS (1) revising the guidelines used by walk-in staff, (2) certifying the proficiency of walk-in staff in various tax law categories, and (3) immediately addressing the results of TIGTA reviews at walk-in sites. As they did last year, field assistance officials continue to disagree with the methodology used by TIGTA to calculate tax law accuracy because TIGTA counts referrals to IRS publications as incorrect.[Footnote 27] However, as we stated last year, we believe that the complexity of tax laws and varying education levels among taxpayers seeking assistance suggest that requiring field assistance employees to walk the taxpayer through a publication to identify the correct response is a necessary procedure that should be followed in practice for their response to be considered correct.[Footnote 28] In addition to TIGTA reviews of tax law accuracy, IRS began measuring the accuracy of return preparation assistance provided at walk-in sites in January 2003, using existing data generated by the submission processing centers.[Footnote 29] IRS data shows that from January 1 to May 3, 2003, the accuracy rate for returns prepared at walk-in sites was 99.8 percent, which exceeded IRS's performance goal of 91 percent. IRS officials attributed the high accuracy rate to the use of standardized software by walk-in staff to prepare and electronically file returns and the lack of significant tax law changes in 2003 as compared to last year. IRS also partners with community-based coalitions--a collection of local organizations that help low-income individuals and families--and other volunteer organizations to provide free return preparation assistance to taxpayers as part of its VITA and TCE programs.[Footnote 30] According to IRS officials, from January 1 to April 19, 2003, the accuracy rate for returns prepared at VITA sites was 98.1 percent and 96.5 percent for returns prepared at TCE sites. In 2003, the number of taxpayers that received return preparation assistance from community-based coalitions and other volunteer organizations increased; at the same time, the number of taxpayers assisted at IRS's walk-in sites continued to decline. Figure 6 shows the growth in the number of returns prepared by community-based coalitions and other organizations, a decline in the number of taxpayers receiving assistance at IRS walk-in sites, and a decline in the number of returns prepared at IRS walk-in sites.[Footnote 31] Figure 6: Assistance Provided by IRS Walk-in and Volunteer Sites, 2000- 2003 Filing Seasons: [See PDF for image] Note: GAO analysis based on IRS data. Total walk-in includes all face- to-face assistance. It does not include the number of taxpayers assisted by walk-in employees via telephone or correspondence, which ranged from about 96,000 in 2000 to over 150,000 in 2003. The number of returns prepared at volunteer sites was not available for the 2000 filing season. The time periods covered by this figure each began on January 1 and ended on April 22, 2000, April 21, 2001, April 20, 2002, and April 19, 2003. [End of figure] IRS officials attributed the overall decline in the number of taxpayers receiving assistance at walk-in sites to (1) IRS's strategy to reduce the amount of return preparation assistance offered at walk-in sites,[Footnote 32] (2) taxpayers use of more convenient means to obtain services that do not require face-to-face contact, such as through IRS's toll-free network and Web site, and (3) the increasing number of taxpayers that receive return preparation assistance at community-based coalitions and other organizations as part of IRS's VITA and TCE programs.[Footnote 33] These officials also told us that the decline in the number of taxpayers assisted at walk-in sites helped IRS reduce its reliance on compliance staff. Traditionally, IRS has detailed staff from its compliance functions, such as Examination and Collection, to help provide walk-in assistance. In 2003, IRS was able to reduce the number of compliance staff that helped to provide walk-in assistance during the filing season by about 118 staff years (66 percent) during the filing season. IRS also reduced the total number of staff years used to provide walk-in assistance during the 2003 filing season by about 14 percent as compared to the same time period in 2002. IRS did not report performance for two key indicators of walk-in service in 2003--timeliness and accuracy of account assistance. For years, IRS officials have contended that, when timeliness is monitored at its walk-in sites, employees have felt in a hurry to provide assistance to taxpayers, which could diminish quality. As a result, IRS discontinued wait time as an official measure of field assistance in 2001 and no longer required walk-in sites that were manually capturing and reporting wait-time information to do so in 2002. While we did not agree with IRS's decision to discontinue wait time as an official measure, we did agree with the decision to stop manual tracking of wait time because it was not practical or accurate to do so.[Footnote 34] This year, IRS no longer required that about 140 of its 400 walk-in sites equipped with an automated system, known as the Queuing Management System, which captures wait-time information to report that information to upper-level management. Further, IRS did not consolidate and disseminate this wait-time information to field managers. According to field assistance officials, this decision was made for the same reason they discontinued wait time as an official measure--because walk-in staff felt pressured to hurry assistance. However, without timeliness information, IRS lacks information about a key component of service, which makes it difficult to balance timeliness and quality. As a result, walk-in staff could take excessive time providing assistance to a few taxpayers regardless of the impact on the wait time for other taxpayers. For this reason, IRS includes timeliness as part of its suite of balanced measures for monitoring telephone operations. In addition, taxpayers reported in customer satisfaction surveys that promptness of service was by far the highest ranked improvement priority for its walk-in sites. IRS also does not presently know the accuracy of the account assistance it provides to taxpayers at walk-in sites. Account assistance differs from tax law assistance--account assistance includes answers to questions about taxpayers' refunds, payments, and tax debts. IRS established baseline data for an account accuracy measure in 2002; however, IRS subsequently decided not to measure account accuracy in 2003 so that its quality reviewers could focus on conducting reviews of tax law accuracy at walk-in sites. IRS officials stated that they are developing a plan for measuring account accuracy and hoped to begin using quality reviewers to measure the accuracy of account assistance in September 2003. Account accuracy is one of the balanced measures of telephone performance. IRS Took Steps in 2003 to Improve Walk-in Service: IRS took several steps to improve walk-in service in 2003. According to field assistance officials, these steps likely helped improve the accuracy of tax law assistance, although they have not conducted any analysis to determine the impact of these steps on any particular aspect of quality of walk-in service. The following are three examples of steps intended to improve accuracy. * Field assistance managers began certifying the proficiency of walk-in staff in various tax law topics in March 2003. According to field assistance officials, walk-in staff that do not pass the certification in a particular topic cannot assist taxpayers on that topic, and managers are required to develop a plan to assist the staff in improving proficiency in that topic. * Field assistance managers and quality reviewers began conducting monthly reviews of tax law accuracy at walk-in sites. IRS data show that from January to April 2003, its reviewers reported receiving correct responses to about 88 percent of the questions asked of walk-in staff, which is higher than the results reported by TIGTA for the same time period. * IRS began training walk-in staff in fiscal year 2003 on how to guide taxpayers through a publication to answer a tax law question, instead of merely providing the taxpayer with the publication and having the taxpayers figure out the answers by themselves. As part of this training, IRS also developed guidance for walk-in staff to use that is similar to what CSRs use for answering tax law questions received via IRS's toll-free telephone network. In addition, field assistance procedures emphasize that walk-in staff should not give taxpayers a publication in lieu of providing an answer to their tax law question. IRS Lacks Data for Assessing Long-term Improvements in Walk-In Assistance: Over the last few years, IRS has made efforts to standardize walk-in assistance, but a lack of performance data makes it difficult for IRS and us to quantify long-term improvements. As we reported in December 2000, IRS's National Office did not implement a quality review program for walk-in sites until 2000.[Footnote 35] Before that time, IRS lacked meaningful nationwide data to assess the performance of its walk-in sites in terms of quality, timeliness, and taxpayer satisfaction. Despite this fact, field assistance officials believe that there have been improvements in the quality of services provided by walk-in sites in recent years, based on a number of factors. For example, in 2001, IRS reorganized its walk-in sites and established a set of measures, such as tax law accuracy, to assess performance and to help provide consistency and standardization. As a result, field assistance officials told us that walk-in sites now capture workload data, for example, more consistently, which makes the data more useful to management and which indicates an improvement in recent years. The officials told us that, in 2002, IRS also began providing more consistent and standardized services, better training, and improved access to taxpayer account information at walk-in sites. In addition, IRS began refining the process for referring complex tax law questions that are beyond the scope of training that walk-in staff normally receive to expert field assistance, toll-free telephone assistance CSRs, or compliance staff. Finally, as previously noted, IRS has also been able to reduce its reliance on compliance staff over the last few years, allowing it to redirect those resources to higher priority, compliance-related work. IRS's Web Site Performance Showed Some Improvement: In 2003, IRS's Web site showed some improvement and taxpayers used it more than in 2002. For example, from January 1 to July 31, 2003, more than 430 million forms, publications, and other documents had been downloaded from the Web site, a 22 percent increase over the same time period last year. Keynote--an independent Web site rater and a recognized authority on Internet performance--reviewed the average delivery time and availability[Footnote 36] of IRS's Web site and reported that the site performed well, although the Web site did exhibit some minor problematic periods. Keynote reported that from April 11 through April 16, 2003, IRS's home page was delivered in around 1 second and the Web site had an average availability rate of 99.35 percent.[Footnote 37] However, on April 14, 2003, Keynote reported that the site's average delivery time experienced slowdowns of up to 6 to 8 seconds from 5 p.m. to 9 p.m., and its average availability rate decreased to less than 90 percent. In 2002, Keynote reported that the Web site's average delivery time was less than 1 second and its availability averaged close to 100 percent for most of the filing season. Although Performance Declined for Questions Received Via IRS's Web Site, Ease of Use Improved: One important feature of IRS's Web site is the ability of taxpayers to ask tax law and procedural questions of IRS via the Internet on its Web site. IRS data indicate that its performance in answering questions received from taxpayers via the Internet worsened during the 2003 filing season as compared to 2002. IRS took 3.7 business days on average to respond to those questions in 2003, as compared with 2.1 business days in 2002 and its 2003 performance goal of 2 business days. In addition, from January 1 to May 31, 2003, IRS responded accurately to 73.7 percent of the questions, as compared to a 77.6 percent accuracy rate for the same time period in 2002 and its 2003 performance goal of 83.5 percent. IRS officials attributed the increase in the average time to respond and the decrease in the accuracy rate to the increased volume and complexity of the questions. Although the number of questions received from taxpayers over the Internet is small when compared to the number of questions received over the telephone, providing accurate responses to these questions is particularly important because of the potential for widespread dissemination of inaccurate responses to other taxpayers. We found that IRS's Web site was more user friendly in 2003. For example, we did not find broken or inappropriate links between pages as we have found in previous years. IRS also added an index to the Web site, making it possible for users to search for forms, instructions, or publications by topic. In addition, IRS resolved our concern that the search functions do not always make the most pertinent information readily available. In April 2003, we testified that when we typed, "earned income tax credit" into the forms and publication search function, Publication 596--the primary publication on the earned income tax credit--was the 70th item on the list, and we had to scroll through seven pages to find it. However, in June 2003, we again typed "earned income credit" into the search function and found the publication was the 9th item on the list and on the first page. IRS officials attributed the improvement in the search function results, in part, to working with contractors to (1) determine what the expected search results should be for the most frequently used search terms, (2) adjust the search results to ensure that those items appear at the top of the list, and (3) expand the thesaurus within the search engine to include an updated repository of the most frequently searched words, phrases, and variations. IRS Continues to Offer New Services to Increase Web Use, a Key Part of Modernization: IRS offered new services on the Web site for the 2003 filing season that represent payoffs from modernization. For example, IRS implemented a refund status check (Where's My Refund) feature on the Web site that enabled taxpayers to find out if IRS received their returns and whether their refunds were processed. As of June 9, 2003, IRS data show that about 11 million taxpayers obtained data on their refund status using this feature. The ability of taxpayers to check the status of refunds on-line is particularly important because it has contributed to the decreased number of refund call inquiries handled by IRS's toll-free telephone operations and has the potential to further decrease those calls. Taxpayers responding to a survey on the feature provided favorable reviews--about 91 percent of the survey respondents said they were satisfied or somewhat satisfied with the overall service provided by the feature. In January 2003, IRS also made available on the Web site a direct link to the Free File program offered through IRS private-sector partners. IRS's Web site is a critical part of modernization because, according to IRS, it is more cost effective than other methods of providing taxpayer assistance, such as answering telephone calls. As discussed above, the initiative that allowed taxpayers to check the status of their refunds shows the potential of the Web site to provide more cost- effective services. Taxpayer's use of IRS's Web site and the services IRS offers on its Web site have grown considerably over the past several filing seasons, another indication that taxpayers are receiving payoffs from modernization. For example, by July 31, 2003, taxpayers already had downloaded more than 430 million forms and publications compared to the 129 million for about the same time period in 2000. Conclusions: IRS's performance during the filing season is important because it affects so many taxpayers. The filing season also plays a crucial role in collecting the revenue that finances the federal government. The improvements seen this year, as well as over the past several years, are part of the payoff from IRS's ongoing modernization efforts. One feature of modernization that has contributed to IRS's improved performance is the greater reliance on performance measures to manage its operations. A few years ago, IRS established performance measures that are intended to balance priorities such as quality, timeliness, customer satisfaction, employee satisfaction, and outcomes. The measures IRS uses to assess its performance in providing telephone service are an example of how IRS has achieved this balance. However, as a result of IRS's decision in 2003 to stop requiring sites equipped with an automated system for reporting wait-time data to report that information, IRS's measures to assess walk-in assistance lack such balance. Finally, managers do not have information on this important aspect of quality and without the balance a timeliness measure would offer, staff might focus on providing accurate assistance to a few taxpayers regardless of the impact on the wait-time for other taxpayers. Recommendation for Executive Action: We recommend that the Commissioner of Internal Revenue direct the appropriate officials to require that IRS consolidate and disseminate wait-time information to field managers based on information from sites equipped with an automated system that can capture wait-time data, in order to assess this important aspect of quality. Agency Comments and Our Evaluation: The Commissioner of Internal Revenue provided written comments in an October 29, 2003, letter (see app. III). The Commissioner noted that IRS's filing season readiness process provided the framework and oversight to ensure that IRS was well prepared for the 2003 filing season. The Commissioner partially agreed with our specific recommendation, stating that IRS will require walk-in sites equipped with Q-Matic to report wait-time information on a quarterly basis and that the automated wait-time information available from these locations would provide valuable data for an assessment of overall trends and relationships in timeliness and quality. However, the Commissioner did not agree to disseminate this consolidated wait-time information to field managers. For years, as we report, IRS has contended that past experience has shown employee reaction to timeliness measures tended to increase the likelihood of inaccurate or incomplete answers. At the same time, the Commissioner noted that routine monitoring of wait time occurs by local managers for walk-in sites equipped with Q-Matic. However, routine monitoring does not provide overall performance data and timeliness data is only available to some managers locally. In our view, there needs to be a balance between measuring quality and timeliness and too much focus on either could create inappropriate incentives for IRS's walk-in staff. As noted in our report, IRS already consolidates and reports tax law and return preparation accuracy at its walk-in sites and plans to do the same for accounts accuracy. Without consolidated timeliness information, field managers would have a difficult time balancing quality and timeliness. : We are sending copies of this report to the Chairmen and Ranking Minority Members of the Senate Committee on Finance, the House Committee on Ways and Means, and the Ranking Minority Member, Subcommittee on Oversight, House Committee on Ways and Means. We are also sending copies to the Secretary of the Treasury; the Commissioner of Internal Revenue; the Director, Office of Management and Budget; and other interested parties. We will also make copies available to others on request. In addition, the report will be available at no charge on the GAO Web site at [Hyperlink, http://www.gao.gov.] h [Hyperlink, http://www.gao.gov] ttp://www.gao.gov. : : This report was prepared under the direction of Joanna M. Stamatiades, Assistant Director. Other major contributors are acknowledged in appendix IV. If you have any questions about this report, contact me on (202) 512-9110. Sincerely yours, Signed by: James R. White: Director, Tax Issues: [End of section] Appendixes: Appendix I: Data on IRS's Processing Performance Relative to Fiscal Year 2001-2003 Performance and Fiscal Year 2003 Goals: As table 2 shows, (1) the Internal Revenue Service's (IRS) performance in 2003 improved over last year for seven measures and (2) IRS exceeded its performance goals in 2003 for five measures but missed its goals for two measures (deposit error rate and letter error rate). IRS's performance in 2003 could not be compared with its performance in 2002 and prior years or 2003 goal for one measure (refund interest paid) because IRS revised the way the measure was computed and did not have the necessary data available to revise the goal. Table 2 also shows that IRS's processing performance has generally improved for each of its measures since 2001. Table 2: IRS's 2001-2003 Tax Filing Season Processing PerformanceA: Measure Name: Deposit error rate; Definition: Percentage of payments applied in error by, for example, reimbursing a taxpayer who overpaid when the taxpayer wanted any overpayment credited to next year's tax bill; Fiscal year 2001 actual[B]: 5.0%; Fiscal year: 2002: actual: 4.8%; +/-0.3%; Fiscal year: 2003: actual: (through July 31): 4.4%; +/ -0.3%; Fiscal year: 2003: goal: 2.4%; Comments: Performance improved, but performance goal not met. According to IRS officials, the goal was too aggressive. Measure Name: Deposit timeliness-paper; Definition: Interest value of money not deposited by the business day after receipt per $1 million in deposits. Measure assumes an 8 percent interest rate; Fiscal year 2001 actual[B]: $748; Fiscal year: 2002: actual: $578; Fiscal year: 2003: actual: (through July 31): $542; Fiscal year: 2003: goal: $573; Comments: Performance improved and performance goal exceeded. Measure Name: Letter error rate; Definition: Percentage of letters issued to taxpayers with errors (includes systemic errors).[C]; Fiscal year 2001 actual[B]: Not comparable because of revisions to the measure; Fiscal year: 2002: actual: 7.4%; +/-0.6%; Fiscal year: 2003: actual: (through July 31): 7.2%; +/-0.5%; Fiscal year: 2003: goal: 6.2%; Comments: Performance improved, but goal not met. According to IRS officials, the goal was not met because of loss of experienced and knowledgeable personnel as a result of IRS's announcement that it would be closing some processing centers. Measure Name: Notice error rate; Definition: Percentage of incorrect notices issued to taxpayers (includes systemic errors).[ C]; Fiscal year 2001 actual[B]: Not comparable because of revisions to the measure; Fiscal year: 2002: actual: 18.7%; +/-2.7%; Fiscal year: 2003: actual: (through July 31): 9.7%; +/-0.5 %; Fiscal year: 2003: goal: 13.2%; Comments: Performance improved and performance goal exceeded. Measure Name: Refund error rate -individual (paper); Definition: The percentage of refunds with IRS-caused errors in the entity information (e.g., incorrect name or Social Security number) or refund amount; includes systemic errors.[ C]; Fiscal year 2001 actual[B]: 9.8%; Fiscal year: 2002: actual: 8.0%; +/-3.8%; Fiscal year: 2003: actual: (through July 31): 5.4%; +/-3.5%; Fiscal year: 2003: goal: 7.6%; Comments: Performance improved and performance goal exceeded. Measure Name: Refund interest paid; Definition: Amount of refund interest IRS paid per $1 million of refunds issued; Fiscal year 2001 actual[B]: Not comparable because of revisions to the measure; Fiscal year: 2002: actual: Not comparable because of revisions to the measure; Fiscal year: 2003: actual: (through July 31): Not comparable because of revisions to the measure; Fiscal year: 2003: goal: Not applicable; Comments: We cannot assess performance relative to previous years or 2003 goal. In 2002, IRS implemented a programming change that revised how it calculates the measure and did not have the necessary data to revise the goal for the 2003 filing season. Measure Name: Refund timeliness-individual (paper); Definition: Percentage of refunds issued within 40 days or less; Fiscal year 2001 actual[B]: 95.2%; Fiscal year: 2002: actual: 98.2%; +/-2.3%; Fiscal year: 2003: actual: (through July 31): 98.8%; +/-2.3%; Fiscal year: 2003: goal: 98.4%; Comments: Performance improved and performance goal exceeded. Measure Name: Productivity; Definition: Weighted volume of documents processed per staff year expended at the processing centers; Fiscal year 2001 actual[B]: 30,133; Fiscal year: 2002: actual: 28,257; Fiscal year: 2003: actual: (through July 31): 30,094; Fiscal year: 2003: goal: 29,302; Comments: Performance improved and performance goal exceeded. Source: IRS data. Note: GAO analysis of IRS data. [A] The measures for fiscal year 2003 are through July 31, which were the latest data available at the time we ended our audit work. According to IRS officials, the 2003 results through July 31 are reflective of IRS's performance during the filing season. In addition, IRS officials told us that the results for the measures should not change significantly through September 30. [B] According to IRS officials, they did not compute a margin of error for these measures in 2001. [C] Systemic errors are computer-generated errors over which a particular processing center would have no control. [End of table] [End of section] Appendix II: Advance Payment of Child Tax Credit Had Minimal Impact on 2003 Filing Season: The Jobs and Growth Tax Relief Reconciliation Act of 2003,[Footnote 38] signed into law on May 28, 2003, increased the amount of the child tax credit from $600 per child to $1,000 for 2003 and 2004. The act also provided for eligible taxpayers to receive the increase of $400 this summer in order to stimulate the economy more rapidly than if taxpayers had to wait until they filed their tax year 2003 return. The Department of the Treasury mailed approximately 24 million advanced payment checks from late July to mid-August 2003 in a manner similar to the advanced payment checks issued in 2001. IRS took several steps in 2003 to prepare taxpayers for the advanced payments. For example, in May IRS set up a special menu prompt on its tax law and refund inquiry toll-free lines that provided taxpayers with general information about the child tax credit advance payment. In mid- July, IRS (1) provided additional information--such as when taxpayers could expect their advanced payment checks based on the last two digits of their social security number--on this special menu prompt, (2) established a new toll-free number to provide taxpayers with specific information about the advanced payments, and (3) updated its Web site to provide taxpayers with information on eligibility requirements and the ability to check the status of their advance payment. According to IRS officials, passage of the Jobs and Growth Tax Relief Reconciliation Act of 2003 had a minimal impact on the 2003 filing season. For example, the officials reported that IRS experienced some increase in telephone calls before the legislation was passed, but they expected the majority of taxpayers to call for telephone assistance in mid-August or later--after the advance payments were mailed. Data on calls were not available in time to be reflected in this report. IRS did not allocate additional resources to provide this assistance and estimated that, as a result of an anticipated increase in demand, the CSR level of service performance measure might drop by about three percentage points by the end of 2003 fiscal year. IRS officials anticipate that some additional impact on telephone service will occur during the 2004 filing season. IRS also anticipates that, based on its experience with the 2001 rate reduction credit, a number of taxpayers will make errors, such as with the Child Tax Credit Worksheet computation during the 2004 filing season. However, IRS anticipates there will be fewer errors in 2004 because fewer taxpayers are affected by the child tax credit. As we reported last year, taxpayers and tax practitioners made many errors related to the rate reduction credit during the 2002 tax filing season.[Footnote 39] However, IRS expects fewer problems with the child tax credit and advanced payment and attributes this in part to IRS having learned lessons from its experience during the 2002 filing season. For example, IRS has identified the types of errors taxpayers and tax professionals made related to the rate reduction credit and was preparing strategies to minimize the impact on taxpayers during the 2004 filing season. [End of section] Appendix III: Comments from the Internal Revenue Service: DEPARTMENT OF THE TREASURY INTERNAL REVENUE SERVICE WASHINGTON, D.C. 20224: COMMISSIONER: October 29, 2003: Mr. James R. White Director, Tax Issues U.S. General Accounting Office 441 G Street, N.W. Washington, D.C. 20548: Dear Mr. White: I agree with your assessment that the 2003 filing season was one highlighted by many improvements. As you acknowledged, preparing for the filing season is a monumental undertaking requiring cross- functional planning and coordination. Our Filing Season Readiness process provides the framework and oversight to insure that we are well prepared, and I appreciate your recognition of our success. The brief synopsis highlighting the progress we have made since 1998 reflects our sustained efforts and the many improvements from our modernization program. We recognize that there are still improvement opportunities, and we plan to continue to build on our success. Telephone Service: We dramatically improved our customers' experience by increasing telephone access this filing season. Increased accessibility meant that more taxpayers were able to receive service on their initial attempt and waited for a much shorter period of time when requiring assistance from a Customer Service Representative (CSR). While we did receive fewer calls than planned, part of that decrease and the improved access was the result of a comprehensive strategy that: Established six new toll-free numbers specifically targeting customer segments based on their service need; Provided improved scripts, menu options, and personalized call routing for tax law callers to reduce the number of transferred calls; Implemented a skill-based routing process that supports specialization and matches each call to a CSR with the identified skills; and: * Realigned five call sites from Small Business/Self Employed Division to the Wage and Investment Division to better match the specialized workload. Our success in improving our customer's experience is evidenced by the results of the Customer Satisfaction Survey related to telephone service. For the period January through March 2003, 94 percent of the callers responding to the survey gave the IRS a rating of 4 ("mostly satisfied") or 5 ("completely satisfied"): regarding their experience using our toll-free service. For the period April through June 2003, the result was 93 percent satisfied. As noted in your report, our tax law customer accuracy rate decreased from 85 percent in 2002 to 81 percent in 2003, and our accounts customer accuracy rate decreased from 91 percent in 2002 to 89 percent in 2003. However, we successfully implemented a new quality measurement and improvement system that has the potential for achieving significant progress. The Embedded Quality (EQ) System represents a cultural transition from our pass/fail system of quality review to a system that aligns quality review standards with employee performance standards. Under the old pass/fail system, any one incorrect action would result in a fail rating. The EQ System computes defects per opportunity. The measurement for defects per opportunity is the total number of opportunities to take correct action divided by missed opportunities (defects). This provides a more accurate picture of service quality and allows for targeted performance feedback. It represents a new way of doing business that builds commitment and capability among all individuals to continually improve customer service, employee satisfaction, and business results. The components that are evaluated by the EQ System include: Timeliness; Professionalism; Customer Accuracy; Regulatory/Statutory Accuracy; and Procedural Quality. Our new approach to the EQ System of measurement and improvement is expected to: * Shape organizational and individual performance by developing appropriate measures; and: * Establish accountability by connecting organizational and human performance. Tax Return Processing: Our returns processing activities were highly effective. Detailed planning, coordination and a dedicated staff contributed to this success. As noted in your report, we continued to improve our performance while consolidating our processing workload. We improved our performance in each of our Processing Performance measures. Through July, we processed over 125 million income tax returns and issued over $189 billion in timely refunds to our customers. Electronic Filing: We are pleased that your report recognizes our progress with the IRS's website and electronic filing. In particular, the report notes our success with the Free File Alliance. While we have not yet reached our long-range goal of 80 percent of all federal tax and information returns filed electronically, we are making progress. During the 2003 tax filing season, we continued to set new records in e-file: * Electronic Filing -As of September 25, 2003, over 53 million taxpayers e-filed, surpassing last year's volume of 46.7 million. * Home computer e-filing - People filed more than 11.9 million returns from their home computers, a 27 percent increase from last year. * Over 2.8 million taxpayers used the free online filing services offered by the Free File Alliance, which exceeded our goal of 2.5 million taxpayers. Electronic payments - There were more than 1.2 million e-payments, a rise of 37.3 percent over the same time last year. This includes 552,694 credit card payments. Electronic signatures - More than 32.5 million taxpayers signed their return electronically using one of the three Personal Identification Number options. * Web activity -The IRS site at www.irs.gov remains one of the most used sites during the filing season, with 4.3 billion hits. In addition, the IRS continues to experience an increase in the number of files downloaded, exceeding 534 million. Plans for improving electronic filing for the 2004 tax filing season include: * Continuing our aggressive encouragement of electronic filing through the deployment of e-services. E-services are a suite of Web-based products that will allow firms to do business with the IRS electronically. E-services will give IRS e-file Providers easier access to the IRS and the ability to receive information electronically. This will reduce response times enabling IRS e-fife Providers to better serve their clients. All e-services products will be quick, convenient, and easy- to-use. * We are working with the Free File Alliance members to develop program requirements (i.e., refinements) designed to improve Free File. The requirements being discussed are a direct result of analysis and feedback gathered from taxpayers regarding their experience with the program. Also, throughout this past filing season we monitored the performance of Alliance members' by doing independent reviews of each of their websites and online programs to ensure compliance with requirements set forth in our Agreement. As a result, key improvements for 2004 include: * Increasing information about forms an* schedules on the Alliance websites; * Guaranteeing tax return calculations; and: * Increasing information regarding the Alliance members' customer service options and state return programs. Taxpayer Assistance Centers (Walk-In Service): We are continuing our strategy to reduce the number of taxpayers who need to visit us in person by increasing the availability of electronic services and volunteer services. In addition, we have taken steps to enhance the taxpayer's experience at our Taxpayer Assistance Centers (TACs). As your report recognizes, we took aggressive actions to improve the accuracy of tax law assistance. We required employees to complete directed learning on each tax law subject and validated their proficiency by conducting monthly certifications of selected topics. We are also revising all tax law training to incorporate the Publication Method. The Publication Method is a technique to "walk" a taxpayer through a publication to cover all appropriate probing questions and to illustrate the correct answer to his/her question. Our long-term approach to improving quality is the implementation of the EQ System, similar to the process discussed above for telephone service. When fully implemented (Fiscal Year 2005), the EQ System will provide us with a common approach to measure our performance keyed to what is critical to the customer, employees, and our organization. Stakeholder Partnerships, Education and Communication (SPEC): In the second year of implementing a partner-based business model that leverages the resources of community coalitions in delivering tax preparation and education, IRS significantly increased the scope and availability of volunteer services. Based on annual surveys conducted after the filing season, the IRS: increased its partner overall satisfaction from 83 percent to 87 percent, and maintained a very high taxpayer overall satisfaction rate of 96 percent. For example, these efforts achieved: * 1.6 million volunteer prepared returns, a 29.6 percent increase over 2002, with a 97 percent filing accuracy rate; 143 million outreach contacts, including 57 million EITC-related contacts, using a wide variety of communication channels including media, direct mail, seminars, conferences, and community-based marketing; and: * An increase from 40 to over 160 community-based coalitions in 2003. National partners such as United Way, Health and Human Services Office of Community Services, Annie E. Casey Foundation, and the National League of Cities serve as the foundation to access, serve, and educate millions of taxpayers. My response to your recommendation for Executive Action is as follows: Recommendation: You recommended that the Commissioner of Internal Revenue Service direct the appropriate officials to require that the IRS consolidate and disseminate wait-time information to field managers based on information from sites equipped with an automated system that can capture wait-time data, in order to assess this important aspect of quality. Response: We continue to agree with you that measuring customer wait-time is an important indicator of the service we are providing to our customers. Although we do not currently consolidate and disseminate wait-time information to TAC managers, these managers have information on wait- time available for their local TACs. TAC managers routinely monitor wait-time information on the automated system (Q-Matic) and allocate TAC resources to ensure that customers do not have excessive wait- times. We believe this local monitoring is the best method available to ensure that customers are being served within a reasonable time period. For the same reasons noted in our response to your 2002 Filing Season report (GAO-03-314), we do not agree that it is necessary for headquarters to consolidate and report TAC wait-times. Therefore, we do not plan to implement your recommendation. However, your report also observed that during the 2003 filing season, Q-Matic equipped sites were not required to report wait-time data to headquarters. We agree that the automated wait-time information available from these locations would provide valuable data for an assessment of overall trends and relationships in timeliness and quality. As a result. Q-Matic sites will be required to report wait-time information on a quarterly basis. Again, I appreciate your observations on the successful tax filing season for 2003. If you have any questions, please call Floyd Williams, Director, Legislative Affairs, at (202) 622-3720. Sincerely, Signed for: Mark W. Everson: [End of section] Appendix IV: GAO Contacts and Staff Acknowledgments: James White, (202) 512-9110 Joanna Stamatiades, (404) 679-1984: In addition to those named above, James Cook, Leon Green, Marshall Hamlett, Ron Heisterkamp, John Lesser, Jay Pelkofer, Amy Rosewarne, Sonja Ware, and Daniel Zeno made key contributions to this report. (440183): FOOTNOTES [1] Most taxpayers file their returns between January 1 and April 15, which is the deadline for filing individual income tax returns. However, millions of taxpayers get an extension from IRS, which allows them to delay filing until as late as October 15. [2] U.S. General Accounting Office, Internal Revenue Service: Assessment of Fiscal Year 2004 Budget Request and 2003 Filing Season Performance to Date, GAO-03-641T (Washington, D.C.: Apr. 8, 2003). [3] IRS uses workload indicators, such as the number of returns processed, for purposes of resource planning. It uses balanced measures primarily for gauging business results (quantity and quality measures) in addition to employee satisfaction and customer satisfaction. [4] U.S. General Accounting Office, Tax Administration: IRS Needs to Further Refine Its Tax Filing Season Performance Measures, GAO-03-143 (Washington, D.C.: Nov. 22, 2002). [5] The Joint Operations Center is the organization responsible for managing IRS's telephone operations. [6] P.L. 105-206. [7] The Government Performance and Results Act of 1993 (P.L. 103-62) was enacted to hold federal agencies accountable for achieving program results. IRS's balanced measurement system is consistent with the intent of the act. [8] Although IRS establishes goals for its balanced measures on a fiscal year basis, our assessment of these measures is based on the filing season, when most taxpayers have their only interaction with IRS. [9] The data we report for 2003 are as of July 31, which were the latest data available at the time we ended our field work. According to IRS officials, the results through July 31 reflect IRS's performance during the filing season. [10] P.L. 108-27. [11] The National Association of Enrolled Agents is a national association of over 10,000 independent, licensed tax professionals called enrolled agents. Enrolled agents are licensed by the federal government and are authorized to appear in place of the taxpayer at IRS. [12] Treasury Inspector General for Tax Administration, The 2003 Filing Season Was Completed Timely and Accurately, but Some New Tax Law Changes Were Not Effectively Implemented, Reference No. 2004-40-003, (Washington, D.C., 2003). [13] TIGTA identified taxpayers that were allowed retirement savings contribution credits and student loan interest deductions in excess of the amounts allowed by the new tax law changes, taxpayers with potential unclaimed additional child tax credits, and taxpayers that were allowed a "dual benefit" for the tuition and fees deduction and the education credit. [14] GAO-03-641T. [15] According to IRS officials, the staff year data for fiscal year 2003 represent actual staff year data through August 2, 2003, plus projected staff year usage through September 30, 2003. [16] RRA 98 provides, in part, that it should be the goal of IRS to have at least 80 percent of all federal tax and information returns filed electronically by 2007. IRS's goal for individual income tax returns is consistent with this overall goal--80 percent by 2007. [17] We used a 3-year average for the growth rate in the total number of individual tax returns because the growth rate in 2003 was negative and we believe that a 3-year average is more representative of future growth. IRS officials attributed the negative growth rate in 2003 to the downturn in the U.S. economy. [18] See Report of the Joint Committee on Taxation Relating to the Internal Revenue Service as required by the IRS Reform and Restructuring Act of 1998, JCX-53-03, May 19, 2003. [19] Electronic Tax Administration Advisory Committee, Annual Report to Congress, (Washington, D.C., June 2003). RRA 98 mandated that the Secretary of the Treasury convene an electronic commerce advisory group to ensure that the Secretary receives input from the private sector on IRS's plan to increase electronic filing. ETAAC was created in 1998 in response to that mandate and, among other things, is required to report to the Congress annually on IRS's progress towards meeting the electronic filing goals set in the act. [20] TIGTA confirmed that IRS exceeded its goals for the Free File Alliance, although they had recommendations to improve the program. See Treasury Inspector General for Tax Administration, Improvements are Needed to Ensure Individual Taxpayers Have an Easy, No-Cost Option to e-file Their Tax Returns, Reference No. 2003-40-165, (Washington, D.C., 2002). [21] IRS has other measures that we are not reporting on because the measures do not provide adequate information to make conclusions about the ease with which taxpayers reached IRS or the accuracy of the responses they received after reaching IRS. [22] GAO-03-143. [23] IRS based its disagreement on the data on automated calls not being good enough to merit attention as a balanced measure. While we recognized that there were data weaknesses with the measure, our recommendation also called for IRS to revise the formula before including it among its balanced measures. See GAO-03-143. [24] U.S. General Accounting Office, IRS's 2002 Tax Filing Season: Returns and Refunds Processed Smoothly; Quality of Assistance Improved, GAO-03-314 (Washington, D.C.: Dec. 20, 2002). [25] At any one of IRS's more than 400 walk-in sites, taxpayers can obtain (1) forms and publications; (2) assistance with their tax accounts; (3) answers to tax law questions; (4) limited return preparation assistance; and (5) various other types of assistance, such as help getting a taxpayer identification number. [26] In 2001, the Congress directed TIGTA to review the accuracy of tax law assistance provided by all of IRS's walk-in sites, S. Rep. No. 107- 57 (2001). From January through April 2003, TIGTA reviewers visited 72 walk-in sites and asked a total of 283 tax law questions. [27] TIGTA counts referrals as incorrect when the IRS employee merely provided the publication, without walking the customer through it to identify the answer, as required by established field assistance procedures. [28] GAO-03-314. [29] IRS considers a return as being accurate if no math errors (obvious errors such as mathematical errors, omitted or inconsistent data, or other inconsistencies) are identified on the return. [30] These programs use IRS-trained volunteers to help prepare basic tax returns for taxpayers with special needs, including people with disabilities, those with low or fixed incomes, non-English speaking people, and the elderly, during the filing season. [31] IRS's walk-in sites provide return preparation assistance to taxpayers taht meet certain income requirements. For the 2003 filing season, the income ceiling for return preparation assistance was $35,000. [32] IRS planned to reduce return preparation assistance by 20 percent in both fiscal years 2003 and 2004 and expects walk-in sites to provide additional tax law assistance, as well as perform some compliance functions. [33] According to IRS, the number of community-based coalitions increased from 6 in fiscal year 2000 to 150 in fiscal year 2003. In 2004, IRS plans to continue expanding VITA and TCE sites in underserved areas, such as rural communities, while improving the operational effectiveness and productivity of existing partnerships. [34] GAO-03-143 and GAO-03-314. [35] U.S. General Accounting Office, Tax Administration: Assessment of IRS' 2000 Tax Filing Season, GAO-01-158 (Washington, D.C.: Dec. 22, 2000). [36] According to Keynote, availability is the percentage of time the Web site's home page downloads fully and average delivery time is the time it takes for the home page to fully download from the time the user hits the "enter" key on the keyboard. According to IRS, a home page is charged with an error and therefore receives a lower percentage of availability even if a graphic that has nothing to do with the user's ability to get pertinent content information from the page does not download properly. As such, according to IRS, the measure does not reflect whether the Web site itself is available or not. Also, according to IRS, errors can be the result of heavy traffic on the Internet in general and may have nothing to do with the home page. [37] Keynote measured the average delivery time and availability of IRS's Web site from 5 p.m., Eastern Daylight Time (EDT), on April 11, 2003, to 9 a.m., EDT, on April 16, 2003. [38] P.L. 108-27. [39] GAO-03-314. GAO's Mission: The General Accounting Office, the investigative arm of Congress, exists to support Congress in meeting its constitutional responsibilities and to help improve the performance and accountability of the federal government for the American people. GAO examines the use of public funds; evaluates federal programs and policies; and provides analyses, recommendations, and other assistance to help Congress make informed oversight, policy, and funding decisions. GAO's commitment to good government is reflected in its core values of accountability, integrity, and reliability. Obtaining Copies of GAO Reports and Testimony: The fastest and easiest way to obtain copies of GAO documents at no cost is through the Internet. GAO's Web site ( www.gao.gov ) contains abstracts and full-text files of current reports and testimony and an expanding archive of older products. The Web site features a search engine to help you locate documents using key words and phrases. You can print these documents in their entirety, including charts and other graphics. Each day, GAO issues a list of newly released reports, testimony, and correspondence. GAO posts this list, known as "Today's Reports," on its Web site daily. The list contains links to the full-text document files. To have GAO e-mail this list to you every afternoon, go to www.gao.gov and select "Subscribe to e-mail alerts" under the "Order GAO Products" heading. Order by Mail or Phone: The first copy of each printed report is free. Additional copies are $2 each. A check or money order should be made out to the Superintendent of Documents. GAO also accepts VISA and Mastercard. Orders for 100 or more copies mailed to a single address are discounted 25 percent. Orders should be sent to: U.S. General Accounting Office 441 G Street NW, Room LM Washington, D.C. 20548: To order by Phone: Voice: (202) 512-6000: TDD: (202) 512-2537: Fax: (202) 512-6061: To Report Fraud, Waste, and Abuse in Federal Programs: Contact: Web site: www.gao.gov/fraudnet/fraudnet.htm E-mail: fraudnet@gao.gov Automated answering system: (800) 424-5454 or (202) 512-7470: Public Affairs: Jeff Nelligan, managing director, NelliganJ@gao.gov (202) 512-4800 U.S. General Accounting Office, 441 G Street NW, Room 7149 Washington, D.C. 20548:

The Justia Government Accountability Office site republishes public reports retrieved from the U.S. GAO These reports should not be considered official, and do not necessarily reflect the views of Justia.