Bureau of Justice Statistics

The Bureau of Justice Statistics (BJS), a statistical agency of the Department of Justice's Office of Justice Programs, produces a recurring national Police-Public Contact Survey documenting contacts between the police and the public, including instances involving the use or threat of force by police. BJS issues public reports and sometimes press releases from survey results. For reports and a press release issued from the 1999 and 2002 surveys (the most recent available), GAO reviewed (1) the extent to which BJS followed quality guidelines to ensure the accuracy and integrity of its survey-related products, and (2) factors that affected whether and how BJS followed available guidelines. GAO reviewed applicable federal data quality guidelines, policy and procedure documents, and interviewed current and former officials familiar with BJS.

BJS followed nearly all quality guidelines for its 1999 and 2002 Police-Public Contact Surveys. Specifically, for the four public reports issued from these surveys, BJS fully followed all data quality guidelines available for reviewing statistical information, obtaining the approval of key decision makers, and publicly disseminating information. These guidelines were issued by the National Research Council, Department of Justice, Justice's Office of Justice Programs, and BJS itself. GAO believes that because BJS followed these guidelines, proper steps were taken to help ensure the accuracy and integrity of the reports. BJS followed 7 of the 10 quality guidelines available for the one press release issued from its 1999 survey, but was not in a position to fully follow 3 other guidelines for reasons discussed below. Two key factors affected whether and how BJS followed quality guidelines. The first concerned different interpretations about certain guideline applicability. BJS considered its survey-related reports--but not its press releases--to be statistical products covered by the National Research Council's guidelines. BJS cited a lack of specificity in these guidelines, which did not specifically state that they were applicable to statistical agency press releases, as a basis for concluding that the survey press releases need not conform to guidelines for statistical products. We believe BJS's position was not unreasonable, and did not find fault with the agency. However, we determined nonetheless that the single press release issued from the 1999 survey was a statistical product, and therefore believe the council's guidelines appropriately applied. Second, certain noncareer appointees outside BJS may, in accordance with Justice Department policy, make decisions about the review, approval, and dissemination of press releases, and BJS press releases are jointly issued with the Justice Department, with input from its Office of Justice Programs. Both conditions can potentially affect BJS's independence. Owing to these conditions, BJS was not, in our view, in a position to meet 3 council quality guidelines related to statistical agency independence, including that it be able to issue statistical products without prior clearance, and control the scope and content of its products. Justice affirmed several of GAO's findings but disagreed with certain GAO conclusions about the applicability of guidelines to a press release. Justice's detailed comments and GAO's response are contained in the report.