On May 8, 2009, the symposium, The Federal Statistical System: Recognizing Its Contributions, Moving It Forward was held in Washington, DC. One of the topics considered at that symposium was the health of innovation in the federal statistical system. A consequence of the symposium was an agreement by the Committee on National Statistics to hold a workshop on the future of innovation in the federal statistical system. This workshop was held on June 29, 2010. The original statement of task for the workshop focused on three challenges to the statistical system: (1) the obstacles to innovative, focused research and development initiatives that could make statistical programs more cost effective; (2) a gap between emerging data visualization and communications technologies and the ability of statistical agencies to understand and capitalize on these developments for their data dissemination programs; and (3) the maturation of the information technology (IT) discipline and the difficulties confronting individual agencies in keeping current with best practice in IT regarding data confidentiality. This report, Facilitating Innovation in the Federal Statistical System, is a descriptive summary of what transpired at the workshop. It is therefore limited to the views and opinions of the workshop participants. However, it does not strictly follow the agenda of the workshop, which had four sessions. Instead, it is organized around the themes of the discussions, which migrated across the four sessions.

Federal government statistics provide critical information to the country and serve a key role in a democracy. For decades, sample surveys with instruments carefully designed for particular data needs have been one of the primary methods for collecting data for federal statistics. However, the costs of conducting such surveys have been increasing while response rates have been declining, and many surveys are not able to fulfill growing demands for more timely information and for more detailed information at state and local levels. Innovations in Federal Statistics examines the opportunities and risks of using government administrative and private sector data sources to foster a paradigm shift in federal statistical programs that would combine diverse data sources in a secure manner to enhance federal statistics. This first publication of a two-part series discusses the challenges faced by the federal statistical system and the foundational elements needed for a new paradigm.

How do federal statistics strengthen our nation's science as well as its policy? In this latest volume of The ANNALS, leading academics, along with key federal officials, including the president's science advisor, the chief statistician of the U.S., the director of the Office of Management and Budget (OMB), the presidents of the National Academies, and the director of the Census Bureau address the argument that the statistics that the federal statistical system produces should be understood as constituting a scientific infrastructure for the empirical social sciences. Further, they see the current federal statistical system as "the best hope for bringing strong science to bear on new data sources" and "the best place to navigate unforeseen challenges in preserving the independence of statistical information from political interference." If federal statistics are the knowledge base from which policy problems and solutions emerge, it is imperative that we pay attention to the lessons they offer. Never before has this topic received this level of attention from such an array of contributors. A must read for all social scientists and policy-makers.

The environment for obtaining information and providing statistical data for policy makers and the public has changed significantly in the past decade, raising questions about the fundamental survey paradigm that underlies federal statistics. New data sources provide opportunities to develop a new paradigm that can improve timeliness, geographic or subpopulation detail, and statistical efficiency. It also has the potential to reduce the costs of producing federal statistics. The panel's first report described federal statistical agencies' current paradigm, which relies heavily on sample surveys for producing national statistics, and challenges agencies are facing; the legal frameworks and mechanisms for protecting the privacy and confidentiality of statistical data and for providing researchers access to data, and challenges to those frameworks and mechanisms; and statistical agencies access to alternative sources of data. The panel recommended a new approach for federal statistical programs that would combine diverse data sources from government and private sector sources and the creation of a new entity that would provide the foundational elements needed for this new approach, including legal authority to access data and protect privacy. This second of the panel's two reports builds on the analysis, conclusions, and recommendations in the first one. This report assesses alternative methods for implementing a new approach that would combine diverse data sources from government and private sector sources, including describing statistical models for combining data from multiple sources; examining statistical and computer science approaches that foster privacy protections; evaluating frameworks for assessing the quality and utility of alternative data sources; and various models for implementing the recommended new entity. Together, the two reports offer ideas and recommendations to help federal statistical agencies examine and evaluate data from alternative sources and then combine them as appropriate to provide the country with more timely, actionable, and useful information for policy makers, businesses, and individuals.

Publicly available statistics from government agencies that are credible, relevant, accurate, and timely are essential for policy makers, individuals, households, businesses, academic institutions, and other organizations to make informed decisions. Even more, the effective operation of a democratic system of government depends on the unhindered flow of statistical information to its citizens. In the United States, federal statistical agencies in cabinet departments and independent agencies are the governmental units whose principal function is to compile, analyze, and disseminate information for such statistical purposes as describing population characteristics and trends, planning and monitoring programs, and conducting research and evaluation. The work of these agencies is coordinated by the U.S. Office of Management and Budget. Statistical agencies may acquire information not only from surveys or censuses of people and organizations, but also from such sources as government administrative records, private-sector datasets, and Internet sources that are judged of suitable quality and relevance for statistical use. They may conduct analyses, but they do not advocate policies or take partisan positions. Statistical purposes for which they provide information relate to descriptions of groups and exclude any interest in or identification of an individual person, institution, or economic unit. Four principles are fundamental for a federal statistical agency: relevance to policy issues, credibility among data users, trust among data providers, and independence from political and other undue external influence. Principles and Practices for a Federal Statistical Agency: Fifth Edition explains these four principles in detail.