Improving Access to and Confidentiality of Research Data summarizes a workshop convened by the Committee on National Statistics (CNSTAT) to promote discussion about methods for advancing the often conflicting goals of exploiting the research potential of microdata and maintaining acceptable levels of confidentiality. This report outlines essential themes of the access versus confidentiality debate that emerged during the workshop. Among these themes are the tradeoffs and tensions between the needs of researchers and other data users on the one hand and confidentiality requirements on the other; the relative advantages and costs of data perturbation techniques (applied to facilitate public release) versus restricted access as tools for improving security; and the need to quantify disclosure risksâ€"both absolute and relativeâ€"created by researchers and research data, as well as by other data users and other types of data.

Policy makers need information about the nation—ranging from trends in the overall economy down to the use by individuals of Medicare—in order to evaluate existing programs and to develop new ones. This information often comes from research based on data about individual people, households, and businesses and other organizations, collected by statistical agencies. The benefit of increasing data accessibility to researchers and analysts is better informed public policy. To realize this benefit, a variety of modes for data access— including restricted access to confidential data and unrestricted access to appropriately altered public-use data—must be used. The risk of expanded access to potentially sensitive data is the increased probability of breaching the confidentiality of the data and, in turn, eroding public confidence in the data collection enterprise. Indeed, the statistical system of the United States ultimately depends on the willingness of the public to provide the information on which research data are based. Expanding Access to Research Data issues guidance on how to more fully exploit these tradeoffs. The panel’s recommendations focus on needs highlighted by legal, social, and technological changes that have occurred during the last decade.

Federal government statistics provide critical information to the country and serve a key role in a democracy. For decades, sample surveys with instruments carefully designed for particular data needs have been one of the primary methods for collecting data for federal statistics. However, the costs of conducting such surveys have been increasing while response rates have been declining, and many surveys are not able to fulfill growing demands for more timely information and for more detailed information at state and local levels. Innovations in Federal Statistics examines the opportunities and risks of using government administrative and private sector data sources to foster a paradigm shift in federal statistical programs that would combine diverse data sources in a secure manner to enhance federal statistics. This first publication of a two-part series discusses the challenges faced by the federal statistical system and the foundational elements needed for a new paradigm.

Policy makers need information about the nationâ€"ranging from trends in the overall economy down to the use by individuals of Medicareâ€"in order to evaluate existing programs and to develop new ones. This information often comes from research based on data about individual people, households, and businesses and other organizations, collected by statistical agencies. The benefit of increasing data accessibility to researchers and analysts is better informed public policy. To realize this benefit, a variety of modes for data accessâ€" including restricted access to confidential data and unrestricted access to appropriately altered public-use dataâ€"must be used. The risk of expanded access to potentially sensitive data is the increased probability of breaching the confidentiality of the data and, in turn, eroding public confidence in the data collection enterprise. Indeed, the statistical system of the United States ultimately depends on the willingness of the public to provide the information on which research data are based. Expanding Access to Research Data issues guidance on how to more fully exploit these tradeoffs. The panel's recommendations focus on needs highlighted by legal, social, and technological changes that have occurred during the last decade.

Policy makers need information about the nationâ€"ranging from trends in the overall economy down to the use by individuals of Medicareâ€"in order to evaluate existing programs and to develop new ones. This information often comes from research based on data about individual people, households, and businesses and other organizations, collected by statistical agencies. The benefit of increasing data accessibility to researchers and analysts is better informed public policy. To realize this benefit, a variety of modes for data accessâ€" including restricted access to confidential data and unrestricted access to appropriately altered public-use dataâ€"must be used. The risk of expanded access to potentially sensitive data is the increased probability of breaching the confidentiality of the data and, in turn, eroding public confidence in the data collection enterprise. Indeed, the statistical system of the United States ultimately depends on the willingness of the public to provide the information on which research data are based. Expanding Access to Research Data issues guidance on how to more fully exploit these tradeoffs. The panel's recommendations focus on needs highlighted by legal, social, and technological changes that have occurred during the last decade.

The need for quality improvement and for cost saving are driving both individual choices and health system dynamics. The health services research that we need to support informed choices depends on access to data, but at the same time, individual privacy and patient-health care provider confidentiality must be protected.

In the realm of health care, privacy protections are needed to preserve patients' dignity and prevent possible harms. Ten years ago, to address these concerns as well as set guidelines for ethical health research, Congress called for a set of federal standards now known as the HIPAA Privacy Rule. In its 2009 report, Beyond the HIPAA Privacy Rule: Enhancing Privacy, Improving Health Through Research, the Institute of Medicine's Committee on Health Research and the Privacy of Health Information concludes that the HIPAA Privacy Rule does not protect privacy as well as it should, and that it impedes important health research.