Winner of the 2017 AERA Division D Significant Contribution to Educational Measurement and Research Methodology Award! Technological and statistical advances, along with a strong interest in gathering more information about the state of our educational systems, have made it possible to assess more students, in more countries, more often, and in more subject domains. The Handbook of International Large-Scale Assessment: Background, Technical Issues, and Methods of Data Analysis brings together recognized scholars in the field of ILSA, behavioral statistics, and policy to develop a detailed guide that goes beyond database user manuals. After highlighting the importance of ILSA data to policy and research, the book reviews methodological aspects and features of the studies based on operational considerations, analytics, and reporting. The book then describes methods of interest to advanced graduate students, researchers, and policy analysts who have a good grounding in quantitative methods, but who are not necessarily quantitative methodologists. In addition, it provides a detailed exposition of the technical details behind these assessments, including the test design, the sampling framework, and estimation methods, with a focus on how these issues impact analysis choices.

This handbook is the first of its kind to provide a general and comprehensive overview of virtually every aspect of International Large Scale Assessment (ILSA). It includes historical, economic, and policy perspectives, theoretical foundations, methodology, and reviews of findings from analyses of ILSA data. After decades, during which ILSAs have generated knowledge within central areas of education research and gained increased and substantial impact on educational policy, practice and research, such a broad overview for a wide-ranging audience is much needed. With contributions from authors and editors from all continents, this handbook appeals to an international audience and keeps a neutral perspective, not favoring one ILSA over another. The handbook is suitable to be read by politicians, researchers and stakeholders who are seeking an overview of ILSAs, their history and development, and both potential benefits and limitations with regard to policy implications. The reviews of findings from studies analyzing ILSA data will be of interest to stakeholders, teachers, researchers, and policymakers. Considering that the reviews extend to all fields pertaining to educational research, the book will be valuable to all researchers interested in education. Students may use the book to learn about ILSAs in the context of policy, theoretical underpinnings, or research. Moreover, the methodology section is written in a manner that is understandable and accessible for students, stakeholders, or researchers not familiar with these data. This methodology part, however, is also a valuable resource for researchers who are familiar with ILSA data, as it provides overviews of the design and sampling procedures of several ILSAs, and includes advice on methods of analysis.Even the owners of the ILSAs may find the book valuable, as it contains overviews and insights into a number of ILSAs, provides information how the data is used by the research community, and includes recommendations for future instruments.

Technological and statistical advances, along with a strong interest in gathering more information about the state of our educational systems, have made it possible to assess more students, in more countries, more often, and in more subject domains. The Handbook of International Large-Scale Assessment: Background, Technical Issues, and Methods of Data Analysis brings together recognized scholars in the field of ILSA, behavioral statistics, and policy to develop a detailed guide that goes beyond database user manuals. After highlighting the importance of ILSA data to policy and research, the book reviews methodological aspects and features of the studies based on operational considerations, analytics, and reporting. The book then describes methods of interest to advanced graduate students, researchers, and policy analysts who have a good grounding in quantitative methods, but who are not necessarily quantitative methodologists. In addition, it provides a detailed exposition of the technical details behind these assessments, including the test design, the sampling framework, and estimation methods, with a focus on how these issues impact analysis choices.

Formative assessment has recently become a focus of renewed research as state and federal policy-makers realize that summative assessments have reached a point of diminishing returns as a tool for increasing student achievement. Consequently, supporters of large-scale testing programs are now beginning to consider the potential of formative assessments to improve student achievement. The mission of this handbook is to comprehensively profile this burgeoning field of study. Written by leading international scholars and practitioners, each chapter includes a discussion of key issues that dominate formative assessment policy and practice today, as well as those that are likely to affect research and practice in the coming years. Key features include: Comprehensive – nineteen chapters cover all aspects of formative assessment including classroom assessment, large-scale applications, technological applications, applications for special needs students, K-12 and post-secondary applications, psychometric considerations, case studies, and discussion of alternative assessment formats such as portfolios and performance assessments. Integrative – thoughtful attention is given to the integration of large-scale and classroom assessments. Practical – provides practical guidance on how to conduct formative assessments that generate credible information to guide instruction. Global – provides perspectives from leading international scholars and practitioners whose expertise spans diverse settings, student populations, and educational systems. Accessible Style – although grounded in the latest research, the book’s style and tone has been carefully crafted to make it accessible to both the textbook and professional markets. It will also be a critical reference book for researchers in teacher preparation, educational administration, and educational policy studies.

This open access book describes and reviews the development of the quality control mechanisms and methodologies associated with IEA’s extensive program of educational research. A group of renowned international researchers, directly involved in the design and execution of IEA’s international large-scale assessments (ILSAs), describe the operational and quality control procedures that are employed to address the challenges associated with providing high-quality, comparable data. Throughout the now considerable history of IEA’s international large-scale assessments, establishing the quality of the data has been paramount. Research in the complex multinational context in which IEA studies operate imposes significant burdens and challenges in terms of the methodologies and technologies that have been developed to achieve the stated study goals. The demands of the twin imperatives of validity and reliability must be satisfied in the context of multiple and diverse cultures, languages, orthographies, educational structures, educational histories, and traditions. Readers will learn about IEA’s approach to such challenges, and the methods used to ensure that the quality of the data provided to policymakers and researchers can be trusted. An often neglected area of investigation, namely the consequential validity of ILSAs, is also explored, examining issues related to reporting, dissemination, and impact, including discussion of the limits of interpretation. The final chapters address the question of the influence of ILSAs on policy and reform in education, including a case study from Singapore, a country known for its outstanding levels of achievement, but which nevertheless seeks the means of continual improvement, illustrating best practice use of ILSA data.

Bringing together the expertise of top evaluation leaders from around the world, The SAGE International Handbook of Educational Evaluation addresses methods and applications in the field, particularly as they relate to policy- and decision-making in an era of globalization. The comprehensive collection of articles in the Handbook compels readers to consider globalization influences on educational evaluation within distinct genres or families of evaluation approaches. Key Features Discusses substantive issues surrounding globalization, and its implication for educational policy and practice and ultimately evaluation; Includes state-of-the-art theory chapters and method chapters within scientific, accountability-oriented, learning-oriented, and political genres of evaluation approaches; Provides real-world case exemplar chapters to illustrate core concepts within genres; Extends dialogue on controversial topics and contemporary educational evaluation tensions in the context of globalization; Summarizes, by means of an integration chapter, the issues, tensions and dilemmas confronting educational evaluators in an era of globalization. Serving as a state-of-the-art resource on educational evaluation, this volume is designed for graduate students, evaluation scholars and researchers and professional evaluation practitioners with an interest in educational program and policy evaluation.

This open access book describes and reviews the development of the quality control mechanisms and methodologies associated with IEA’s extensive program of educational research. A group of renowned international researchers, directly involved in the design and execution of IEA’s international large-scale assessments (ILSAs), describe the operational and quality control procedures that are employed to address the challenges associated with providing high-quality, comparable data. Throughout the now considerable history of IEA’s international large-scale assessments, establishing the quality of the data has been paramount. Research in the complex multinational context in which IEA studies operate imposes significant burdens and challenges in terms of the methodologies and technologies that have been developed to achieve the stated study goals. The demands of the twin imperatives of validity and reliability must be satisfied in the context of multiple and diverse cultures, languages, orthographies, educational structures, educational histories, and traditions. Readers will learn about IEA’s approach to such challenges, and the methods used to ensure that the quality of the data provided to policymakers and researchers can be trusted. An often neglected area of investigation, namely the consequential validity of ILSAs, is also explored, examining issues related to reporting, dissemination, and impact, including discussion of the limits of interpretation. The final chapters address the question of the influence of ILSAs on policy and reform in education, including a case study from Singapore, a country known for its outstanding levels of achievement, but which nevertheless seeks the means of continual improvement, illustrating best practice use of ILSA data.