The Understanding Research series focuses on the process of writing up social research. The series is broken down into three categories: Understanding Statistics, Understanding Measurement, and Understanding Qualitative Research. The books provide researchers with guides to understanding, writing, and evaluating social research. Each volume demonstrates how research should be represented, including how to write up the methodology as well as the research findings. Each volume also reviews how to appropriately evaluate published research. Validity and Validation is an introduction to validity theory and to the methods used to obtain evidence for the validity of research and assessment results. The book pulls together the best thinking from educational and psychological research and assessment over the past 50 years. It briefly describes validity theory's roots in the philosophy of science. It highlights the ways these philosophical perspectives influence concepts of internal and external validity in research methodology, as well as concepts of validity and reliability in educational and psychological tests and measurements. Each chapter provides multiple examples (e.g., research designs and examples of output) to help the readers see how validation work is done in practice, from the ways we design research studies to the ways we interpret research results. Of particular importance is the practical focus on validation of scores from tests and other measures. The book also addresses strategies for investigating the validity of inferences we make about examinees using scores from assessments, as well as how to investigate score uses, the value implications of score interpretations, and the social consequences of score use. With this foundation, the book presents strategies for minimizing threats for validity as well as quantitative and qualitative methods for gathering evidence for the validity of scores.

This book combines an overview of validity theory, trends in validation practices and a review of standards and guidelines in several international jurisdictions with research synthesis of the validity evidence in different research areas. An overview of theory is both useful and timely, in view of the increased use of tests and measures for decision-making, ranking and policy purposes in large-scale testing, assessment and social indicators and quality of life research. Research synthesis is needed to help us assemble, critically appraise and integrate the overwhelming volume of research on validity in different contexts. Rather than examining whether any given measure is “valid”, the focus is on a critical appraisal of the kinds of validity evidence reported in the published research literature. The five sources of validity evidence discussed are: content-related, response processes, internal structure, associations with other variables and consequences. The 15 syntheses included here, represent a broad sampling of psychosocial, health, medical and educational research settings, giving us an extensive evidential basis to build upon earlier studies. The book concludes with a meta-synthesis of the 15 syntheses and a discussion of the current thinking of validation practices by leading experts in the field.

Alternative Validation Strategies is a groundbreaking compendium of the most current research and practical guidelines for time- and cost-saving alternatives to the traditional test validation strategies associated with selection processes. The “state of the science” strategies outlined in this valuable resource will help employers to evaluate the inferences drawn from their selection procedures while offering practices that meet stringent legal and regulatory requirements.

Validity and Validation is an introduction to validity theory and to the methods used to obtain evidence for the validity of research and assessment results. The book briefly describes the philosophy of science roots of validity theory and how these philosophical perspectives influence concepts of internal and external validity in research methodology.

Carol A. Chapelle shows readers how to design validation research for tests of human capacities and performance. Any test that is used to make decisions about people or programs should have undergone extensive research to demonstrate that the scores are actually appropriate for their intended purpose. Argument-Based Validation in Testing and Assessment is intended to help close the gap between theory and practice, by introducing, explaining, and demonstrating how test developers can formulate the overall design for their validation research from an argument-based perspective.

This volume addresses an urgent need across multiple disciplines to broaden our understanding and use of response processes evidence of test validity. It builds on the themes and findings of the volume Validity and Validation in Social, Behavioral, and Health Sciences (Zumbo & Chan, 2014), with a focus on measurement validity evidence based on response processes. Approximately 1000 studies are published each year examining the validity of inferences made from tests and measures in the social, behavioural, and health sciences. The widely accepted Standards for Educational and Psychological Testing (1999, 2014) present five sources of evidence for validity: content-related, response processes, internal structure, relationships with other variables, and consequences of testing. Many studies focus on internal structure and relationships with other variables sources of evidence, which have a long history in validation research, known methodologies, and numerous exemplars in the literature. Far less is understood by test users and researchers conducting validation work about how to think about and apply new and emerging sources of validity evidence. This groundbreaking volume is the first to present conceptual models of response processes, methodological issues that arise in gathering response processes evidence, as well as applications and exemplars for providing response processes evidence in validation work.

This book critically examines the historical and philosophical foundations of construct validity theory (CVT), and how these have and continue to inform and constrain the conceptualization of validity and its application in research. CVT has had an immense impact on how researchers in the behavioural sciences conceptualize and approach their subject matter. Yet, there is equivocation regarding the foundations of the CVT framework as well as ambiguities concerning the nature of the “constructs” that are its raison d’etre. The book is organized in terms of three major parts that speak, respectively, to the historical, philosophical, and pragmatic dimensions of CVT. The primary objective is to provide researchers and students with a critical lens through which a deeper understanding may be gained of both the utility and limitations of CVT and the validation practices to which it has given rise.