Signal Detection Theory and ROC Analysis in Psychology and Diagnostics

Signal Detection Theory and ROC Analysis in Psychology and Diagnostics
Title Signal Detection Theory and ROC Analysis in Psychology and Diagnostics PDF eBook
Author John A. Swets
Publisher Psychology Press
Total Pages 325
Release 2014-02-25
Genre Psychology
ISBN 131777972X

Download Signal Detection Theory and ROC Analysis in Psychology and Diagnostics Book in PDF, Epub and Kindle

Signal detection theory--as developed in electrical engineering and based on statistical decision theory--was first applied to human sensory discrimination 40 years ago. The theoretical intent was to provide a valid model of the discrimination process; the methodological intent was to provide reliable measures of discrimination acuity in specific sensory tasks. An analytic method of detection theory, called the relative operating characteristic (ROC), can isolate the effect of the placement of the decision criterion, which may be variable and idiosyncratic, so that a pure measure of intrinsic discrimination acuity is obtained. For the past 20 years, ROC analysis has also been used to measure the discrimination acuity or inherent accuracy of a broad range of practical diagnostic systems. It was widely adopted by methodologists in the field of information retrieval, is increasingly used in weather forecasting, and is the generally preferred method in clinical medicine, primarily in radiology. This book attends to both themes, ROC analysis in the psychology laboratory and in practical diagnostic settings, and to their essential unity. The focus of this book is on detection and recognition as fundamental tasks that underlie most complex behaviors. As defined here, they serve to distinguish between two alternative, confusable stimulus categories, which may be perceptual or cognitive categories in the psychology laboratory, or different states of the world in practical diagnostic tasks. This book on signal detection theory in psychology was written by one of the developers of the theory, who co-authored with D.M. Green the classic work published in this area in 1966 (reprinted in 1974 and 1988). This volume reviews the history of the theory in engineering, statistics, and psychology, leading to the separate measurement of the two independent factors in all discrimination tasks, discrimination acuity and decision criterion. It extends the previous book to show how in several areas of psychology--in vigilance and memory--what had been thought to be discrimination effects were, in reality, effects of a changing criterion. The book shows that data plotted in terms of the relative operating characteristic have essentially the same form across the wide range of discrimination tasks in psychology. It develops the implications of this ROC form for measures of discrimination acuity, pointing up the valid ones and identifying several common, but invalid, ones. The area under the binormal ROC is seen to be supported by the data; the popular measures d' and percent correct are not. An appendix describes the best, current programs for fitting ROCs and estimating their parameters, indices, and standard errors. The application of ROC analysis to diagnostic tasks is also described. Diagnostic accuracy in a wide range of tasks can be expressed in terms of the ROC area index. Choosing the appropriate decision criterion for a given diagnostic setting--rather than considering some single criterion to be natural and fixed--has a major impact on the efficacy of a diagnostic process or system. Illustrated here by separate chapters are diagnostic systems in radiology, information retrieval, aptitude testing, survey research, and environments in which imminent dangerous conditions must be detected. Data from weather forecasting, blood testing, and polygraph lie detection are also reported. One of these chapters describes a general approach to enhancing the accuracy of diagnostic systems.

Evaluation of diagnostic systems

Evaluation of diagnostic systems
Title Evaluation of diagnostic systems PDF eBook
Author John Swets
Publisher Elsevier
Total Pages 270
Release 2012-12-02
Genre Reference
ISBN 0323141641

Download Evaluation of diagnostic systems Book in PDF, Epub and Kindle

Evaluation of Diagnostic Systems: Methods from Signal Detection Theory addresses the many issues that arise in evaluating the performance of a diagnostic system, across the wide range of settings in which such systems are used. These settings include clinical medicine, industrial quality control, environmental monitoring and investigation, machine and metals inspection, military monitoring, information retrieval, and crime investigation. The book is divided into three parts encompassing 11 chapters that emphasize the interpretation of diagnostic visual images by human observers. The first part of the book describes quantitative methods for measuring the accuracy of a system and the statistical techniques for drawing inferences from performance tests. The subsequent part covers study design and includes a detailed description of the form and conduct of an image-interpretation test. The concluding part examines the case study of a medical imaging system that serves as an example of both simple and complex applications. In this part, three mammographic modalities are used: industrial film radiography, low-dose film radiography, and xeroradiography. The case study focuses on the overall reliability of accuracy indices made by its main components, that is, the variabilities across cases, across readers, and within individual readers. The supplementary texts provide study protocols, a computer program for processing test results, and an extensive list of references that will assist the reader in applying those evaluative methods to diagnostic systems in any setting. This book is of value to scientists and engineers, as well as to applied, quantitative, or experimental psychologists who are engaged in the study of the human processes of discrimination and decision making in either perceptual or cognitive tasks.

Signal Detection Theory and ROC-analysis

Signal Detection Theory and ROC-analysis
Title Signal Detection Theory and ROC-analysis PDF eBook
Author James P. Egan
Publisher
Total Pages 312
Release 1975
Genre Education
ISBN

Download Signal Detection Theory and ROC-analysis Book in PDF, Epub and Kindle

Detection Theory

Detection Theory
Title Detection Theory PDF eBook
Author Neil A. Macmillan
Publisher Psychology Press
Total Pages 599
Release 2004-09-22
Genre Psychology
ISBN 1135634564

Download Detection Theory Book in PDF, Epub and Kindle

Detection Theory is an introduction to one of the most important tools for analysis of data where choices must be made and performance is not perfect. Originally developed for evaluation of electronic detection, detection theory was adopted by psychologists as a way to understand sensory decision making, then embraced by students of human memory. It has since been utilized in areas as diverse as animal behavior and X-ray diagnosis. This book covers the basic principles of detection theory, with separate initial chapters on measuring detection and evaluating decision criteria. Some other features include: *complete tools for application, including flowcharts, tables, pointers, and software; *student-friendly language; *complete coverage of content area, including both one-dimensional and multidimensional models; *separate, systematic coverage of sensitivity and response bias measurement; *integrated treatment of threshold and nonparametric approaches; *an organized, tutorial level introduction to multidimensional detection theory; *popular discrimination paradigms presented as applications of multidimensional detection theory; and *a new chapter on ideal observers and an updated chapter on adaptive threshold measurement. This up-to-date summary of signal detection theory is both a self-contained reference work for users and a readable text for graduate students and other researchers learning the material either in courses or on their own.

Signal Detection Theory and Psychophysics

Signal Detection Theory and Psychophysics
Title Signal Detection Theory and Psychophysics PDF eBook
Author David Marvin Green
Publisher
Total Pages 504
Release 1974
Genre Signal detection (Psychology).
ISBN

Download Signal Detection Theory and Psychophysics Book in PDF, Epub and Kindle

A Primer of Signal Detection Theory

A Primer of Signal Detection Theory
Title A Primer of Signal Detection Theory PDF eBook
Author Don McNicol
Publisher Psychology Press
Total Pages 249
Release 2005-01-15
Genre Psychology
ISBN 1135604673

Download A Primer of Signal Detection Theory Book in PDF, Epub and Kindle

A Primer of Signal Detection Theory is being reprinted to fill the gap in literature on Signal Detection Theory--a theory that is still important in psychology, hearing, vision, audiology, and related subjects. This book is intended to present the methods of Signal Detection Theory to a person with a basic mathematical background. It assumes knowledge only of elementary algebra and elementary statistics. Symbols and terminology are kept at a basic level so that the eventual and hoped for transfer to a more advanced text will be accomplished as easily as possible. Intended for undergraduate students at an introductory level, the book is divided into two sections. The first part introduces the basic ideas of detection theory and its fundamental measures. Its aim is to enable the reader to be able to understand and compute these measures. It concludes with a detailed analysis of a typical experiment and a discussion of some of the problems which can arise for the potential user of detection theory. The second section considers three more advanced topics: threshold theory, the extension of detection theory, and an examination of Thurstonian scaling procedures.

Signal Detection and Recognition by Human Observers

Signal Detection and Recognition by Human Observers
Title Signal Detection and Recognition by Human Observers PDF eBook
Author John A. Swets
Publisher
Total Pages 726
Release 1964
Genre Medical
ISBN

Download Signal Detection and Recognition by Human Observers Book in PDF, Epub and Kindle