What are students learning? Throughout the world, governments striving to improve educational quality are turning to national assessments to provide this much-needed information in key curriculum areas. The capacity for carrying out national assessments has grown remarkably in recent years, but it has not been matched by widespread use of their findings. This book seeks to maximize an appreciation for the value of such data and to assist countries in exploiting the knowledge that national assessments yield. Using the Results of a National Assessment of Educational Achievement identifies the main factors affecting the use of national assessment findings. These include the political context in which an assessment is carried out, the nature of the assessment (census based or sample based), the assignment of accountability for the results, and the quality of assessment instruments. The book describes the type of information that the main report of a national assessment should contain, as well as other means of communicating findings to technical and nontechnical audiences. It outlines general considerations in translating national assessment results into policy and action, and examines specific procedures for using the data in policy making, educational management, teaching, and promoting public awareness. The topics addressed in this volume should be of interest to policy makers, educators, researchers, and development practitioners.

This volume provides step-by-step details on how to analyze data collected in a national assessment, with an introduction to statistical analyses normally carried out in these large-scale assessments, item and test analysis, and a CD contains with analysis software (IATA), exercises and supporting data files.

Since the late 1960s, the National Assessment of Educational Progress (NAEP)--the nation's report card--has been the only continuing measure of student achievement in key subject areas. Increasingly, educators and policymakers have expected NAEP to serve as a lever for education reform and many other purposes beyond its original role. Grading the Nation's Report Card examines ways NAEP can be strengthened to provide more informative portrayals of student achievement and the school and system factors that influence it. The committee offers specific recommendations and strategies for improving NAEP's effectiveness and utility, including: Linking achievement data to other education indicators. Streamlining data collection and other aspects of its design. Including students with disabilities and English-language learners. Revamping the process by which achievement levels are set. The book explores how to improve NAEP framework documents--which identify knowledge and skills to be assessed--with a clearer eye toward the inferences that will be drawn from the results. What should the nation expect from NAEP? What should NAEP do to meet these expectations? This book provides a blueprint for a new paradigm, important to education policymakers, professors, and students, as well as school administrators and teachers, and education advocates.

The issues surrounding the comparability of various tests used to assess performance in schools received broad public attention during congressional debate over the Voluntary National Tests proposed by President Clinton in his 1997 State of the Union Address. Proponents of Voluntary National Tests argue that there is no widely understood, challenging benchmark of individual student performance in 4th-grade reading and 8th-grade mathematics, thus the need for a new test. Opponents argue that a statistical linkage among tests already used by states and districts might provide the sort of comparability called for by the president's proposal. Public Law 105-78 requested that the National Research Council study whether an equivalency scale could be developed that would allow test scores from existing commercial tests and state assessments to be compared with each other and with the National Assessment of Education Progress. In this book, the committee reviewed research literature on the statistical and technical aspects of creating valid links between tests and how the content, use, and purposes of education testing in the United States influences the quality and meaning of those links. The book summarizes relevant prior linkage studies and presents a picture of the diversity of state testing programs. It also looks at the unique characteristics of the National Assessment of Educational Progress. Uncommon Measures provides an answer to the question posed by Congress in Public Law 105-78, suggests criteria for evaluating the quality of linkages, and calls for further research to determine the level of precision needed to make inferences about linked tests. In arriving at its conclusions, the committee acknowledged that ultimately policymakers and educators must take responsibility for determining the degree of imprecision they are willing to tolerate in testing and linking. This book provides science-based information with which to make those decisions.

The National Assessment of Educational Progress (NAEP), known as the nation's report card, has chronicled students' academic achievement in America for over a quarter of a century. It has been a valued source of information about students' performance, providing the best available trend data on the academic achievement of elementary, middle, and secondary school students in key subject areas. NAEP's prominence and the important need for stable and accurate measures of academic achievement call for evaluation of the program and an analysis of the extent to which its results are reasonable, valid, and informative to the public. This volume of papers considers the use and application of NAEP. It provides technical background to the recently published book, Grading the Nation's Report Card: Evaluating NAEP and Transforming the Assessment of Educational Progress (NRC, 1999), with papers on four key topics: NAEP's assessment development, content validity, design and use, and more broadly, the design of education indicator systems.