Don't fly blind. See how the power of experiments works for you. When it comes to improving customer experiences, trying out new business models, or developing new products, even the most experienced managers often get it wrong. They discover that intuition, experience, and big data alone don't work. What does? Running disciplined business experiments. And what if companies roll out new products or introduce new customer experiences without running these experiments? They fly blind. That's what Harvard Business School professor Stefan Thomke shows in this rigorously researched and eye-opening book. It guides you through best practices in business experimentation, illustrates how these practices work at leading companies, and answers some fundamental questions: What makes a good experiment? How do you test in online and brick-and-mortar businesses? In B2B and B2C? How do you build an experimentation culture? Also, best practice means running many experiments. Indeed, some hugely successful companies, such as Amazon, Booking.com, and Microsoft, run tens of thousands of controlled experiments annually, engaging millions of users. Thomke shows us how these and many other organizations prove that experimentation provides significant competitive advantage. How can managers create this capability at their own companies? Essential is developing an experimentation organization that prizes the science of testing and puts the discipline of experimentation at the center of its innovation process. While it once took companies years to develop the tools for such large-scale experiments, advances in technology have put these tools at the fingertips of almost any business professional. By combining the power of software and the rigor of controlled experiments, today's managers can make better decisions, create magical customer experiences, and generate big financial returns. Experimentation Works is your guidebook to a truly new way of thinking and innovating.

When it comes to innovation, relying on intuition won't cut it anymore. Whether it's improving customer experiences, trying out new business models, or developing new products, even the most experienced managers often get it wrong. This is especially true in the online world, where predicting customer behavior is virtually impossible. Managers can, however, discover whether a new product, service, or business model will fail or succeed--by subjecting it to rigorous experimentation. Think about it. A pharmaceutical company would never introduce a new drug without first conducting a round of experiments based on established scientific protocols. Yet that's essentially what many companies do when they roll out new products and services. As Harvard Business School professor Stefan Thomke shows in this eye-opening and essential book, the "best guess" approach to innovation is changing fast. There are now leading companies that conduct more than ten thousand online controlled experiments annually, engaging millions of users. These organizations have discovered that an "experiment with everything" approach has a big payoff, giving them a considerable competitive advantage. How can you do this at your company? Leaders and managers need to create an "experimentation organization" that masters the science of testing and puts the discipline of experimentation at the center of the innovation process. It used to take companies years to build the infrastructure and develop the expertise to run hundreds of experiments each day. But Thomke shows how, with advances in technology, these capabilities are at the fingertips of almost any business professional. By combining the power of software and the rigor of controlled experiments, today's managers can make better decisions, create better customer experiences, and generate huge financial returns. Filled with engaging and instructive stories of leading experimentation organizations, Experimentation Works will be your guidebook to a truly new way of thinking and innovating.

Every company's ability to innovate depends on a process of experimentation whereby new products and services are created and existing ones improved. But the cost of experimentation often limits innovation. New technologies--including computer modeling and simulation--promise to lift that constraint by changing the economics of experimentation. Never before has it been so economically feasible to ask "what-if" questions and generate preliminary answers. These technologies amplify the impact of learning, paving the way for higher R&D performance and innovation and new ways of creating value for customers.In Experimentation Matters, Stefan Thomke argues that to unlock such potential, companies must not only understand the power of experimentation and new technologies, but also change their processes, organization, and management of innovation. He explains why experimentation is so critical to innovation, underscores the impact of new technologies, and outlines what managers must do to integrate them successfully. Drawing on a decade of research in multiple industries as diverse as automotive, semiconductors, pharmaceuticals, chemicals, and banking, Thomke provides striking illustrations of how companies drive strategy and value creation by accommodating their organizations to new experimentation technologies.As in the outcome of any effective experiment, Thomke also reveals where that has not happened, and explains why. In particular, he shows managers how to: implement "front-loaded" innovation processes that identify potential problems before resources are committed and design decisions locked in; experiment and test frequently without overloading their organizations; integrate new technologies into the current innovation system; organize for rapid experimentation; fail early and often, but avoid wasteful "mistakes"; and manage projects as experiments.Pointing to the custom integrated circuit industry--a multibillion dollar market--Thomke also shows what happens when new experimentation technologies are taken beyond firm boundaries, thereby changing the way companies create new products and services with customers and suppliers. Probing and thoughtful, Experimentation Matters will influence how both executives and academics think about experimentation in general and innovation processes in particular. Experimentation has always been the engine of innovation, and Thomke reveals how it works today.

Animal Experimentation: Working Towards a Paradigm Change critically appraises current animal use in science and discusses ways in which we can contribute to a paradigm change towards human-biology based approaches.

How tech companies like Google, Airbnb, StubHub, and Facebook learn from experiments in our data-driven world—an excellent primer on experimental and behavioral economics Have you logged into Facebook recently? Searched for something on Google? Chosen a movie on Netflix? If so, you've probably been an unwitting participant in a variety of experiments—also known as randomized controlled trials—designed to test the impact of different online experiences. Once an esoteric tool for academic research, the randomized controlled trial has gone mainstream. No tech company worth its salt (or its share price) would dare make major changes to its platform without first running experiments to understand how they would influence user behavior. In this book, Michael Luca and Max Bazerman explain the importance of experiments for decision making in a data-driven world. Luca and Bazerman describe the central role experiments play in the tech sector, drawing lessons and best practices from the experiences of such companies as StubHub, Alibaba, and Uber. Successful experiments can save companies money—eBay, for example, discovered how to cut $50 million from its yearly advertising budget—or bring to light something previously ignored, as when Airbnb was forced to confront rampant discrimination by its hosts. Moving beyond tech, Luca and Bazerman consider experimenting for the social good—different ways that governments are using experiments to influence or “nudge” behavior ranging from voter apathy to school absenteeism. Experiments, they argue, are part of any leader's toolkit. With this book, readers can become part of “the experimental revolution.”

Getting numbers is easy; getting numbers you can trust is hard. This practical guide by experimentation leaders at Google, LinkedIn, and Microsoft will teach you how to accelerate innovation using trustworthy online controlled experiments, or A/B tests. Based on practical experiences at companies that each run more than 20,000 controlled experiments a year, the authors share examples, pitfalls, and advice for students and industry professionals getting started with experiments, plus deeper dives into advanced topics for practitioners who want to improve the way they make data-driven decisions. Learn how to • Use the scientific method to evaluate hypotheses using controlled experiments • Define key metrics and ideally an Overall Evaluation Criterion • Test for trustworthiness of the results and alert experimenters to violated assumptions • Build a scalable platform that lowers the marginal cost of experiments close to zero • Avoid pitfalls like carryover effects and Twyman's law • Understand how statistical issues play out in practice.

The latest experimental design techniques for quality improvement "The methods taught in this book are a major contribution to statistical methods as an aid to engineers, as well as to those in industry, education, or government who are trying to understand the meaning of fi gures derived from comparisons or experiments." -- W. EDWARDS DEMING Co-written by three recipients of the Deming Medal awarded by the American Society for Quality (ASQ), Quality Improvement through Planned Experimentation, Third Edition discusses the principles and methodologies for planning and conducting experiments to improve products, processes, or systems. Fully revised with up-to-date case studies and incorporating new software, this authoritative guide fosters the sequential building of knowledge essential for implementing effective improvements. End-of-chapter exercises reinforce what you've learned, and forms for designing planned experiments help you to integrate the methods in the book into your daily work. The methods of planned experimentation provide an opportunity to better meet the needs of customers, reduce costs, and increase productivity by effecting verifiably beneficial changes. COVERAGE INCLUDES: * Improvement of quality * Principles for design and analysis of planned experiments * Experiments with one factor * Experiments with more than one factor * Reducing the size of experiments * Evaluating sources of variation * Sequential experimentation * Using a time series response variable * Designs with factors at more than two levels * Applications in health care * New product design NEW: Study-it software available for download!