Managing Data in Motion describes techniques that have been developed for significantly reducing the complexity of managing system interfaces and enabling scalable architectures. Author April Reeve brings over two decades of experience to present a vendor-neutral approach to moving data between computing environments and systems. Readers will learn the techniques, technologies, and best practices for managing the passage of data between computer systems and integrating disparate data together in an enterprise environment. The average enterprise's computing environment is comprised of hundreds to thousands computer systems that have been built, purchased, and acquired over time. The data from these various systems needs to be integrated for reporting and analysis, shared for business transaction processing, and converted from one format to another when old systems are replaced and new systems are acquired. The management of the "data in motion" in organizations is rapidly becoming one of the biggest concerns for business and IT management. Data warehousing and conversion, real-time data integration, and cloud and "big data" applications are just a few of the challenges facing organizations and businesses today. Managing Data in Motion tackles these and other topics in a style easily understood by business and IT managers as well as programmers and architects. Presents a vendor-neutral overview of the different technologies and techniques for moving data between computer systems including the emerging solutions for unstructured as well as structured data types Explains, in non-technical terms, the architecture and components required to perform data integration Describes how to reduce the complexity of managing system interfaces and enable a scalable data architecture that can handle the dimensions of "Big Data"

In this IBM® Redbooks® publication, we discuss and describe the positioning, functions, capabilities, and advanced programming techniques for IBM InfoSphereTM Streams (V1). See: http://www.redbooks.ibm.com/abstracts/sg247970.html for the newer InfoSphere Streams (V2) release. Stream computing is a new paradigm. In traditional processing, queries are typically run against relatively static sources of data to provide a query result set for analysis. With stream computing, a process that can be thought of as a continuous query, that is, the results are continuously updated as the data sources are refreshed. So, traditional queries seek and access static data, but with stream computing, a continuous stream of data flows to the application and is continuously evaluated by static queries. However, with IBM InfoSphere Streams, those queries can be modified over time as requirements change. IBM InfoSphere Streams takes a fundamentally different approach to continuous processing and differentiates itself with its distributed runtime platform, programming model, and tools for developing continuous processing applications. The data streams consumable by IBM InfoSphere Streams can originate from sensors, cameras, news feeds, stock tickers, and a variety of other sources, including traditional databases. It provides an execution platform and services for applications that ingest, filter, analyze, and correlate potentially massive volumes of continuous data streams.

Besides the courseware publication (ISBN: 9789401807999), you are advised to obtain the DAMA DMBOK publication (ISBN: 9781634622349). Optionally, you can use the publication Data management: a gentle introduction (ISBN: 9789401805506) as inspiration for examples and quotes about the field of data management. This material is intended to prepare participants for the CDMP exam by DAMA International. The courseware can only be ordered by partners and is based on the current version of the DAMA DMBOK. The material will be updated when new versions of DMBOK are published. DAMA DMBOK is the industry reference for data management. It is published by DAMA International and is currently in its second version. The DMBOK is developed by professionals and can be seen as a collection of best practices. The domain of data management is divided into functional areas which are discussed in terms of definitions (what is it), goals (what are we trying to achieve), steps (what are typical activities), inputs/outputs, and participating roles. Developing and sustaining an effective data management function is far from an easy task. The DMBOK framework is adopted by many organizations as the foundation for their data management function: standardized language and good practices speed up the learning process. After the training, you have an overview of the field of data management, its terminology, and current best practices.

Master the hottest technology around to drive marketing success Marketers are faced with a stark and challenging dilemma: customers demand deep personalization, but they are increasingly leery of offering the type of personal data required to make it happen. As a solution to this problem, Customer Data Platforms have come to the fore, offering companies a way to capture, unify, activate, and analyze customer data. CDPs are the hottest marketing technology around today, but are they worthy of the hype? Customer Data Platforms takes a deep dive into everything CDP so you can learn how to steer your firm toward the future of personalization. Over the years, many of us have built byzantine “stacks” of various marketing and advertising technology in an attempt to deliver the fabled “right person, right message, right time” experience. This can lead to siloed systems, disconnected processes, and legacy technical debt. CDPs offer a way to simplify the stack and deliver a balanced and engaging customer experience. Customer Data Platforms breaks down the fundamentals, including how to: Understand the problems of managing customer data Understand what CDPs are and what they do (and don't do) Organize and harmonize customer data for use in marketing Build a safe, compliant first-party data asset that your brand can use as fuel Create a data-driven culture that puts customers at the center of everything you do Understand how to use AI and machine learning to drive the future of personalization Orchestrate modern customer journeys that react to customers in real-time Power analytics with customer data to get closer to true attribution In this book, you’ll discover how to build 1:1 engagement that scales at the speed of today’s customers.

Find the right big data solution for your business or organization Big data management is one of the major challenges facing business, industry, and not-for-profit organizations. Data sets such as customer transactions for a mega-retailer, weather patterns monitored by meteorologists, or social network activity can quickly outpace the capacity of traditional data management tools. If you need to develop or manage big data solutions, you'll appreciate how these four experts define, explain, and guide you through this new and often confusing concept. You'll learn what it is, why it matters, and how to choose and implement solutions that work. Effectively managing big data is an issue of growing importance to businesses, not-for-profit organizations, government, and IT professionals Authors are experts in information management, big data, and a variety of solutions Explains big data in detail and discusses how to select and implement a solution, security concerns to consider, data storage and presentation issues, analytics, and much more Provides essential information in a no-nonsense, easy-to-understand style that is empowering Big Data For Dummies cuts through the confusion and helps you take charge of big data solutions for your organization.

A collection of the best contributions from DataFlux's featured experts.

Executing Data Quality Projects, Second Edition presents a structured yet flexible approach for creating, improving, sustaining and managing the quality of data and information within any organization. Studies show that data quality problems are costing businesses billions of dollars each year, with poor data linked to waste and inefficiency, damaged credibility among customers and suppliers, and an organizational inability to make sound decisions. Help is here! This book describes a proven Ten Step approach that combines a conceptual framework for understanding information quality with techniques, tools, and instructions for practically putting the approach to work – with the end result of high-quality trusted data and information, so critical to today’s data-dependent organizations. The Ten Steps approach applies to all types of data and all types of organizations – for-profit in any industry, non-profit, government, education, healthcare, science, research, and medicine. This book includes numerous templates, detailed examples, and practical advice for executing every step. At the same time, readers are advised on how to select relevant steps and apply them in different ways to best address the many situations they will face. The layout allows for quick reference with an easy-to-use format highlighting key concepts and definitions, important checkpoints, communication activities, best practices, and warnings. The experience of actual clients and users of the Ten Steps provide real examples of outputs for the steps plus highlighted, sidebar case studies called Ten Steps in Action. This book uses projects as the vehicle for data quality work and the word broadly to include: 1) focused data quality improvement projects, such as improving data used in supply chain management, 2) data quality activities in other projects such as building new applications and migrating data from legacy systems, integrating data because of mergers and acquisitions, or untangling data due to organizational breakups, and 3) ad hoc use of data quality steps, techniques, or activities in the course of daily work. The Ten Steps approach can also be used to enrich an organization’s standard SDLC (whether sequential or Agile) and it complements general improvement methodologies such as six sigma or lean. No two data quality projects are the same but the flexible nature of the Ten Steps means the methodology can be applied to all. The new Second Edition highlights topics such as artificial intelligence and machine learning, Internet of Things, security and privacy, analytics, legal and regulatory requirements, data science, big data, data lakes, and cloud computing, among others, to show their dependence on data and information and why data quality is more relevant and critical now than ever before. Includes concrete instructions, numerous templates, and practical advice for executing every step of The Ten Steps approach Contains real examples from around the world, gleaned from the author’s consulting practice and from those who implemented based on her training courses and the earlier edition of the book Allows for quick reference with an easy-to-use format highlighting key concepts and definitions, important checkpoints, communication activities, and best practices A companion Web site includes links to numerous data quality resources, including many of the templates featured in the text, quick summaries of key ideas from the Ten Steps methodology, and other tools and information that are available online