This book presents prospective, industrially proven methods and software solutions for storing, processing, and viewing multimedia content on digital cameras, camcorders, TV, and mobile devices. Most of the algorithms described here are implemented as systems on chip firmware or as software products and have low computational complexity and memory consumption. In the four parts of the book, which contains a total of 16 chapters, the authors address solutions for the conversion of images and videos by super-resolution, depth estimation and control and mono-to-stereo (2D to 3D) conversion; display applications by video editing; the real-time detection of sport episodes; and the generation and reproduction of natural effects. The practical principles of machine learning are illustrated using technologies such as image classification as a service, mobile user profiling, and automatic view planning with dictionary-based compressed sensing in magnetic resonance imaging. The implementation of these technologies in mobile devices is discussed in relation to algorithms using a depth camera based on a colour-coded aperture, the animated graphical abstract of an image, a motion photo, and approaches and methods for iris recognition on mobile platforms. The book reflects the authors’ practical experience in the development of algorithms for industrial R&D and the commercialization of technologies. Explains digital techniques for digital cameras, camcorders, TV, mobile devices; Offers essential algorithms for the processing pipeline in multimedia devices and accompanying software tools; Features advanced topics on data processing, addressing current technology challenges.

This book constitutes the proceedings of the First International Conference on Smart Multimedia, ICSM 2018, which was held in Toulon, France, in August 2018. The 39 papers presented were selected from about 100 submissions and are grouped in sections on social, affective and cognition analysis, person-centered smart multimedia: serving people with disabilities to the general population, haptic and robots for smart multimedia applications, MR, 3D, underwater image processing, smart signal processing meets smart sensing, visual behavior analysis: methods and applications, video analysis, learning, low-level vision, miscellaneous.

This book presents applications of machine learning techniques in processing multimedia large-scale data. Multimedia such as text, image, audio, video, and graphics stands as one of the most demanding and exciting aspects of the information era. The book discusses new challenges faced by researchers in dealing with these large-scale data and also presents innovative solutions to address several potential research problems, e.g., enabling comprehensive visual classification to fill the semantic gap by exploring large-scale data, offering a promising frontier for detailed multimedia understanding, as well as extract patterns and making effective decisions by analyzing the large collection of data.

Real-Time Image and Video Processing presents an overview of the guidelines and strategies for transitioning an image or video processing algorithm from a research environment into a real-time constrained environment. Such guidelines and strategies are scattered in the literature of various disciplines including image processing, computer engineering, and software engineering, and thus have not previously appeared in one place. By bringing these strategies into one place, the book is intended to serve the greater community of researchers, practicing engineers, industrial professionals, who are interested in taking an image or video processing algorithm from a research environment to an actual real-time implementation on a resource constrained hardware platform. These strategies consist of algorithm simplifications, hardware architectures, and software methods.Throughout the book, carefully selected, representative examples from the literature are presented to illustrate the discussed concepts. After reading the book, readers will have a strong understanding of the wide variety of techniques and tools involved in designing a real-time image or video processing system.

This book describes the algorithms and computer architectures used to create and analyze photographs in modern digital cameras. It also puts the capabilities of digital cameras into context for applications in art, entertainment, and video analysis. The author discusses the entire range of topics relevant to digital camera design, including image processing, computer vision, image sensors, system-on-chip, and optics, while clearly describing the interactions between design decisions at these different levels of abstraction. Readers will benefit from this comprehensive view of digital camera design, describing the range of algorithms used to compose, enhance, and analyze images, as well as the characteristics of optics, image sensors, and computing platforms that determine the physical limits of image capture and computing. The content is designed to be used by algorithm designers and does not require an extensive background in optics or electronics.

Advances in artificial intelligence (AI), widespread mobile devices, internet technologies, multimedia data sources, and information processing have led to the emergence of multimedia processing. Multimedia processing is the application of signal processing tools to multimedia data—text, audio, images, and video—to allow the interpretation of these data, particularly in urban and smart city environments. This book discusses the new standards of multimedia and information processing from several technological perspectives, including analytics empowered by AI, streaming on the intelligent edge, multimedia edge caching and AI, services for edge AI, and hardware and devices for multimedia on edge intelligence. FEATURES Covers a wide spectrum of enabling technologies for AI and machine learning for multimedia and information processing Includes many applications using AI, from robotics and driverless cars to environmental, human health, and remote sensing Presents an overview of the fundamentals of AI and multimedia processing: imaging, signal, and speech Explains new models and architectures for multimedia streaming, services, and caching for AI Discusses the emerging paradigms of the deployment of hardware and devices for multimedia on edge intelligence Gives recommendations for future research in multimedia and AI This book is written for engineers and graduate students in image and signal processing, information processing, environmental engineering, medical and public health, etc., who are interested in machine learning, deep learning, and multimedia processing.

This book constitutes the proceedings of the Second International Conference on Smart Multimedia, ICSM 2019, which was held in San Diego, CA, USA, in December 2019. The 45 papers presented were selected from about 100 submissions and are grouped in sections on 3D mesh and depth image processing; image understanding; miscellaneous; smart multimedia for citizen-centered smart living; 3D perception and applications; video applications; multimedia in medicine; haptics and applications; smart multimedia beyond the visible spectrum; machine learning for multimedia; image segmentation and processing; biometrics; 3D and image processing; and smart social and connected household products.