Machine Leaing Infrastructure and Best Practices for Software Engineers: Take your machine leaing software from a prototype to a fully fledged software system
by: Miroslaw Staron (Author)
Publisher: Packt Publishing
Publication Date: 31 Jan. 2024
Language: English
Print Length: 346 pages
ISBN-10: 1837634068
ISBN-13: 9781837634064
Book Description
Efficiently transform your initial designs into big systems by leaing the foundations of infrastructure, algorithms, and ethical considerations for mode software productsKey FeaturesLea how to scale-up your machine leaing software to a professional levelSecure the quality of your machine leaing pipeline at runtimeApply your knowledge to natural languages, programming languages, and imagesBook DescriptionAlthough creating a machine leaing pipeline or developing a working prototype of a software system from that pipeline is easy and straightforward nowadays, the jouey toward a professional software system is still extensive. This book will help you get to grips with various best practices and recipes that will help software engineers transform prototype pipelines into complete software products.The book begins by introducing the main concepts of professional software systems that leverage machine leaing at their core. As you progress, you’ll explore the differences between traditional, non-ML software, and machine leaing software. The initial best practices will guide you in determining the type of software you need for your product. Subsequently, you will delve into algorithms, covering their selection, development, and testing before exploring the intricacies of the infrastructure for machine leaing systems by defining best practices for identifying the right data source and ensuring its quality.Towards the end, you’ll address the most challenging aspect of large-scale machine leaing systems – ethics. By exploring and defining best practices for assessing ethical risks and strategies for mitigation, you will conclude the book where it all began – large-scale machine leaing software.What you will leaIdentify what the machine leaing software best suits your needsWork with scalable machine leaing pipelinesScale up pipelines from prototypes to fully fledged softwareChoose suitable data sources and processing methods for your productDifferentiate raw data from complex processing, noting their advantagesTrack and mitigate important ethical risks in machine leaing softwareWork with testing and validation for machine leaing systemsWho this book is forIf you’re a machine leaing engineer, this book will help you design more robust software, and understand which scaling-up challenges you need to address and why. Software engineers will benefit from best practices that will make your products robust, reliable, and innovative. Decision makers will also find lots of useful information in this book, including guidance on what to look for in a well-designed machine leaing software product.Table of ContentsMachine Leaing Compared to Traditional SoftwareElements of a Machine Leaing Software SystemData in Software Systems – Text, Images, Code, FeaturesData Acquisition, Data Quality and NoiseQuantifying and Improving Data PropertiesTypes of Data in ML SystemsFeature Engineering for Numerical and Image DataFeature Engineering for Natural Language DataTypes of Machine Leaing Systems – Feature-Based and Raw Data Based (Deep Leaing)Training and evaluation of classical ML systems and neural networksTraining and evaluation of advanced algorithms – deep leaing, autoencoders, GPT-3Designing machine leaing pipelines (MLOps) and their testingDesigning and implementation of large scale, robust ML software – a comprehensive exampleEthics in data acquisition and management(N.B. Please use the Look Inside option to see further chapters)
About the Author
About the Author Miroslaw Staron is a professor of Applied IT at the University of Gothenburg in Sweden with a focus on empirical software engineering, measurement, and machine leaing. He is currently editor-in-chief of Information and Software Technology and co-editor of the regular Practitioner’s Digest column of IEEE Software. He has authored books on automotive software architectures, software measurement, and action research. He also leads several projects in AI for software engineering and leads an AI and digitalization theme at Software Center. He has written over 200 joual and conference articles.