Effective Data Science Infrastructure: How to Make Data Scientists Productive

“Do not miss the opportunity to cover all key aspects of data science infrastructure on your next project.” Jesús A. Juárez Guerrero

“Useful book that provides tactical guidance on how to use Metaflow to streamline data science workflows but also includes great frameworks and abstractions to consider when defining your data science infrastructure stack.” Sarah Catanzaro

“This is the ultimate book to learn how to handle infrastructure in data science!” Ninoslav Cerkez

“If you need a workflow management tool to glue your data code, look at metaflow. It’s simple yet efficient.” Mikael Dautrey

Effective Data Science Infrastructure: How to make data scientists more productive is a guide to building infrastructure that will supercharge data science projects and data scientists. Based on state-of-the-art practices that power the massive data operations of Netflix, this book offers techniques and patterns relevant to companies of all shapes and sizes. You’ll learn how you can make data scientists more productive with your existing cloud infrastructure, a stack of open source software, and idiomatic Python.

As you work through this easy-to-follow guide, you’ll set up end-to-end infrastructure from the ground up, with a fully customizable process you can easily adapt to your company. You’ll build a cloud-based development environment that covers local prototyping and deployment to production, set up infrastructure that supports a real-world machine learning application, and handle a large-scale application for processing hundreds of gigabytes of data. Throughout, you’ll follow a human-centric approach focused on user experience and meeting the unique needs of data scientists.