Python Data Cleaning and Preparation Best Practices
Free Download Python Data Cleaning and Preparation Best Practices: A practical guide to organizing and handling data from various sources and formats using Python by Maria Zervou
English | September 27, 2024 | ISBN: 1837634742 | 456 pages | EPUB | 13 Mb
Take your data preparation skills to the next level by converting any type of data asset into a structured, formatted, and readily usable dataset
Key FeaturesMaximize the value of your data through effective data cleaning methodsEnhance your data skills using strategies for handling structured and unstructured dataElevate the quality of your data products by testing and validating your data pipelinesPurchase of the print or Kindle book includes a free PDF eBookBook Description
Professionals face several challenges in effectively leveraging data in today’s data-driven world. One of the main challenges is the low quality of data products, often caused by inaccurate, incomplete, or inconsistent data. Another significant challenge is the lack of skills among data professionals to analyze unstructured data, leading to valuable insights being missed that are difficult or impossible to obtain from structured data alone.
To help you tackle these challenges, this book will take you on a journey through the upstream data pipeline, which includes the ingestion of data from various sources, the validation and profiling of data for high-quality end tables, and writing data to different sinks. You’ll focus on structured data by performing essential tasks, such as cleaning and encoding datasets and handling missing values and outliers, before learning how to manipulate unstructured data with simple techniques. You’ll also be introduced to a variety of natural language processing techniques, from tokenization to vector models, as well as techniques to structure images, videos, and audio.
By the end of this book, you’ll be proficient in data cleaning and preparation techniques for both structured and unstructured data.
What you will learnIngest data from different sources and write it to the required sinksProfile and validate data pipelines for better quality controlGet up to speed with grouping, merging, and joining structured dataHandle missing values and outliers in structured datasetsImplement techniques to manipulate and transform time series dataApply structure to text, image, voice, and other unstructured dataWho this book is for
Whether you’re a data analyst, data engineer, data scientist, or a data professional responsible for data preparation and cleaning, this book is for you. Working knowledge of Python programming is needed to get the most out of this book.
Table of ContentsData Ingestion TechniquesImportance of Data QualityData Profiling – Understanding Data Structure, Quality, and DistributionCleaning Messy Data and Data ManipulationData Transformation – Merging and ConcatenatingData Grouping, Aggregation, Filtering, and Applying FunctionsData SinksDetecting and Handling Missing Values and OutliersNormalization and StandardizationHandling Categorical FeaturesConsuming Time Series DataText Preprocessing in the Era of LLMsImage and Audio Preprocessing with LLMs
About Author
