This article will review some of the critical techniques used in Exploratory Data Analysis, specifically for Bivariate Analysis. We will review some of the essential concepts, understand some of the math behind correlation coefficients and provide sufficient examples in Python for a well-rounded, comprehensive understanding. What is Bivariate Analysis? Exploratory Data Analysis, or EDA, is … Read more
Problem Formulation and Solution Overview When working with data, you may encounter a string or list of strings containing two (2) double quotes. This article shows you how to remove one set of these double quotes. 💬 Question: How would we write code to remove the extra set of double quotes? We can accomplish this … Read more
Problem Formulation and Solution Overview This article will show different ways to read and filter an Excel file in Python. To make it more interesting, we have the following scenario: Sven is a Senior Coder at K-Paddles. K-Paddles manufactures Kayak Paddles made of Kevlar for the White Water Rafting Community. Sven has been asked to … Read more
💬 Programming Challenge: Given a Pandas DataFrame or a Pandas Series object. How to convert them to a NumPy array? In this short tutorial, you’ll learn (1) how to convert a 1D pandas Series to a NumPy array, and (2) how to convert a 2D pandas DataFrame to an array. Let’s get started with the … Read more
Problem Formulation Say, you have a function create_df() that creates a DataFrame from some data that may be read from a CSV file, the web, or from another variable in the code (e.g., a nested list)—doesn’t matter. You want to return the DataFrame to the caller of the function at runtime. ⚡ However, the code … Read more
Problem Formulation and Solution Overview This article will show you how to remove text within parentheses in Python. To make it more interesting, we have the following running scenario: Rivers Clothing has a CSV file containing all their employees. The format is currently first name (middle name) and last name (for example, Martin (Robert) Simpson). … Read more
Problem Formulation and Solution Overview This article will show you how to subtract minutes from a datetime in Python. To make it more interesting, we have the following running scenario: ToyMax has 200 employees. All employees must swipe in and out daily using a time card reader. Sometimes the employee swipe-in times do not appear … Read more
A Time Series is essentially a tabular data with the special feature of having a time index. The common forecast task is ‘knowing the past (and sometimes the present), predict the future’. This task, taken as a principle, reveals itself in several ways: in how to interpret your problem, in feature engineering, and in which … Read more
💬 Challenge: Given a Pandas DataFrame. How to find the longest string in a given DataFrame column? We’re going to discuss different variants of this problem next. Let’s get started with the easiest next! Method 1: Find Length of Longest String in DataFrame Column To find the length of the longest string in a DataFrame … Read more
Problem Formulation and Solution Overview This article will show you how to add days to a Pandas DataFrame Date column. To make it more interesting, we have the following running scenario: CheckersTV is a new channel offering streaming news and games. They have a large subscriber base, each paying a monthly fee of $12.99. For … Read more
Problem Formulation and Solution Overview This article will show you how to find the most common element in a Pandas Column. To make it more interesting, we have the following running scenario: You have been provided with a downloadable CSV file containing crime statistics for the San Diego area, including their respective NCIC Crime Codes. … Read more
Problem 💬 Challenge: How to convert a Parquet file ‘my_file.parquet’ to a CSV file ‘my_file.csv’ in Python? In case you don’t know what a Parquet file is, here’s the definition: 💡 Info: Apache Parquet is an open-source, column-oriented data file format designed for efficient data storage and retrieval using data compression and encoding schemes to … Read more