Story: Assume you work for the Finxter Academy. Your boss asks you to import an existing CSV file containing fictitious users to SQLite3. What is SQLite3, you ask! SQLite3 is an ANSI-C source-code file that offers a light-weight database with the following qualities: Easy to compile and incorporate into projects. No external dependencies. Supports cross-platforms. … Read more
Story: This series of articles assume you work in the IT Department of Mason Books. The Owner asks you to scrape the website of a competitor. He would like this information to gain insight into his pricing structure. 💡 Note: Before continuing, we recommend you possess, at minimum, a basic knowledge of HTML and CSS and … Read more
Introduction Something usual in data science is to work with data stored in a pandas dataframe. Often there is a need to extract specific parts of the dataframe, like columns, rows, or both. The reasons for this could be many, the dataframe is large, and only certain parts are of interest. This post will present … Read more
What are Arrays? A Python array is a data structure like a list. They contain a number of objects that can be of different data types. They provide fast ways and versatile ways to normalize data. What are Dataframes? Dataframes are an ordered sequence of Series, sharing the same index with labeled columns used to … Read more
Problem Statement: Selecting rows from a Dataframe based on the column values. Introduction DataFrame (A Quick Recap) A DataFrame is a 2-dimensional data structure that is generally immutable and heterogeneous. It has labelled axes – rows and columns. A Pandas Dataframe comprises three parts: data, rows, and columns. Now let’s create a Dataframe. We are … Read more
Story: This series of articles assume you are an employee of the City of Sacramento’s IT Department. At the end of each month, a CSV file is sent to the Chief of Police outlining the crime statistics for the current month. However, the Chief prefers to view the output in a styled PDF format based … Read more
Story: This series of articles assume you are an employee of the City of Sacramento’s IT Department. At the end of each month, a CSV file is sent to the Chief of Police outlining the crime statistics for the current month. However, the Chief prefers to view the output in a styled PDF format based … Read more
Story: This series of articles assume you are an employee of the City of Sacramento’s IT Department. At the end of each month, a CSV file is sent to the Chief of Police outlining the crime statistics for the current month. However, the Chief prefers to view the output in a styled PDF format based … Read more
This article focuses on the serialization and conversion methods of a Python DataFrame: to_gbq(), to_coo(). Let’s get started! Preparation Before any data manipulation can occur, four (4) new libraries will require installation. The Pandas library enables access to/from a DataFrame. The NumPy library supports multi-dimensional arrays and matrices in addition to a collection of mathematical … Read more
When we’re working on real-world data, the data files that we receive will be huge. In such cases, cleansing the data becomes important. Often, we might have to count the occurrences of elements in a column. Doing so, gives us insights like: The number of times the value has been duplicated. Count corresponding to a … Read more
This article focuses on the serialization and conversion methods of a Python DataFrame: to_parquet(), to_feather(), to_string(), Styler. Let’s get started! Preparation Before any data manipulation can occur, three (3) new libraries will require installation. The Pandas library enables access to/from a DataFrame. The Pyarrow library allows writing/reading access to/from a parquet file. The Openpyxl library … Read more
Problem Formulation While working on large datasets, we might have to find the unique values from various columns. For example, let’s say, we have a dataframe object as shown below: And we want to find the unique elements from Col1 and Col2. That is, we want to return the following values: Solution Overview To solve … Read more