🤪 About: This article does only one thing: giving this excellent StackOverflow answer a platform — and formatting it a bit for ease of reading. You can’t parse [X]HTML with regex. Because HTML can’t be parsed by regex. Regex is not a tool that can be used to correctly parse HTML. As I have answered … Read more
In this tutorial, we’ll learn how to create a simple live-updating Bitcoin price chart using the Binance API. This straightforward guide will cover all the necessary HTML, JavaScript, and CSS code required to get started with real-time cryptocurrency price tracking. You don’t need much for this tutorial: ✅ We’ll create a single HTML document that … Read more
Quick Fix Trying to parse a site when web scraping or calling APIs with Python requests, but getting slapped with a 403 Forbidden error. Ouch! The basic code looks like this: And the server is like, “Nope, you’re not coming in” 🥸, showing a 403 Forbidden error. Turns out, servers can be picky. They might … Read more
📝 TLDR Freelancers that use Upwork have an advantage if they apply to job soon after they are posted. Upwork offers an RSS feed that can be parsed for job information sent in the jobs broadcast. Feedparser is a python module that can be used to extract some of the key data from the XML … Read more
Why Create a QA Database? A good question often opens up new perspectives and new ways of thinking. But that’s not why I had to create a Question-Answering database. Question-Answering (QA) databases play an important role in researching and developing large language models (LLMs). These databases have two primary applications: Traditionally, QA databases can be … Read more
This article is based on a freelance job posted on Upwork to scrape data for all the gyms in the USA from MindBodyOnline.com or another similar site. I treated this as a learning project, and it was a good one, as I learned a lot! 🕷️ Web scraping, a technique used to extract data from … Read more
In this article, I’ll share my method of retrieving the first n Google search results for a given keyword and extract the text content from the resulting URLs. The search_google(query, num_results) function performs a search using the Google Custom Search JSON API, with the search query and the desired number of results (num_results) as parameters. … Read more
I have just created this small helper tool to extract all email addresses from a huge text file or string. Simply copy and paste your text into the field and click “Extract Emails“: 👇 Email Extractor Enter Text: Extract Emails Copy to Clipboard Extracted Emails: JavaScript Regex In the online tool above, I used a … Read more
Summary: Use urllib.parse.urljoin() to scrape the base URL and the relative path and join them to extract the complete/absolute URL. You can also concatenate the base URL and the absolute path to derive the absolute path; but make sure to take care of erroneous situations like extra forward-slash in this case. Quick Answer When web … Read more
As a Python developer, you may often deal with making HTTP requests to interact with APIs or to retrieve information from web pages. By default, these requests can be slow and block your program’s execution, making your code less efficient. This is where Python’s async requests come to the rescue. Asynchronous HTTP requests allow your … Read more
To download a Zoom video in Python, first install the requests library using pip install requests. Then, use the requests.get() method to fetch the video content from the Zoom URL and save it to a file with .mp4 extension. Ensure you have the necessary permissions and note that some videos may require authentication or additional … Read more
To get historical weather data in Python, install the Meteostat library using pip install meteostat or run !pip install meteostat with the exclamation mark prefix ! in a Jupyter Notebook. If you haven’t already, also install the Matplotlib library using pip install matplotlib. Then, copy the following code into your programming environment and change the … Read more