Distributed Systems

PyPubSub – Creating Your First Publish Subscribe App in Python

Did you check the news today, or receive an email newsletter from a company? Both modes of communication follow the publish-subscribe communication pattern. This article will show you how to implement your own pubsub system in Python using the flexible PyPubSub library. If you already know about the PubSub concept, feel free to move ahead …

PyPubSub – Creating Your First Publish Subscribe App in Python Read More »

Python HTML Get Parameter

Problem Formulation: How to perform an HTTP get call in Python? Solution: Use Python’s requests library. This is semantically equivalent to issuing an HTTP get call: http://example.com?param_1=value_1&param_2=value_2 In fact, you can obtain this exact URL by using the r.url attribute on the request object: You can find the text response by using the r.text attribute …

Python HTML Get Parameter Read More »

How to Send UDP Multicast in Python?

Problem Formulation: How to send and receive UDP multicast messages in Python? Background: Multicast is a distributed systems concept for group communication over a network (one-to-many or many-to-many). The choice of the network “transport layer” which the Multicast uses determines its type—for example, IP Multicast is sending a multicast over the IP layer and UDP …

How to Send UDP Multicast in Python? Read More »

How to Send UDP Messages in Python?

Problem Formulation: How to send and receive UDP messages in Python? Background: The User Datagram Protocol (UDP) network layer allows you to send messages without providing deliverability guarantees. UDP is unreliable—massages may be lost or delivered out of order. But this makes UDP also fast, lightweight, and the protocol of choice for many streaming scenarios …

How to Send UDP Messages in Python? Read More »

TensorFlow — A Helpful Illustrated Guide

Machine Learning (ML) is a sought-after skill in today’s automated world. Google is one of the key players in the Machine Learning space. With the growing scale and popularity of deep learning, the limitations of a single machine become more and more pronounced. Motivation Training a model on a single computer can take a long …

TensorFlow — A Helpful Illustrated Guide Read More »

MapReduce — A Helpful Illustrated Guide

MapReduce is the name of both (i) a distributed processing programming model provided by the Apache Foundation, and (ii) a functional processing technique. It consists of two steps: the map() function and the reduce() function. Map() converts each element in a data set into a modified element. Reduce() takes subsets of modified elements and aggregates …

MapReduce — A Helpful Illustrated Guide Read More »

Apache Spark – A Short Overview

Large companies analyze massive amounts of data coming from various sources such as social nets, weblogs, or customers. An important class of data analytics concerns large-scale set operations. Suppose you have two customer data sets A and B. Set A contains all customers who bought in 2017. Set B contains all customers who bought in …

Apache Spark – A Short Overview Read More »