Data Logistics using Apache Kafka, Spark, and Spring Boot

This post summarizes how Apache Kafka works and demonstrates how it can be used to ingest data and transfer it to another system. It will therefore only highlight the fundamentals of Apache Kafka, its justification, the context of usage as well as using its Producer and Consumer API. What is Apache Kafka? Even though it... Continue Reading →

How To Connect Java: Spring MVC to Neo4J Graph Database

This is a simple stepwise approach to show the basic steps involved in connecting a typical Java application to the Neo4J graph database. Your final output should look similar to what we have in the image below. The data displayed are the ones retrieved from Neo4J, the creation of the data is also covered later... Continue Reading →

Container-based Virtualization of a Hadoop Cluster using Docker

Hadoop is a collection of open-source software utilities, a framework that supports the processing of large data sets in a distributed computing environment. Its core part consists of HDFS (Hadoop Distributed File System) which is used for storage, MapReduce which is used to define the data processing task and YARN which actually runs the data... Continue Reading →

Feign Clients: Handling Multiple Authorization Approach

In a typical application platform of any size, communication is either synchronous or asynchronous. For synchronous communication that is HTTP-based, there exist, numerous clients, to choose from. However, for the Java ecosystem, feign (https://github.com/OpenFeign/feign)  provides an abstraction over this and offers among other benefits: multiple encoding, better error handling, logging, etc. Feign offers a declarative... Continue Reading →

Optimizing Scheduled Job Execution with Jobrunr and Shedlock

In a setup where multiple instances of an application are running simultaneously, it is imperative to make sure only one of those instances can start the execution of a scheduled job. However, in a scenario where the tasks of the scheduled job are not only heavy but also voluminous, it is important to find a... Continue Reading →

Blog at WordPress.com.

Up ↑