A guide to producing, consuming and processing events. Kafka 2.0 was recently released and I thought it would be a good time to review the basics of using Kafka. My goal is to focus on producing, consuming and processing messages or events. This book will therefore cover how to use Kafka’s producer and consumer API, as well as higher level APIs: Kafka Streams, Spark Structured Streaming, and KSQL
Author : Alexis SEIGNEURIN - Data Engineer
In his 15+ year career as a Software Engineer, Alexis has explored many aspects of Data Management using a wide range of languages, frameworks, systems, and databases. He has worked extensively with Spark, Kafka, and AWS technologies, and also contributed to Data Science projects.
05/31/2023
Fenris Digital is a new InsurTech company focused on improving the customer journey at the point of quote. Fenris maintains one of the largest insurance data repositories in the industry. Using records on over 255 million adults, 130 million households, and 50 million small businesses, the Fenris pre-fill data API helps reduce the average application question set from 50 to just five.
Read more
05/31/2023
Our client manages the end-to-end lifecycle for visa applications on behalf of governments across the world. Ippon was brought in to modernize the visa application platform to enable scaling for US federal government use. Ippon adapted the application to make it run within AWS GovCloud and be authorized to receive an Authority To Operate (ATO) from the US federal government. Without these changes, the application would not be usable by what would end up being the largest potential customer for our client: the US State Department.
Read more
05/31/2023
This customer is a top credit card issuer in the US. They used an antiquated system to track their fraud and dispute cases. The system required licensing fees and was expensive to change for new business requirements. Our solution required building a new “Case-as-a-Service” platform with modern technology that was easy to change and usable by the entire enterprise. This case system handled any type of case management required among all lines of business. The customer’s primary business is credit cards, but they also have retail and commercial banking divisions. The customer prides themselves on being leaders in technology within banking. This same customer also has fully adopted the cloud and has exited data centers entirely.
Read more