Platform Engineering

We regularly write about our technical experiences (good and bad) and what we're learning from the market.

Tags

Automate Kafka Testing

Posted by Tabish Ghani on 12 April 2019

Testing, unit-testing, kafka, Fast-Data

Overview

Apache Kafka is being leveraged very commonly and forms some of large scale and important systems in the world processing trillions of messages per day. It is serving as pipeline backbone for many companies in financial and tech industry.

Before I continue, I want to set some expectations. The point of this...

Continue reading

Building A Continuous Delivery Pipeline for StreamSets

Posted by Ahmed Huwait on 07 July 2018

api, streamsets, ci-cd, unit-testing

StreamSets DataCollector (SDC) is a data streaming tool that helps you move data from where it is generated or collected, to where you need it for analysis or processing. I personally found SDC interesting as it sits somewhere between systems integration, which is my background and big data, which was new to me at the...

Continue reading