Platform Engineering

We regularly write about our technical experiences (good and bad) and what we're learning from the market.


    Automate Kafka Testing

    Posted by Tabish Ghani on 12 April 2019

    Testing, unit-testing, kafka, Fast-Data


    Apache Kafka is being leveraged very commonly and forms some of large scale and important systems in the world processing trillions of messages per day. It is serving as pipeline backbone for many companies in financial and tech industry.

    Before I continue, I want to set some expectations. The point of this...

    Continue reading

    Building A Continuous Delivery Pipeline for StreamSets

    Posted by Ahmed Huwait on 07 July 2018

    api, streamsets, ci-cd, unit-testing

    StreamSets DataCollector (SDC) is a data streaming tool that helps you move data from where it is generated or collected, to where you need it for analysis or processing. I personally found SDC interesting as it sits somewhere between systems integration, which is my background and big data, which was new to me at the...

    Continue reading