Apache Kafka is the leading data landing platform. It is the de-facto standard for collecting and then streaming data to different systems. It is also used a filter system in

There are several tools/framework available that help process data as it arrives. I had done a comparative study of below four systems in the past: Apache KafkaFacebook ScribeCloudera FlumeApache