Kafka wasn’t the first open source project I was involved in at LinkedIn. We’d also built a key-value store, a workflow system, and a number of other things. The biggest difference with Kafka was that ...

Streaming is hot. The demand for real-time data processing is rising, and streaming vendors are proliferating and competing. Apache Kafka is a key component in many data pipeline architectures, mostly ...

These days, massively scalable pub/sub messaging is virtually synonymous with Apache Kafka. Apache Kafka continues to be the rock-solid, open-source, go-to choice for distributed streaming ...

As more and more organizations have come to rely on streaming data to provide real-time insights, a number of applications have sprung up to handle the myriad technical challenges that streaming data ...

Having been thrust into the spotlight by IBM last week, Apache Kafka is getting so much attention that it’s threatening to surpass Apache Spark as Big Data’s tech du jour and become a permanent ...

When the big data movement started it was mostly focused on batch processing. Distributed data storage and querying tools like MapReduce, Hive, and Pig were all designed to process data in batches ...

The open-source technology behind hot startup Confluent, which allows companies to stream vast amounts of data for near-instant use, has earned it supporters at a who’s who of tech companies (think ...

Unlock the full InfoQ experience by logging in! Stay updated with your favorite authors and topics, engage with content, and download exclusive resources. In this episode, Thomas Betts speaks with Ian ...

Unlock the full InfoQ experience by logging in! Stay updated with your favorite authors and topics, engage with content, and download exclusive resources. Senyo Simpson discusses how Rust's core ...