What is Apache Beam?

Apache Beam is a flexible programming SDK for building data processing pipelines that can handle batch processing, stream processing, and parallel processing in one. Its unified model allows developers to define and execute abstract data workflows to be deployed on one of any number of different data processing engines, such as Apache Flink, Apache Spark, Google Cloud Dataflow, and Kafka.

Built by the original creators of Apache Kafka, Confluent powers scalable, continuous, fault-tolerant data stream processing, real-time integration, streaming analytics, governance, and more to modernize your data infrastructure.