Why did we choose Flink as the computing engine that integrates streams and batches? The main reason is that Flink is a distributed computing framework for finite-flow and infinite-flow stateful computing, and it can support both stream processing and batch application types. In the traditional sense, Flink is an infinite stream of data. But if we divide the infinite data stream with time windows one by one, we will get a lot of limited data streams. For Flink, the number of batches…

#Daily #blog #exploration #practice #Flink #streaming #batch #integration #ByteDance