The Rise of Data Streaming Platforms

Apache Kafka and Apache Flink are powering a new category of data infrastructure called data streaming platform (DSP). This provides an opportunity for each enterprise to take actions on what’s happening in its business in real time. I will first provide an overview of DSP. DSP has both similarities and differences to database systems. I will show how existing database technologies can be used in this new platform and some of the unique problems that DSP needs to solve. I will conclude with some of the new opportunities on DSP. Speaker Bio: Jun Rao is a co-founder of Confluent, a company that provides a data streaming platform based on Apache Kafka. Before Confluent, Jun Rao was a senior staff engineer at LinkedIn where he led the development of Kafka. Before LinkedIn, Jun Rao was a researcher at IBM’s Almaden research center, where he conducted research on database and distributed systems. Jun Rao is a committer of Apache Kafka and Apache Cassandra.