InfoQ Homepage Streaming Content on InfoQ
-
Streaming Databases: Embracing the Convergence of Stream Processing and Databases
Yingjun Wu discusses the evolution of streaming databases, and the features and design principles that set streaming databases apart from conventional database systems and stream processing engines.
-
Building a Large Scale Real-Time Ad Events Processing System
Chao Chu provides insights and practical knowledge for building streaming pipelines for an ad platform.
-
Multi-Region Data Streaming with Redpanda
Michał Maślanka introduces the design of Redpanda’s Multi-Region feature, and describes how they leveraged Raft’s properties, a constraint solver, automatic data balancing, and tiered storage.
-
Building High-Fidelity Data Streams
Sid Anand discusses how they built a lossless streaming data system that guarantees sub-second (p95) event delivery at scale with better than three nines availability.
-
Streaming from Apache Iceberg - Building Low-Latency and Cost-Effective Data Pipelines
Steven Wu discusses the design of the Flink Iceberg, comparing the Kafka and Iceberg sources for streaming and how the Iceberg streaming source can power many common stream processing use cases.
-
From Zero to a Hundred Billion: Building Scalable Real-Time Event Processing at DoorDash
Allen Wang discusses the design of the event system including major components of event producing, event processing with Flink and streaming SQL, event format and schema validation.
-
Resilient Real-Time Data Streaming across the Edge and Hybrid Cloud
Kai Waehner explores different architectures and their trade-offs for transactional and analytical workloads. Real-world examples include financial services, retail, and the automotive industry.
-
Building & Operating High-Fidelity Data Streams
Sid Anand discusses building high-fidelity nearline data streams as a service within a lean team.
-
From Batch to Streams: Building Value from Data In-Motion
Ricardo Ferreira discusses the risks of designing siloed-based systems and how streaming data architectures can become a solution to address competitiveness.
-
Everything You Wanted to Know about Apache Kafka But Were Too Afraid to Ask!
Ricardo Ferreira explains what a streaming platform such as Apache Kafka is and some of the use cases and design patterns around its use.
-
Reactive Event Processing with Apache Geode
Bill Burcham discusses how to integrate Geode with your Reactive System efficiently, and at scale.
-
Databases and Stream Processing: a Future of Consolidation
Ben Stopford digs into why both stream processors and databases are necessary from a technical standpoint but also by exploring industry trends that make consolidation in the future far more likely.