Tutorials and Examples
- Quickstart
- Build a materialized view/cache
- Build a streaming ETL pipeline
- Build an event-driven microservice
- ksqlDB Examples
- ksqlDB with Embedded Connect
- Integrating with PostgreSQL
Stream Processing Cookbook¶
The Stream Processing Cookbook contains ksqlDB recipes that provide in-depth tutorials and recommended deployment scenarios.
ksqlDB with Embedded Connect¶
ksqlDB has native integration with Connect. While ksqlDB can integrate with a separate Kafka Connect cluster, it can also run Connect embedded within the ksqlDB server, making it unnecessary to run a separate Connect cluster. The embedded Connect tutorial shows how you can configure ksqlDB to run Connect in embedded mode.
ksqlDB Examples¶
These examples provide common ksqlDB usage operations.
You can configure Java streams applications to deserialize and ingest data in multiple ways, including Kafka console producers, JDBC source connectors, and Java client producers. For full code examples,
Level Up Your KSQL Videos¶
| Video | Description |
|---|---|
| KSQL Introduction | Intro to Kafka stream processing, with a focus on KSQL. |
| KSQL Use Cases | Describes several KSQL uses cases, like data exploration, arbitrary filtering, streaming ETL, anomaly detection, and real-time monitoring. |
| KSQL and Core Kafka | Describes KSQL dependency on core Kafka, relating KSQL to clients, and describes how KSQL uses Kafka topics. |
| Installing and Running KSQL | How to get KSQL, configure and start the KSQL server, and syntax basics. |
| KSQL Streams and Tables | Explains the difference between a STREAM and TABLE, shows a detailed example, and explains how streaming queries are unbounded. |
| Reading Kafka Data from KSQL | How to explore Kafka topic data, create a STREAM or TABLE from a Kafka topic, identify fields. Also explains metadata like ROWTIME and TIMESTAMP, and covers different formats like Avro, JSON, and Delimited. |
| Streaming and Unbounded Data in KSQL | More detail on streaming queries, how to read topics from the beginning, the differences between persistent and non-persistent queries, how do streaming queries end. |
| Enriching data with KSQL | Scalar functions, changing field types, filtering data, merging data with JOIN, and rekeying streams. |
| Aggregations in KSQL | How to aggregate data with KSQL, different types of aggregate functions like COUNT, SUM, MAX, MIN, TOPK, etc, and windowing and late-arriving data. |
| Taking KSQL to Production | How to use KSQL in streaming ETL pipelines, scale query processing, isolate workloads, and secure your entire deployment. |
| Insert Into | A brief tutorial on how to use INSERT INTO in KSQL by Confluent. |
| Struct (Nested Data) | A brief tutorial on how to use STRUCT in KSQL by Confluent. |
| Stream-Stream Joins | A short tutorial on stream-stream joins in KSQL by Confluent. |
| Table-Table Joins | A short tutorial on table-table joins in KSQL by Confluent. |
| Monitoring KSQL in Confluent Control Center | Monitor performance and end-to-end message delivery of your KSQL queries. |
Page last revised on: 2020-04-29
Last update:
2020-04-29