CREATE STREAM AS SELECT¶
1 2 3 4 5 6 7 8
Create a new materialized stream view, along with the corresponding Kafka topic, and stream the result of the query into the topic.
The PARTITION BY clause, if supplied, is applied to the source after any JOIN or WHERE clauses, and before the SELECT clause, in much the same way as GROUP BY.
Joins to streams can use any stream column. If the join criteria is not the key column of the stream ksqlDB will internally repartition the data.
Kafka guarantees the relative order of any two messages from one source partition only if they are also both in the same partition after the repartition. Otherwise, Kafka is likely to interleave messages. The use case will determine if these ordering guarantees are acceptable.
See Partition Data to Enable Joins for more information about how to correctly partition your data for joins.
For stream-stream joins, you must specify a WITHIN clause for matching records that both occur within a specified time interval. For valid time units, see Time Units.
The key of the resulting stream is determined by the following rules, in order of priority:
1. if the query has a
1. if the
PARITION BY is on a single source column reference, the key will match the
name, type and contents of the source column.
1. otherwise the key will have a system generated name, unless you provide an alias in the
projection, and will match the type and contents of the result of the expression.
1. if the query has a join see Join Synthetic Key Columns for more info.
1. otherwise, the primary key will match the name, unless you provide an alias in the projection,
and type of the source stream's key.
The projection must include all columns required in the result, including any key columns.
For supported serialization formats,
ksqlDB can integrate with Confluent Schema Registry.
ksqlDB registers the value schema of the new stream with Schema Registry automatically.
The schema is registered under the subject
The WITH clause for the result supports the following properties:
|The name of the Kafka topic that backs this stream. If this property is not set, then the name of the stream in upper case will be used as default.
|Specifies the serialization format of the message value in the topic. For supported formats, see Serialization Formats. If this property is not set, the format of the input stream/table is used.
|Used when VALUE_FORMAT='DELIMITED'. Supports single character to be a delimiter, defaults to ','. For space and tab delimited values you must use the special values 'SPACE' or 'TAB', not an actual space or tab character.
|The number of partitions in the backing topic. If this property is not set, then the number of partitions of the input stream/table will be used. In join queries, the property values are taken from the left-side stream or table.
|The replication factor for the topic. If this property is not set, then the number of replicas of the input stream or table will be used. In join queries, the property values are taken from the left-side stream or table.
|Sets a column within this stream's schema to be used as the default source of
ROWTIME for any downstream queries. Downstream queries that use time-based operations, such as windowing, will process records in this stream based on the timestamp in this column. The column will be used to set the timestamp on any records emitted to Kafka. Timestamps have a millisecond accuracy. If not supplied, the
ROWTIME of the source stream is used.
Note: This doesn't affect the processing of the query that populates this stream. For example, given the following statement:
CREATE STREAM foo WITH (TIMESTAMP='t2') ASThe window into which each row of
bar is placed is determined by bar's
|Used in conjunction with TIMESTAMP. If not set, ksqlDB timestamp column must be of type
bigint. When set, the TIMESTAMP column must be of type
varchar and have a format that can be parsed with the Java
DateTimeFormatter. If your timestamp format has characters requiring single quotes, you can escape them with two successive single quotes,
'', for example:
'yyyy-MM-dd''T''HH:mm:ssX'. For more information on timestamp formats, see DateTimeFormatter.
|Controls how values are serialized where the values schema contains only a single column. This setting controls how the query serializes values with a single-column schema.
If set to
true, ksqlDB serializes the column as a named column within a record.
If set to
false, ksqlDB serializes the column as an anonymous value.
If not supplied, the system default, defined by ksql.persistence.wrap.single.values, then the format's default is used.
null values have special meaning in ksqlDB. Care should be taken when dealing with single-column schemas where the value can be
null. For more information, see Single column (un)wrapping.
Note: Supplying this property for formats that do not support wrapping, for example
DELIMITED, or when the value schema has multiple columns, results in an error.
- To use Avro, you must have Schema Registry enabled and
ksql.schema.registry.url must be set in the ksqlDB server configuration
file. See Configure ksqlDB for Avro, Protobuf, and JSON schemas.
- Avro field names are not case sensitive in ksqlDB. This matches the ksqlDB
column name behavior.
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17