Create Table Monitor

Creates a monitor that watches for a single table modification event type (insert, update, or delete) on a particular table (identified by input parameter table_name) and forwards event notifications to subscribers via ZMQ. After this call completes, subscribe to the returned output parameter topic_id on the ZMQ table monitor port (default 9002). Each time an operation of the given type on the table completes, a multipart message is published for that topic; the first part contains only the topic ID, and each subsequent part contains one binary-encoded Avro object that corresponds to the event and can be decoded using output parameter type_schema. The monitor will continue to run (regardless of whether or not there are any subscribers) until deactivated with Clear Table Monitor.

For more information on table monitors, see Table Monitors.

Input Parameter Description

NameTypeDescription
table_namestringName of the table to monitor, in [schema_name.]table_name format, using standard name resolution rules.
optionsmap of string to strings

Optional parameters. The default value is an empty map ( {} ).

Supported Parameters (keys)Parameter Description
event

Type of modification event on the target table to be monitored by this table monitor. The default value is insert.

Supported ValuesDescription
insertGet notifications of new record insertions. The new row images are forwarded to the subscribers.
updateGet notifications of update operations. The modified row count information is forwarded to the subscribers.
deleteGet notifications of delete operations. The deleted row count information is forwarded to the subscribers.
monitor_idID to use for this monitor instead of a randomly generated one
datasink_nameName of an existing data sink to send change data notifications to
destinationDestination for the output data in format 'destination_type://path[:port]'. Supported destination types are 'http', 'https' and 'kafka'.
kafka_topic_nameName of the Kafka topic to publish to if destination in input parameter options is specified and is a Kafka broker
increasing_columnColumn on subscribed table that will increase for new records (e.g., TIMESTAMP).
expressionFilter expression to limit records for notification
refresh_method

Method controlling when the table monitor reports changes to the input parameter table_name. The default value is on_change.

Supported ValuesDescription
on_changeReport changes as they occur.
periodicReport changes periodically at rate specified by refresh_period.
refresh_periodWhen refresh_method is periodic, specifies the period in seconds at which changes are reported.
refresh_start_timeWhen refresh_method is periodic, specifies the first time at which changes are reported. Value is a datetime string with format 'YYYY-MM-DD HH:MM:SS'.

Output Parameter Description

NameTypeDescription
topic_idstringThe ZMQ topic ID to subscribe to for table events.
table_namestringValue of input parameter table_name.
type_schemastringJSON Avro schema of the table, for use in decoding published records.
infomap of string to strings

Additional information. The default value is an empty map ( {} ).

Possible Parameters (keys)Parameter Description
ttlFor insert_table/delete_table events, the ttl of the table.
insert_topic_idThe topic id for 'insert' event in input parameter options
update_topic_idThe topic id for 'update' event in input parameter options
delete_topic_idThe topic id for 'delete' event in input parameter options
insert_type_schemaThe JSON Avro schema of the table in output parameter table_name
update_type_schemaThe JSON Avro schema for 'update' events
delete_type_schemaThe JSON Avro schema for 'delete' events