A set of string constants for the parameter options. More...

Public Attributes
const string	BAD_RECORD_TABLE_NAME = "bad_record_table_name"
	Name of a table to which records that were rejected are written. More...

const string	BAD_RECORD_TABLE_LIMIT = "bad_record_table_limit"
	A positive integer indicating the maximum number of records that can be written to the bad-record-table. More...

const string	BATCH_SIZE = "batch_size"
	Number of records per batch when inserting data. More...

const string	DATASOURCE_NAME = "datasource_name"
	Name of an existing external data source from which table will be loaded. More...

const string	ERROR_HANDLING = "error_handling"
	Specifies how errors should be handled upon insertion. More...

const string	PERMISSIVE = "permissive"
	Records with missing columns are populated with nulls if possible; otherwise, the malformed records are skipped. More...

const string	IGNORE_BAD_RECORDS = "ignore_bad_records"
	Malformed records are skipped. More...

const string	ABORT = "abort"
	Stops current insertion and aborts entire operation when an error is encountered. More...

const string	IGNORE_EXISTING_PK = "ignore_existing_pk"
	Specifies the record collision error-suppression policy for inserting into a table with a primary key, only used when not in upsert mode (upsert mode is disabled when UPDATE_ON_EXISTING_PK is FALSE). More...

const string	TRUE = "true"
	Upsert new records when primary keys match existing records. More...

const string	FALSE = "false"
	Reject new records when primary keys match existing records. More...

const string	INGESTION_MODE = "ingestion_mode"
	Whether to do a full load, dry run, or perform a type inference on the source data. More...

const string	FULL = "full"
	Run a type inference on the source data (if needed) and ingest. More...

const string	DRY_RUN = "dry_run"
	Does not load data, but walks through the source data and determines the number of valid records, taking into account the current mode of ERROR_HANDLING. More...

const string	TYPE_INFERENCE_ONLY = "type_inference_only"
	Infer the type of the source data and return, without ingesting any data. More...

const string	JDBC_FETCH_SIZE = "jdbc_fetch_size"
	The JDBC fetch size, which determines how many rows to fetch per round trip. More...

const string	JDBC_SESSION_INIT_STATEMENT = "jdbc_session_init_statement"
	Executes the statement per each JDBC session before doing actual load. More...

const string	NUM_SPLITS_PER_RANK = "num_splits_per_rank"
	Number of splits for reading data per rank. More...

const string	NUM_TASKS_PER_RANK = "num_tasks_per_rank"
	Number of tasks for reading data per rank. More...

const string	PRIMARY_KEYS = "primary_keys"
	Comma separated list of column names, to set as primary keys, when not specified in the type. More...

const string	SHARD_KEYS = "shard_keys"
	Comma separated list of column names, to set as shard keys, when not specified in the type. More...

const string	SUBSCRIBE = "subscribe"
	Continuously poll the data source to check for new data and load it into the table. More...

const string	TRUNCATE_TABLE = "truncate_table"
	If set to TRUE, truncates the table specified by table_name prior to loading the data. More...

const string	REMOTE_QUERY = "remote_query"
	Remote SQL query from which data will be sourced. More...

const string	REMOTE_QUERY_ORDER_BY = "remote_query_order_by"
	Name of column to be used for splitting the query into multiple sub-queries using ordering of given column. More...

const string	REMOTE_QUERY_FILTER_COLUMN = "remote_query_filter_column"
	Name of column to be used for splitting the query into multiple sub-queries using the data distribution of given column. More...

const string	REMOTE_QUERY_INCREASING_COLUMN = "remote_query_increasing_column"
	Column on subscribed remote query result that will increase for new records (e.g., TIMESTAMP). More...

const string	REMOTE_QUERY_PARTITION_COLUMN = "remote_query_partition_column"
	Alias name for REMOTE_QUERY_FILTER_COLUMN. More...

const string	TRUNCATE_STRINGS = "truncate_strings"
	If set to TRUE, truncate string values that are longer than the column's type size. More...

const string	UPDATE_ON_EXISTING_PK = "update_on_existing_pk"
	Specifies the record collision policy for inserting into a table with a primary key. More...

Detailed Description

A set of string constants for the parameter options.

Optional parameters.

Definition at line 228 of file InsertRecordsFromQuery.cs.

Member Data Documentation

◆ ABORT

const string InsertRecordsFromQueryRequest.Options.ABORT = "abort"

Stops current insertion and aborts entire operation when an error is encountered.

Primary key collisions are considered abortable errors in this mode.

Definition at line 290 of file InsertRecordsFromQuery.cs.

◆ BAD_RECORD_TABLE_LIMIT

const string InsertRecordsFromQueryRequest.Options.BAD_RECORD_TABLE_LIMIT = "bad_record_table_limit"

A positive integer indicating the maximum number of records that can be written to the bad-record-table.

Default value is 10000.

Definition at line 241 of file InsertRecordsFromQuery.cs.

◆ BAD_RECORD_TABLE_NAME

const string InsertRecordsFromQueryRequest.Options.BAD_RECORD_TABLE_NAME = "bad_record_table_name"

Name of a table to which records that were rejected are written.

The bad-record-table has the following columns: line_number (long), line_rejected (string), error_message (string). When error handling is Abort, bad records table is not populated.

Definition at line 236 of file InsertRecordsFromQuery.cs.

◆ BATCH_SIZE

const string InsertRecordsFromQueryRequest.Options.BATCH_SIZE = "batch_size"

Number of records per batch when inserting data.

Definition at line 244 of file InsertRecordsFromQuery.cs.

◆ DATASOURCE_NAME

const string InsertRecordsFromQueryRequest.Options.DATASOURCE_NAME = "datasource_name"

Name of an existing external data source from which table will be loaded.

Definition at line 248 of file InsertRecordsFromQuery.cs.

◆ DRY_RUN

const string InsertRecordsFromQueryRequest.Options.DRY_RUN = "dry_run"

Does not load data, but walks through the source data and determines the number of valid records, taking into account the current mode of ERROR_HANDLING.

Definition at line 363 of file InsertRecordsFromQuery.cs.

◆ ERROR_HANDLING

const string InsertRecordsFromQueryRequest.Options.ERROR_HANDLING = "error_handling"

Specifies how errors should be handled upon insertion.

Supported values:

PERMISSIVE: Records with missing columns are populated with nulls if possible; otherwise, the malformed records are skipped.
IGNORE_BAD_RECORDS: Malformed records are skipped.
ABORT: Stops current insertion and aborts entire operation when an error is encountered. Primary key collisions are considered abortable errors in this mode.

The default value is ABORT.

Definition at line 277 of file InsertRecordsFromQuery.cs.

◆ FALSE

const string InsertRecordsFromQueryRequest.Options.FALSE = "false"

Reject new records when primary keys match existing records.

Definition at line 323 of file InsertRecordsFromQuery.cs.

◆ FULL

const string InsertRecordsFromQueryRequest.Options.FULL = "full"

Run a type inference on the source data (if needed) and ingest.

Definition at line 357 of file InsertRecordsFromQuery.cs.

◆ IGNORE_BAD_RECORDS

const string InsertRecordsFromQueryRequest.Options.IGNORE_BAD_RECORDS = "ignore_bad_records"

Malformed records are skipped.

Definition at line 284 of file InsertRecordsFromQuery.cs.

◆ IGNORE_EXISTING_PK

const string InsertRecordsFromQueryRequest.Options.IGNORE_EXISTING_PK = "ignore_existing_pk"

Specifies the record collision error-suppression policy for inserting into a table with a primary key, only used when not in upsert mode (upsert mode is disabled when UPDATE_ON_EXISTING_PK is FALSE).

Supported values:

TRUE: Ignore new records whose primary key values collide with those of existing records.
FALSE: Treat as errors any new records whose primary key values collide with those of existing records.

The default value is FALSE.

Definition at line 315 of file InsertRecordsFromQuery.cs.

◆ INGESTION_MODE

const string InsertRecordsFromQueryRequest.Options.INGESTION_MODE = "ingestion_mode"

Whether to do a full load, dry run, or perform a type inference on the source data.

Supported values:

FULL: Run a type inference on the source data (if needed) and ingest.
DRY_RUN: Does not load data, but walks through the source data and determines the number of valid records, taking into account the current mode of ERROR_HANDLING.
TYPE_INFERENCE_ONLY: Infer the type of the source data and return, without ingesting any data. The inferred type is returned in the response.

The default value is FULL.

Definition at line 353 of file InsertRecordsFromQuery.cs.

◆ JDBC_FETCH_SIZE

const string InsertRecordsFromQueryRequest.Options.JDBC_FETCH_SIZE = "jdbc_fetch_size"

The JDBC fetch size, which determines how many rows to fetch per round trip.

Definition at line 373 of file InsertRecordsFromQuery.cs.

◆ JDBC_SESSION_INIT_STATEMENT

const string InsertRecordsFromQueryRequest.Options.JDBC_SESSION_INIT_STATEMENT = "jdbc_session_init_statement"

Executes the statement per each JDBC session before doing actual load.

The default value is ''.

Definition at line 378 of file InsertRecordsFromQuery.cs.

◆ NUM_SPLITS_PER_RANK

const string InsertRecordsFromQueryRequest.Options.NUM_SPLITS_PER_RANK = "num_splits_per_rank"

Number of splits for reading data per rank.

Default will be external_file_reader_num_tasks. The default value is ''.

Definition at line 383 of file InsertRecordsFromQuery.cs.

◆ NUM_TASKS_PER_RANK

const string InsertRecordsFromQueryRequest.Options.NUM_TASKS_PER_RANK = "num_tasks_per_rank"

Number of tasks for reading data per rank.

Default will be external_file_reader_num_tasks.

Definition at line 388 of file InsertRecordsFromQuery.cs.

◆ PERMISSIVE

const string InsertRecordsFromQueryRequest.Options.PERMISSIVE = "permissive"

Records with missing columns are populated with nulls if possible; otherwise, the malformed records are skipped.

Definition at line 281 of file InsertRecordsFromQuery.cs.

◆ PRIMARY_KEYS

const string InsertRecordsFromQueryRequest.Options.PRIMARY_KEYS = "primary_keys"

Comma separated list of column names, to set as primary keys, when not specified in the type.

The default value is ''.

Definition at line 393 of file InsertRecordsFromQuery.cs.

◆ REMOTE_QUERY

const string InsertRecordsFromQueryRequest.Options.REMOTE_QUERY = "remote_query"

Remote SQL query from which data will be sourced.

Definition at line 433 of file InsertRecordsFromQuery.cs.

◆ REMOTE_QUERY_FILTER_COLUMN

const string InsertRecordsFromQueryRequest.Options.REMOTE_QUERY_FILTER_COLUMN = "remote_query_filter_column"

Name of column to be used for splitting the query into multiple sub-queries using the data distribution of given column.

The default value is ''.

Definition at line 444 of file InsertRecordsFromQuery.cs.

◆ REMOTE_QUERY_INCREASING_COLUMN

const string InsertRecordsFromQueryRequest.Options.REMOTE_QUERY_INCREASING_COLUMN = "remote_query_increasing_column"

Column on subscribed remote query result that will increase for new records (e.g., TIMESTAMP).

The default value is ''.

Definition at line 449 of file InsertRecordsFromQuery.cs.

◆ REMOTE_QUERY_ORDER_BY

const string InsertRecordsFromQueryRequest.Options.REMOTE_QUERY_ORDER_BY = "remote_query_order_by"

Name of column to be used for splitting the query into multiple sub-queries using ordering of given column.

The default value is ''.

Definition at line 438 of file InsertRecordsFromQuery.cs.

◆ REMOTE_QUERY_PARTITION_COLUMN

const string InsertRecordsFromQueryRequest.Options.REMOTE_QUERY_PARTITION_COLUMN = "remote_query_partition_column"

Alias name for REMOTE_QUERY_FILTER_COLUMN.

The default value is ''.

Definition at line 455 of file InsertRecordsFromQuery.cs.

◆ SHARD_KEYS

const string InsertRecordsFromQueryRequest.Options.SHARD_KEYS = "shard_keys"

Comma separated list of column names, to set as shard keys, when not specified in the type.

The default value is ''.

Definition at line 398 of file InsertRecordsFromQuery.cs.

◆ SUBSCRIBE

const string InsertRecordsFromQueryRequest.Options.SUBSCRIBE = "subscribe"

Continuously poll the data source to check for new data and load it into the table.

Supported values:

TRUE
FALSE

The default value is FALSE.

Definition at line 413 of file InsertRecordsFromQuery.cs.

◆ TRUE

const string InsertRecordsFromQueryRequest.Options.TRUE = "true"

Upsert new records when primary keys match existing records.

Definition at line 319 of file InsertRecordsFromQuery.cs.

◆ TRUNCATE_STRINGS

const string InsertRecordsFromQueryRequest.Options.TRUNCATE_STRINGS = "truncate_strings"

If set to TRUE, truncate string values that are longer than the column's type size.

Supported values:

TRUE
FALSE

The default value is FALSE.

Definition at line 471 of file InsertRecordsFromQuery.cs.

◆ TRUNCATE_TABLE

const string InsertRecordsFromQueryRequest.Options.TRUNCATE_TABLE = "truncate_table"

If set to TRUE, truncates the table specified by table_name prior to loading the data.

Supported values:

TRUE
FALSE

The default value is FALSE.

Definition at line 429 of file InsertRecordsFromQuery.cs.

◆ TYPE_INFERENCE_ONLY

const string InsertRecordsFromQueryRequest.Options.TYPE_INFERENCE_ONLY = "type_inference_only"

Infer the type of the source data and return, without ingesting any data.

The inferred type is returned in the response.

Definition at line 369 of file InsertRecordsFromQuery.cs.

◆ UPDATE_ON_EXISTING_PK

const string InsertRecordsFromQueryRequest.Options.UPDATE_ON_EXISTING_PK = "update_on_existing_pk"

Specifies the record collision policy for inserting into a table with a primary key.

Supported values:

TRUE: Upsert new records when primary keys match existing records.
FALSE: Reject new records when primary keys match existing records.

The default value is FALSE.

Definition at line 491 of file InsertRecordsFromQuery.cs.

The documentation for this struct was generated from the following file:

Kinetica/Protocol/InsertRecordsFromQuery.cs

Public Attributes

Detailed Description

Member Data Documentation

◆ ABORT

◆ BAD_RECORD_TABLE_LIMIT

◆ BAD_RECORD_TABLE_NAME

◆ BATCH_SIZE

◆ DATASOURCE_NAME

◆ DRY_RUN

◆ ERROR_HANDLING

◆ FALSE

◆ FULL

◆ IGNORE_BAD_RECORDS

◆ IGNORE_EXISTING_PK

◆ INGESTION_MODE

◆ JDBC_FETCH_SIZE

◆ JDBC_SESSION_INIT_STATEMENT

◆ NUM_SPLITS_PER_RANK

◆ NUM_TASKS_PER_RANK

◆ PERMISSIVE

◆ PRIMARY_KEYS

◆ REMOTE_QUERY

◆ REMOTE_QUERY_FILTER_COLUMN

◆ REMOTE_QUERY_INCREASING_COLUMN

◆ REMOTE_QUERY_ORDER_BY

◆ REMOTE_QUERY_PARTITION_COLUMN

◆ SHARD_KEYS

◆ SUBSCRIBE

◆ TRUE

◆ TRUNCATE_STRINGS

◆ TRUNCATE_TABLE

◆ TYPE_INFERENCE_ONLY

◆ UPDATE_ON_EXISTING_PK