7.1 Release Notes

SQL/OLAP

• Support for streaming from Azure, Kafka, and S3 data sources
• Support for shapefile ingestion
• Added managed credential framework for authenticating to external data sources and model repositories, in SQL and natively
• New SQL commands for managing & executing UDFs
• New SQL commands for managing & querying/matching/solving graphs
• New SQL commands for managing & executing ML models
• Support for looking up specific granted permissions and roles, in SQL and natively
• Improved KiFS and its integration within the database

Geospatial/Network Graph/Visualization

• Enabled distributed solves for name (string) based property graphs
• Added feature attributes to the Vector Tile Service output
• Added new Eulerian Paths solver, useful for fraud detection; see MATCH_LOOPS solver type in /match/graph
• Added graph statistics, including diameter, average valence, clusters, average and maximum cluster sizes available as STATS_ALL solver type in /solve/graph
• Added new Centrality Closeness solver, useful for fraud detection; see CLOSENESS solver type in /solve/graph
• Added max_truck_drop_limit to the Multiple Supply Demand solver
• Added ability to export SVG embedded html output for Multiple Supply Demand solver for real time dynamic simulations with routing animation (speed adjustable for tracking)
• Added API endpoints for creating and retrieving WMS videos; can be overlaid on many basemap providers
• Enabled distributed shortest path solves for non-geospatial graphs
• Added maximum solution targets limit for Centrality and Page Rank solvers for performance tuning
• Various performance improvements and bug fixes

AAW

• Support for ML management & execution commands via SQL
• Automatic completion and teardown of batch mode model jobs
• Improved logging (custom log levels, redirection etc.)
• Server level performance and stability improvements
• More efficient reporting of model running state in user interface

APIs/Tools/Connectors

• Added capability to upload files to Kinetica File System (KiFS) to the Java API

Highlights

• Data egress from Kinetica to CSV and Parquet
• Boolean data type support
• Regular expression matching via SQL
• KIO deprecated; replaced by native ingress & egress capabilities

SQL/OLAP

• New functions:
  • REGEXP_LIKE - regular expression filtering
  • TIME_BUCKET
• Geospatial indexes for WKT or latitude/longitude columns
• Added support for multi-head fast record retrieval with KI_HINT_KEY_LOOKUP hint
• SQL support for applying the k-means algorithm
• LIST DATASOURCE command for listing remote tables via data source
• Materialized views can be moved from one schema to another
• Support for extracting the epoch from a timestamp using EXTRACT
• Simplified syntax for loading data from a remote table via LOAD INTO...FROM REMOTE TABLE
• Improved performance for queries using primary or partition key columns
• Reduced-memory index for low-cardinality columns

Infrastructure

• Native data egress in CSV & Parquet formats
• Support for limiting KiFS directory sizes
• Support for altering the number of CPU & GPU data processors, as well as the maximum number of concurrent running GPU kernels, at runtime

Geospatial/Network Graph/Visualization

• Graph support for all WKT types, including discontinuous ones
• Support for running the supply/demand solve as a batch traveling salesman solve via BATCH_TSM_MODE option
• Support for filtering out demand sites beyond a given distance from a transport's starting location when using the supply/demand solver, via TRUCK_SERVICE_RADIUS
• Support for a crowd-sourcing type of supply/demand solve, made possible by DEPOT_ID being used as a grouping mechanism and not assumed to be the location of the transports
• Added optional supply/demand unit unloading penalties via DEMAND_PENALTY & SUPPLY_TRUCK_PENALTY
• Added optional threshold on supply side sequencing via MAX_SUPPLY_COMBINATIONS
• Sequencing on the supply side of supply/demand solvers is now multithreaded
• Support for querying feature information at a given point via the WMS GetFeatureInfo function

APIs/Tools/Connectors

• Java API
  • Boolean type support
  • Added retry handler for requests that fail under heavy load
  • Improved bulk ingestion error handling/reporting
  • Improved support for compiling & running API client code under different Java versions
• JDBC
  • BLOB/CLOB support
  • Added support for multi-head fast record retrieval with KI_HINT_KEY_LOOKUP hint
  • Added support for disabling multi-head inserts
  • Improved INSERT error handling/reporting
  • Added support for the non-transactional driver being used by JDBC clients requiring transactions
• Python API
  • Improved HTTP protocol compliance

UI

• Workbench
  • Added CData import UI
  • Added usage metrics UI
  • Updated example workbooks
  • Enhanced home screen

Highlights

• Kinetica Workbench web interface for developing and collaborating with interactive SQL workbooks
• JDBC ingress and egress
• Import and export data to/from other data sources and enterprise applications
• Reveal filter slice allows additional map layers to be used for filtering base layer
• New track SQL functions

SQL/OLAP

• New functions:
  • ST_TRACK_DWITHIN
  • ST_TRACKINTERSECTS
  • ST_TRACKDURATION
  • ST_TRACKLENGTH
• Other new functions:
  • ISNUMERIC
  • WIDTH_BUCKET
• Added support for ILIKE operator
• New SQL command to upload a file to KiFS from a URL
• Support for renaming schemas
• Support for renaming and moving materialized views
• Added SQL Support for generating isochrones
• SQL Procedures can now invoke UDFs
• Added support for pg_roles and pg_type catalog tables
• Statistics and errors now saved for data imports and exports
• Track rendering now supported on joins and materialized views
• Track rendering now supports alternate ID and timestamp column names
• Logical views, logical external tables, and catalog tables are now accessible from the native API
• Materialized views are now updated, when needed, after multi-head inserts
• PostgreSQL Wire Protocol support now includes Extended Query Protocol
• KiSQL now supports line editing and line history
• Improved performance of ingestion and copying of data with init_with_uuid column property
• Improved UUID generation algorithm to produce more unique values for large batch inserts
• Added support for chunk-skipping in series partitions, when query includes the partition key
• Input UUIDs do not require hyphens
• Support for optional AM/PM in default date format
• Added LLL (whole milliseconds) and $ (start of optional section) code to TO_CHAR family of functions
• Updated CAST function to work more consistently with other databases
• K-means clustering algorithm now supported on CPUs, join views, and materialized views
• Support for multiple subscriptions to same Kafka topic, if done by different users

Infrastructure

• Google Cloud Storage support
  • Direct ingestion from files in GCS
  • External tables from files in GCS
  • GCS-based cold storage tier
• JDBC ingress support
  • Direct ingestion from queries on JDBC-accessible databases
  • External tables from queries on JDBC-accessible databases
• JDBC Egress support
  • Export Kinetica query results into JDBC-accessible databases
• Broader support for SQL & NoSQL databases and enterprise applications via Kinetica data sources
• Support for KiFS files in configuration settings and credential, data source, & data sink properties that reference files
• Support customer-managed keys for AWS S3 access
• Allow S3 data source or cold storage user to be able specify the server-side encryption method and key
• Enable S3 IAM role parameter in configuration settings for cold storage

Geospatial/Network Graph/Visualization

• New /match/graph solver, match_charging_stations, for finding an optimal route involving multiple electric-vehicle charging stations
• Distributed graph support for /query/graph

APIs/Tools/Connectors

• Java API
  • Added capability to pass in self-signed certificates & passwords as options
  • Updated dependencies to more secure versions
  • Fixed unhandled exception when an Avro encoding error occurs
  • Fixed error where a type's column order would not match a table created from it
  • Removed client-side primary key check, to improve performance and make returned errors more consistently delivered
• Python API
  • Made the API more Python3 compatible
  • Prevented client hanging when connection IP/URL does not match any known to the server; client will operate in degraded mode (no multi-head, etc.)
  • Removed client-side primary key check, to improve performance and make returned errors more consistently delivered
  • Rectified a formatting issue while building expressions for keyed lookups that was resulting in a failure on Python 2.7.x.
  • Corrected some string/null comparisons
• C++/C#
  • Removed client-side primary key check, to improve performance and make returned errors more consistently delivered

UI

• Kinetica Workbench web interface for developing and collaborating with interactive SQL workbooks
• GAdmin viewer for SVG animation results in Graph Match UI
• Allow Reveal additional map layers to be used for filtering base layer
• Allow Reveal map tracks click and highlight
• Allow Reveal to be embedded in an iframe

SQL/OLAP

• New SQL commands for managing files & directories in KiFS
• New SQL command for loading Reveal dashboards from GitHub, Amazon S3, or a local file
• Added support for data sources on public S3 buckets and Azure BLOB stores
• Added data sinks, which are references to external systems that can receive data streamed from Kinetica, in SQL and natively
• Added filter-based triggers for detecting changes in data over time
• Added a default set of libraries for use with Python UDFs

Geospatial/Network Graph/Visualization

• Added graph security
• Ported non-path solvers to work with partitioned graphs
• Added graph elasticity on cloud deployments

APIs/Tools/Connectors

• Added support for uploading & downloading of files from a client using KiSQL
• Added multipart uploading of files to KiFS in the Java API

UI