7.1 Release Notes

Publish Date: 2021.07.08

Features

Kinetica is now also available as a managed application in the Azure Marketplace!

  • Streamlined provisioning process simplifies setup and gets you up and running in 30 minutes
  • Pay-as-you-go option allows you to pay for what you use, billed through Azure
  • Infrastructure provisioned into your Azure subscription, but monitored and managed by Kinetica (Azure Managed Application)
  • New Kinetica Workbench simplifies SQL analysis and collaboration (replacing GAdmin)
  • Easily ingest data from developer's local environment into Kinetica's marketplace instance
  • Easily set up streaming ingestion from Kafka, AWS S3, and Azure blob storage from within Kinetica
  • User-Defined Functions (UDFs), Graphs, and ML models can be managed & executed via SQL
  • Integrated performance monitoring with Azure Monitor
  • One-click upgrades

SQL/OLAP

  • Support for streaming from Azure, Kafka, and S3 data sources
  • Support for shapefile ingestion
  • Added managed credential framework for authenticating to external data sources and model repositories, in SQL and natively
  • New SQL commands for managing & executing UDFs
  • New SQL commands for managing & querying/matching/solving graphs
  • New SQL commands for managing & executing ML models
  • Support for looking up specific granted permissions and roles, in SQL and natively
  • Improved KiFS and its integration within the database

Geospatial/Network Graph/Visualization

  • Enabled distributed solves for name (string) based property graphs
  • Added feature attributes to the Vector Tile Service output
  • Added new Eulerian Paths solver, useful for fraud detection; see MATCH_LOOPS solver type in /match/graph
  • Added graph statistics, including diameter, average valence, clusters, average and maximum cluster sizes available as STATS_ALL solver type in /solve/graph
  • Added new Centrality Closeness solver, useful for fraud detection; see CLOSENESS solver type in /solve/graph
  • Added max_truck_drop_limit to the Multiple Supply Demand solver
  • Added ability to export SVG embedded html output for Multiple Supply Demand solver for real time dynamic simulations with routing animation (speed adjustable for tracking)
  • Added API endpoints for creating and retrieving WMS videos; can be overlaid on many basemap providers
  • Enabled distributed shortest path solves for non-geospatial graphs
  • Added maximum solution targets limit for Centrality and Page Rank solvers for performance tuning
  • Various performance improvements and bug fixes

AAW

  • Support for ML management & execution commands via SQL
  • Automatic completion and teardown of batch mode model jobs
  • Improved logging (custom log levels, redirection etc.)
  • Server level performance and stability improvements
  • More efficient reporting of model running state in user interface

APIs/Tools/Connectors


Version 7.1.8

Build Date: 2022.10.16

Highlights

  • Data egress from Kinetica to CSV and Parquet
  • Boolean data type support
  • Regular expression matching via SQL
  • KIO deprecated; replaced by native ingress & egress capabilities

SQL/OLAP

  • New functions:
    • REGEXP_LIKE - regular expression filtering
    • TIME_BUCKET
  • Geospatial indexes for WKT or latitude/longitude columns
  • Added support for multi-head fast record retrieval with KI_HINT_KEY_LOOKUP hint
  • SQL support for applying the k-means algorithm
  • LIST DATASOURCE command for listing remote tables via data source
  • Materialized views can be moved from one schema to another
  • Support for extracting the epoch from a timestamp using EXTRACT
  • Simplified syntax for loading data from a remote table via LOAD INTO...FROM REMOTE TABLE
  • Improved performance for queries using primary or partition key columns
  • Reduced-memory index for low-cardinality columns

Infrastructure

  • Native data egress in CSV & Parquet formats
  • Support for limiting KiFS directory sizes
  • Support for altering the number of CPU & GPU data processors, as well as the maximum number of concurrent running GPU kernels, at runtime

Geospatial/Network Graph/Visualization

  • Graph support for all WKT types, including discontinuous ones
  • Support for running the supply/demand solve as a batch traveling salesman solve via BATCH_TSM_MODE option
  • Support for filtering out demand sites beyond a given distance from a transport's starting location when using the supply/demand solver, via TRUCK_SERVICE_RADIUS
  • Support for a crowd-sourcing type of supply/demand solve, made possible by DEPOT_ID being used as a grouping mechanism and not assumed to be the location of the transports
  • Added optional supply/demand unit unloading penalties via DEMAND_PENALTY & SUPPLY_TRUCK_PENALTY
  • Added optional threshold on supply side sequencing via MAX_SUPPLY_COMBINATIONS
  • Sequencing on the supply side of supply/demand solvers is now multithreaded
  • Support for querying feature information at a given point via the WMS GetFeatureInfo function

APIs/Tools/Connectors

  • Java API
    • Boolean type support
    • Added retry handler for requests that fail under heavy load
    • Improved bulk ingestion error handling/reporting
    • Improved support for compiling & running API client code under different Java versions
  • JDBC
    • BLOB/CLOB support
    • Added support for multi-head fast record retrieval with KI_HINT_KEY_LOOKUP hint
    • Added support for disabling multi-head inserts
    • Improved INSERT error handling/reporting
    • Added support for the non-transactional driver being used by JDBC clients requiring transactions
  • Python API
    • Improved HTTP protocol compliance

UI

  • Workbench
    • Added CData import UI
    • Added usage metrics UI
    • Updated example workbooks
    • Enhanced home screen

Version 7.1.7

Build Date: 2022.07.03

Highlights

  • Kinetica Workbench web interface for developing and collaborating with interactive SQL workbooks
  • JDBC ingress and egress
  • Import and export data to/from other data sources and enterprise applications
  • Reveal filter slice allows additional map layers to be used for filtering base layer
  • New track SQL functions

SQL/OLAP

  • New functions:
    • ST_TRACK_DWITHIN
    • ST_TRACKINTERSECTS
    • ST_TRACKDURATION
    • ST_TRACKLENGTH
  • Other new functions:
    • ISNUMERIC
    • WIDTH_BUCKET
  • Added support for ILIKE operator
  • New SQL command to upload a file to KiFS from a URL
  • Support for renaming schemas
  • Support for renaming and moving materialized views
  • Added SQL Support for generating isochrones
  • SQL Procedures can now invoke UDFs
  • Added support for pg_roles and pg_type catalog tables
  • Statistics and errors now saved for data imports and exports
  • Track rendering now supported on joins and materialized views
  • Track rendering now supports alternate ID and timestamp column names
  • Logical views, logical external tables, and catalog tables are now accessible from the native API
  • Materialized views are now updated, when needed, after multi-head inserts
  • PostgreSQL Wire Protocol support now includes Extended Query Protocol
  • KiSQL now supports line editing and line history
  • Improved performance of ingestion and copying of data with init_with_uuid column property
  • Improved UUID generation algorithm to produce more unique values for large batch inserts
  • Added support for chunk-skipping in series partitions, when query includes the partition key
  • Input UUIDs do not require hyphens
  • Support for optional AM/PM in default date format
  • Added LLL (whole milliseconds) and $ (start of optional section) code to TO_CHAR family of functions
  • Updated CAST function to work more consistently with other databases
  • K-means clustering algorithm now supported on CPUs, join views, and materialized views
  • Support for multiple subscriptions to same Kafka topic, if done by different users

Infrastructure

  • Google Cloud Storage support
    • Direct ingestion from files in GCS
    • External tables from files in GCS
    • GCS-based cold storage tier
  • JDBC ingress support
    • Direct ingestion from queries on JDBC-accessible databases
    • External tables from queries on JDBC-accessible databases
  • JDBC Egress support
    • Export Kinetica query results into JDBC-accessible databases
  • Broader support for SQL & NoSQL databases and enterprise applications via Kinetica data sources
  • Support for KiFS files in configuration settings and credential, data source, & data sink properties that reference files
  • Support customer-managed keys for AWS S3 access
  • Allow S3 data source or cold storage user to be able specify the server-side encryption method and key
  • Enable S3 IAM role parameter in configuration settings for cold storage

Geospatial/Network Graph/Visualization

  • New /match/graph solver, match_charging_stations, for finding an optimal route involving multiple electric-vehicle charging stations
  • Distributed graph support for /query/graph

APIs/Tools/Connectors

  • Java API
    • Added capability to pass in self-signed certificates & passwords as options
    • Updated dependencies to more secure versions
    • Fixed unhandled exception when an Avro encoding error occurs
    • Fixed error where a type's column order would not match a table created from it
    • Removed client-side primary key check, to improve performance and make returned errors more consistently delivered
  • Python API
    • Made the API more Python3 compatible
    • Prevented client hanging when connection IP/URL does not match any known to the server; client will operate in degraded mode (no multi-head, etc.)
    • Removed client-side primary key check, to improve performance and make returned errors more consistently delivered
    • Rectified a formatting issue while building expressions for keyed lookups that was resulting in a failure on Python 2.7.x.
    • Corrected some string/null comparisons
  • C++/C#
    • Removed client-side primary key check, to improve performance and make returned errors more consistently delivered

UI

  • Kinetica Workbench web interface for developing and collaborating with interactive SQL workbooks
  • GAdmin viewer for SVG animation results in Graph Match UI
  • Allow Reveal additional map layers to be used for filtering base layer
  • Allow Reveal map tracks click and highlight
  • Allow Reveal to be embedded in an iframe

Version 7.1.5

Build Date: 2021.08.13

SQL/OLAP

  • New SQL commands for managing files & directories in KiFS
  • New SQL command for loading Reveal dashboards from GitHub, Amazon S3, or a local file
  • Added support for data sources on public S3 buckets and Azure BLOB stores
  • Added data sinks, which are references to external systems that can receive data streamed from Kinetica, in SQL and natively
  • Added filter-based triggers for detecting changes in data over time
  • Added a default set of libraries for use with Python UDFs

Geospatial/Network Graph/Visualization

  • Added graph security
  • Ported non-path solvers to work with partitioned graphs
  • Added graph elasticity on cloud deployments

APIs/Tools/Connectors

  • Added support for uploading & downloading of files from a client using KiSQL
  • Added multipart uploading of files to KiFS in the Java API

UI

Workbench

  • Enabled multipart file uploading, which removes previous limits on the total file sizes allowed by the drag & drop uploader
  • Track & contour rendering options added to Map widget
  • Scatter plot chart added as visualization option for SQL query block

Reveal

  • UX streamlined with various workflow improvements