Provisioning Kinetica in Azure

Before You Start

Note that provisioning Kinetica through the Azure Marketplace will incur charges in your Azure subscription. These charges will depend on the type and size of the cluster you provision as well as the hours of usage. Once the provisioning is complete, the database will start running.

Pre-requisites

Azure Account

An Azure account is required to provision Marketplace applications, including Kinetica. If you have an Azure free account, you will need to upgrade to an Azure Pay As You Go Account before provisioning Kinetica.

Subscription Owner Role

Kinetica in Azure requires that you are an owner on the Azure Subscription in order to provision the cluster. Check your subscriptions in the Azure Portal to confirm your role.

Azure Resource Providers

Make sure you have the following resource providers enabled:

  • Microsoft.AlertsManagement
  • Microsoft.ContainerInstance
  • Microsoft.OperationsManagement

Azure Quota

Make sure you have an adequate quota in your Azure subscription and Azure region for the following resources:

  • Microsoft.Network

    • Static Public IP Addresses (1 per cluster deployment)
    • Public IP Addresses - Standard (1 per cluster deployment)
    • Public IP Addresses - Basic (1 per cluster deployment)
  • Microsoft.Compute

    The number of required cores for Standard ESv4 and Standard NVSv3 families depends on the cluster size and configuration:

    GPU Acceleration Cluster Size Required Standard ESv4 Cores Required Standard NVSv3 Cores
    Off XS 22 N/A
    Off S 38 N/A
    Off M 74 N/A
    On XS 6 24
    On S 6 48
    On M 10 96

Provisioning

Choosing an Offer

There are two different offers in Azure for Kinetica, depending on your preferred consumption and payment model:

Larger cluster sizes and configurations are only available in the Bring Your Own License (BYOL) offer. All other features and functions are the same between the two offers.

Kinetica Pay As You Go (PAYG)

With this offer, Kinetica license fees are based on your hourly usage and the size of the cluster. See Size for specifics on cluster sizes, hardware configurations, and hourly license fees.

Click the following links to review the PAYG offering in Azure and begin the provisioning process.

Kinetica Bring Your Own License (BYOL)

For customers with an existing Kinetica license, you can choose this option and input your existing Kinetica license key. You will not incur additional Kinetica license charges, although you will be charged for Azure infrastructure costs.

Click the following links to review the BYOL offering in Azure and begin the provisioning process.

Basics

The first step of the Azure provisioning process requires certain basic information about your Azure subscription and Kinetica deployment:

  • Subscription: The Azure Subscription you want to use for this deployment

  • Resource Group: The Azure Resource Group that should contain the Azure Managed Application for the Kinetica deployment.

  • Region: The Azure region where Kinetica should be deployed. The following regions are currently supported:

    Region Azure Supported Region(s)
    Africa South Africa North
    Asia Pacific Southeast Asia
    Australia Australia East
    Brazil Brazil South
    Europe

    North Europe

    West Europe

    France Central

    India Central India
    Japan Japan East
    United Arab Emirates UAE North
    United Kingdom UK South
    United States

    East US

    East US 2

    South Central US

    West US

    West US 2

  • Kinetica License Key: [BYOL Only] To provision Kinetica in Azure, enter your existing license key.

  • Kinetica Cluster Name: A label you can use to identify a specific Kinetica instance when you have multiple Kinetica deployments. This name will be used for the Managed Application in the Resource Group specified above. The name will also be visible in the Kinetica Workbench so that you can easily differentiate among Kinetica deployments.

    Note

    We recommend using a unique name for your cluster to ensure that deployments in the same resource group do not conflict.

  • Managed Resource Group: This identifier is pre-populated by Azure and should not be changed.

../img/prov.step_basics.png

Size

As a next step, you will choose the type and size of your Kinetica Cluster.

../img/prov.step_size.png

GPU Acceleration

This setting determines whether the deployment will use GPUs to accelerate the performance of your database. This option is recommended if you have use cases that would benefit from GPU performance, such as interactive visualization of large scale geographic data or high-cardinality joins.

Kinetica Cluster Size

This setting will determine the performance of your database. Each increase in size roughly corresponds to a doubling in performance. We recommend you start with smaller cluster sizes for testing and evaluation and then scale to larger sizes (as needed) for your production deployments.

Note

Not all sizes and configurations are available with the Pay-As-You-Go offer. See the table below for size availability per offer.

Hardware Configurations

The following tables show the Azure infrastructure (VMs and Managed Disks) that will be deployed for the database for different sizes and configurations, as well as the availability per offer of each configuration.

All configurations use P40 2 TiB Managed Disks.

Note

  • In addition to the database infrastructure shown in the charts below, additional Azure resources will be provisioned for other required components, including the Kinetica Workbench UI
  • The total data capacity is unlimited through the use of Azure blob storage. The Recommended Hot Data Size is a rough estimation of the amount of data at a time that can be efficiently used in queries without decreasing performance. However, this will also greatly depend on the size & complexity of the queries issued.
Standard
Size VM Series # VMs # Disks PAYG BYOL Recommended Hot Data Size
XS E16s v4 1 1 $1.50/hour Yes 250 GB
S E16s v4 2 2 $3.00/hour Yes 500 GB
M E16s v4 4 4 $6.00/hour Yes 1 TB
L E16s v4 8 8 N/A Yes 2 TB
XL E16s v4 16 16 N/A Yes 4 TB
2XL E16s v4 32 32 N/A Yes 8 TB
3XL E16s v4 64 64 N/A Yes >16 TB
GPU
Size VM Series # VMs # Disks PAYG BYOL Recommended Hot Data Size
XS NV24s v3 1 2 $1.80/hour Yes 250 GB
S NV24s v3 2 4 $3.60/hour Yes 500 GB
M NV24s v3 4 8 $7.20/hour Yes 1 TB
L NV24s v3 8 16 N/A Yes 2 TB
XL NV24s v3 16 32 N/A Yes 4 TB
2XL NV24s v3 32 64 N/A Yes 8 TB
3XL NV24s v3 64 128 N/A Yes >16 TB

User Information

In this step, you will define the initial administrator username and password for your Kinetica cluster, as well as contact information for support.

../img/prov.step_user_info.png

Networking

In this step, you can choose to use the default network configuration or configure advanced options. If you are testing or evaluating Kinetica, you can select the Default Network Configuration option. If you intend to peer the Kinetica network with another Azure network, you should choose Advanced Network Configuration and review the settings. For more information on the Advanced Network Configuration, see the corresponding Azure documentation for details on the specific settings:

https://docs.microsoft.com/en-us/azure/aks/configure-azure-cni

Note

The settings under Advanced Network Configuration cannot be changed after provisioning.

After provisioning, you will be able to configure network security groups and rules. For instance, you could add rules to limit access to specific IP addresses or ranges.

../img/prov.step_networking.png

Basic Networking Configuration

../img/prov.step_networking_adv.png

Advanced Networking Configuration

Tags

This is a standard step for provisioning Azure resources that allows you to specify your own custom tags for the resources associated with this cluster deployment.

../img/prov.step_tags.png

Provisioning Time Warning

The provisioning process for Kinetica in Azure currently takes between 60 and 90 minutes.

../img/prov.step_prov_size_warn.png

Review & Create

In this final screen, you can review the terms and agreements for the Kinetica Cluster and the settings you have specified.

Once you click Create, the provisioning process will start.

Note

The Kinetica cluster will start running as soon as the provisioning process completes and you will start to incur costs from the associated Azure infrastructure.

../img/prov.step_create.png ../img/prov.step_create_in_progress.png

Validating the Cluster Deployment

After the provisioning process is complete, you should see an indication that the deployment is complete:

../img/prov.step_create_complete.png

If the provisioning process was not successful, please contact Kinetica support <support@kinetica.com>.

Get the Workbench URL

After your deployment is complete, click on Go to resource to navigate to the Managed Application. Alternatively, you can also search for the Managed Application that you just provisioned (the name will be the Kinetica Cluster name you entered on the first page of the provisioning process).

../img/prov.manage.png

Click on Parameters and Outputs under Settings in the left sidebar. The hostname is at the bottom of the list:

../img/prov.manage_params.png

Note

This is the hostname (e.g. kinetica-sdw-prsmowx4jmuqe.eastus.cloudapp.azure.com) you will use to connect to the Workbench. See Connecting to the Kinetica Workbench for connection instructions.