Before You Start
Note that provisioning Kinetica through the Azure Marketplace will incur charges in your Azure subscription. These charges will depend on the type and size of the cluster you provision as well as the hours of usage. Once the provisioning is complete, the database will start running.
Pre-requisites
Azure Account
An Azure account is required to provision Marketplace applications, including Kinetica. If you have an Azure free account, you will need to upgrade to an Azure Pay As You Go Account before provisioning Kinetica.
Subscription Owner Role
Kinetica in Azure requires that you are an owner on the Azure Subscription in order to provision the cluster. Check your subscriptions in the Azure Portal to confirm your role.
Azure Resource Providers
Make sure you have the following resource providers enabled:
- Microsoft.AlertsManagement
- Microsoft.ContainerInstance
- Microsoft.OperationsManagement
Azure Quota
Make sure you have an adequate quota in your Azure subscription and Azure region for the following resources:
Microsoft.Network
- Static Public IP Addresses (1 per cluster deployment)
- Public IP Addresses - Standard (1 per cluster deployment)
- Public IP Addresses - Basic (1 per cluster deployment)
Microsoft.Compute
The number of required cores for Standard ESv4 and Standard NVSv3 families depends on the cluster size and configuration:
GPU Acceleration Cluster Size Required Standard ESv4 Cores Required Standard NVSv3 Cores Off XS 22 N/A Off S 38 N/A Off M 74 N/A On XS 6 24 On S 6 48 On M 10 96
Provisioning
Choosing an Offer
There are two different offers in Azure for Kinetica, depending on your preferred consumption and payment model:
Larger cluster sizes and configurations are only available in the Bring Your Own License (BYOL) offer. All other features and functions are the same between the two offers.
Kinetica Pay As You Go (PAYG)
With this offer, Kinetica license fees are based on your hourly usage and the size of the cluster. See Size for specifics on cluster sizes, hardware configurations, and hourly license fees.
Click the following links to review the PAYG offering in Azure and begin the provisioning process.
Kinetica Bring Your Own License (BYOL)
For customers with an existing Kinetica license, you can choose this option and input your existing Kinetica license key. You will not incur additional Kinetica license charges, although you will be charged for Azure infrastructure costs.
Click the following links to review the BYOL offering in Azure and begin the provisioning process.
Basics
The first step of the Azure provisioning process requires certain basic information about your Azure subscription and Kinetica deployment:
Subscription: The Azure Subscription you want to use for this deployment
Resource Group: The Azure Resource Group that should contain the Azure Managed Application for the Kinetica deployment.
Region: The Azure region where Kinetica should be deployed. The following regions are currently supported:
Region Azure Supported Region(s) Africa South Africa North Asia Pacific Southeast Asia Australia Australia East Brazil Brazil South Europe North Europe
West Europe
France Central
India Central India Japan Japan East United Arab Emirates UAE North United Kingdom UK South United States East US
East US 2
South Central US
West US
West US 2
Kinetica License Key: [BYOL Only] To provision Kinetica in Azure, enter your existing license key.
Kinetica Cluster Name: A label you can use to identify a specific Kinetica instance when you have multiple Kinetica deployments. This name will be used for the Managed Application in the Resource Group specified above. The name will also be visible in the Kinetica Workbench so that you can easily differentiate among Kinetica deployments.
Note
We recommend using a unique name for your cluster to ensure that deployments in the same resource group do not conflict.
Managed Resource Group: This identifier is pre-populated by Azure and should not be changed.
Size
As a next step, you will choose the type and size of your Kinetica Cluster.
GPU Acceleration
This setting determines whether the deployment will use GPUs to accelerate the performance of your database. This option is recommended if you have use cases that would benefit from GPU performance, such as interactive visualization of large scale geographic data or high-cardinality joins.
Kinetica Cluster Size
This setting will determine the performance of your database. Each increase in size roughly corresponds to a doubling in performance. We recommend you start with smaller cluster sizes for testing and evaluation and then scale to larger sizes (as needed) for your production deployments.
Note
Not all sizes and configurations are available with the Pay-As-You-Go offer. See the table below for size availability per offer.
Hardware Configurations
The following tables show the Azure infrastructure (VMs and Managed Disks) that will be deployed for the database for different sizes and configurations, as well as the availability per offer of each configuration.
All configurations use P40 2 TiB Managed Disks.
Note
- In addition to the database infrastructure shown in the charts below, additional Azure resources will be provisioned for other required components, including the Kinetica Workbench UI
- The total data capacity is unlimited through the use of Azure blob storage. The Recommended Hot Data Size is a rough estimation of the amount of data at a time that can be efficiently used in queries without decreasing performance. However, this will also greatly depend on the size & complexity of the queries issued.
Standard
| Size | VM Series | # VMs | # Disks | PAYG | BYOL | Recommended Hot Data Size |
|---|---|---|---|---|---|---|
| XS | E16s v4 | 1 | 1 | $1.50/hour | Yes | 250 GB |
| S | E16s v4 | 2 | 2 | $3.00/hour | Yes | 500 GB |
| M | E16s v4 | 4 | 4 | $6.00/hour | Yes | 1 TB |
| L | E16s v4 | 8 | 8 | N/A | Yes | 2 TB |
| XL | E16s v4 | 16 | 16 | N/A | Yes | 4 TB |
| 2XL | E16s v4 | 32 | 32 | N/A | Yes | 8 TB |
| 3XL | E16s v4 | 64 | 64 | N/A | Yes | >16 TB |
GPU
| Size | VM Series | # VMs | # Disks | PAYG | BYOL | Recommended Hot Data Size |
|---|---|---|---|---|---|---|
| XS | NV24s v3 | 1 | 2 | $1.80/hour | Yes | 250 GB |
| S | NV24s v3 | 2 | 4 | $3.60/hour | Yes | 500 GB |
| M | NV24s v3 | 4 | 8 | $7.20/hour | Yes | 1 TB |
| L | NV24s v3 | 8 | 16 | N/A | Yes | 2 TB |
| XL | NV24s v3 | 16 | 32 | N/A | Yes | 4 TB |
| 2XL | NV24s v3 | 32 | 64 | N/A | Yes | 8 TB |
| 3XL | NV24s v3 | 64 | 128 | N/A | Yes | >16 TB |
User Information
In this step, you will define the initial administrator username and password for your Kinetica cluster, as well as contact information for support.
Networking
In this step, you can choose to use the default network configuration or configure advanced options. If you are testing or evaluating Kinetica, you can select the Default Network Configuration option. If you intend to peer the Kinetica network with another Azure network, you should choose Advanced Network Configuration and review the settings. For more information on the Advanced Network Configuration, see the corresponding Azure documentation for details on the specific settings:
https://docs.microsoft.com/en-us/azure/aks/configure-azure-cni
Note
The settings under Advanced Network Configuration cannot be changed after provisioning.
After provisioning, you will be able to configure network security groups and rules. For instance, you could add rules to limit access to specific IP addresses or ranges.
Basic Networking Configuration
Advanced Networking Configuration
Tags
This is a standard step for provisioning Azure resources that allows you to specify your own custom tags for the resources associated with this cluster deployment.
Provisioning Time Warning
The provisioning process for Kinetica in Azure currently takes between 60 and 90 minutes.
Review & Create
In this final screen, you can review the terms and agreements for the Kinetica Cluster and the settings you have specified.
Once you click Create, the provisioning process will start.
Note
The Kinetica cluster will start running as soon as the provisioning process completes and you will start to incur costs from the associated Azure infrastructure.
Validating the Cluster Deployment
After the provisioning process is complete, you should see an indication that the deployment is complete:
If the provisioning process was not successful, please contact Kinetica support <support@kinetica.com>.
Get the Workbench URL
After your deployment is complete, click on Go to resource to navigate to the Managed Application. Alternatively, you can also search for the Managed Application that you just provisioned (the name will be the Kinetica Cluster name you entered on the first page of the provisioning process).
Click on Parameters and Outputs under Settings in the left sidebar. The hostname is at the bottom of the list:
Note
This is the hostname (e.g. kinetica-sdw-prsmowx4jmuqe.eastus.cloudapp.azure.com) you will use to connect to the Workbench. See Connecting to the Kinetica Workbench for connection instructions.
Appendix
Operating Costs
The total cost to operate Kinetica is based on the Kinetica license fee and the cost of the Azure infrastructure.
Kinetica License Fee
If you are using the Kinetica Pay As You Go offer (PAYG), the Kinetica license fee is based on the size of the Kinetica cluster and the hours of usage. If you suspend Kinetica (manually or through auto suspend), the cluster is suspended, and you will not incur Kinetica license fees until the cluster is resumed. For details on the hourly license fees for different cluster sizes, see Hardware Configurations.
If you are using the Kinetica Bring Your Own License offer (BYOL), you will not be charged in Azure for a Kinetica license fee. Your Kinetica license fee has already been paid for outside the Azure Marketplace.
Azure Infrastructure Costs
Your Azure infrastructure costs will depend on the size of the Kinetica cluster, any discounted pricing you may receive (e.g., credits for Reserved Virtual Machine Instances), and your overall usage of the cluster.
The primary cost components will be the Azure VM(s) and Managed Disk(s) used in the AKS cluster to power the Kinetica database and the VM(s) used for additional cluster infrastructure services (e.g., Kinetica Workbench). When the Kinetica cluster is suspended, the VM(s) and Managed Disk(s) used by the Kinetica database will be spun down and will not incur costs. However, the infrastructure services will continue to run and incur costs.
Finally, your usage of the cluster will also affect the overall cost, although the incremental costs should be minor. For instance, ingesting large volumes of data may increase your network charges while increased usage may increase the log volume stored in Azure Log Analytics.
Below are the estimated costs to operate Kinetica clusters in Azure, assuming on-demand VM instance pricing. With Reserved Virtual Machine Instances (especially for the compute nodes), you will be able to realize significant cost savings.
| Type | Size | VMs for Kinetica database | Managed Disks | Estimated Infrastructure Cost [running] ($/hour) | Estimated Infrastructure Cost [suspended] ($/hour) |
|---|---|---|---|---|---|
| CPU | XS | 1 E16s v4 (16 vCPU, 128 GB) | 2 TB | $1.89 | $0.87 |
| CPU | S | 2 E16s v4 (16 vCPU, 128 GB) | 4 TB | $3.21 | $1.19 |
| CPU | M | 4 E16s v4 (16 vCPU, 128 GB) | 8 TB | $5.86 | $1.82 |
| GPU | XS | 1 NV24s v3 (2 M60, 24 vCPU, 224 GB) | 4 TB | $3.16 | $0.87 |
| GPU | S | 2 NV24s v3 (2 M60, 24 vCPU, 224 GB) | 8 TB | $5.76 | $1.19 |
| GPU | M | 4 NV24s v3 (2 M60, 24 vCPU, 224 GB) | 16 TB | $10.95 | $1.82 |
