Graph Solvers with REST

End-to-End Graph Example Using REST Endpoints

The following guide provides step-by-step instructions to get started with using the Network Graphs & Solvers in Kinetica. This guide demonstrates some key graph concepts as well as how to create and solve a graph using the Kinetica REST API.

Prerequisites

Data File

The tutorial makes use of the dc_shape dataset, which can be ingested from the data file mentioned above.

To ingest the file using Workbench:

  1. Log in to Workbench; see Connecting to the Kinetica Workbench.
  2. Click Import on the top menu.
  3. Click File Upload to upload the file through KiFS and then import the data from it.
  4. In the Setup step, enter the name of a KiFS directory as the Folder
  5. For File, select the data file on your local file system to upload, then click Upload.
  6. In the Source step, click Next.
  7. In the Destination step, enter graph for the Schema.
  8. Ensure dc_shape is specified as the Table.
  9. Click Import.

The file will be validated and records will be inserted.

Using the REST API

As mentioned above, running the following examples requires access to a REST client or a terminal. If opting to run the tutorial via a terminal, the tutorial script and cURL package are required. See Download & Run for more information.

Key Information and Concepts

After the data file has been ingested into Kinetica, you should learn about the dataset and how it relates to the Network Graphs Solvers.

Data

The dc_shape dataset is a HERE dataset and is analogous to most road network datasets you could find in that it includes columns for the type of road, the average speed, the direction of the road, a WKT linestring for its geographic location, a unique ID integer for the road, and more. The graph used in the example is created with two columns from the dc_shape dataset:

  • shape -- a WKT linestring composed of points that make up various streets, roads, highways, alleyways, and footpaths throughout Washington, D.C.
  • direction -- an integer column that conveys information about the directionality of the road, with forward meaning the direction in which the way is drawn in OSM and backward being the opposite direction:
    • 0 -- a forward one-way road
    • 1 -- a two-way road
    • 2 -- a backward one-way road

You'll notice later that the shape column is also part of an inline calculation for distance as weight during graph creation using the ST_LENGTH and ST_NPOINTS geospatial functions.

Graph Concepts

A graph typically comprises nodes, edges, weights, and restrictions, but only requires edges and weights. The graph created in this tutorial only uses edges and weights.

In this particular example, edges are logically mapped to sections of roadways and footpaths throughout the Washington, D.C., area. Each edge corresponds to a consecutive pair of points from each of the source LINESTRINGs, so a LINESTRING containing n points will have n-1 edges. Because the source graph is not created with nodes, implicit nodes are assigned at either end of each edge after graph creation.

For example, link ID 18350083 is a part of the Ward Circle roundabout, which itself is part of Massachusetts Avenue Northwest near American University. Selecting link ID 18350083 from the dc_shape table reveals the following WKT linestring (the end of the linestring was removed for clarity):

LINESTRING (-77.08544159 38.93787003, -77.08544159 38.93793869, -77.08545685 38.9380188, -77.08548737 38.9381218, ...)

As noted above, each consecutive pair of coordinates will correspond to an edge in the graph, e.g.:

  • Edge A - LINESTRING(-77.08544159 38.93787003, -77.08544159 38.93793869)
  • Edge B - LINESTRING(-77.08544159 38.93793869, -77.08545685 38.9380188)
  • Edge C - LINESTRING(-77.08545685 38.9380188, -77.08548737 38.9381218)

Weights in this graph, as mentioned previously, are an abstract cost (distance, time, etc.) for traveling any roadway or footpath in the Washington, D.C., area. Weights are particularly important when solving a graph. There are two solver types presented in the tutorial below:

  • shortest_path -- Find the shortest path between two points on a graph
  • multiple_routing -- Find the quickest route between a source point and many destination points; also known as traveling salesman

Because there are no explicit nodes in the tutorial graph, source and destination point(s) must be selected from any of the edges comprising the Washington, D.C., road network. Otherwise, the graph will not be able to traverse to the point and will result in a null solution.

Tutorial via REST Client

This tutorial can be run via cURL to create and solve the graph, but any REST client will work. In the following examples, the JSON block presented is passed as a text file to cURL's --data parameter, and the name of the endpoint is appended to the database connection URL.

A call to the /create/graph endpoint looks like:

REST Create Graph Call
1
2
3
curl -sS --header "Content-Type: application/json" \
  --user ${USERNAME}:${PASSWORD} \
  --data @create_graph.json ${HOST_URL}/create/graph

See the REST tab of Connecting via API for how to construct the HOST_URL parameter above.

The response will be a JSON block containing three primary fields:

  • status - OK or ERROR, depending on the success of the call
  • message - error message, if any
  • data_str - an escaped-quotes JSON block containing the response data for the request

Create Graph

One graph is used for both solve graph examples later in the tutorial: dc_shape_graph, a graph based on the aforementioned dc_shape dataset. The dc_shape_graph graph is created with the following characteristics:

  • It is directed because the roads in the graph have directionality (one-way and two-way roads)
  • It has no explicitly defined nodes because the example relies on implicit nodes attached to the defined edges
  • The edges are derived from WKT LINESTRINGs in the shape column of the dc_shape table (WKTLINE). Each road segment's directionality is derived from the direction column of the dc_shape table (DIRECTION). Each road segment's weight is represented as its distance, which is calculated as the length of the entire shape column's LINESTRING (in meters) divided by the number of points in the LINESTRING minus 1 (WEIGHT_VALUESPECIFIED).
  • It has no explicitly defined weights, as those were defined as part of the edge configuration above
  • It has no inherent restrictions for any of the nodes or edges in the graph
  • It utilizes the following options:
    • It will be replaced with this instance of the graph if a graph of the same name exists (recreate)
    • If nodes are within 0.00001 degrees (1 meter) of each other, they will be merged together (merge_tolerance)
    • The resulting graph's information will be placed into a table (graph_table) and an EDGE_WKTLINE column will be included so the graph can be visualized

To create the graph:

  1. Call the /create/graph endpoint with the following JSON parameter block:

    Create Graph Endpoint Call JSON Payload
     1
     2
     3
     4
     5
     6
     7
     8
     9
    10
    11
    12
    13
    14
    15
    16
    17
    
    {
      "graph_name": "graph_rest.dc_shape_graph",
      "directed_graph": true,
      "nodes": [],
      "edges": [
        "graph.dc_shape.shape AS WKTLINE",
        "graph.dc_shape.direction AS DIRECTION",
        "ST_LENGTH(graph.dc_shape.shape,1)/(ST_NPOINTS(graph.dc_shape.shape)-1) AS WEIGHT_VALUESPECIFIED"
      ],
      "weights": [],
      "restrictions": [],
      "options": {
        "merge_tolerance": "0.00001",
        "recreate": "true",
        "graph_table": "graph_rest.dc_shape_graph_table"
      }
    }
  2. The response should contain the following JSON block:

    Create Graph Endpoint Response
    1
    2
    3
    4
    5
    6
    7
    8
    9
    
    {
        "edges_ids": [],
        "info": {
            "status": "OK"
        },
        "num_edges": 491457,
        "num_nodes": 446491,
        "result": true
    }
    

Solve the Graph (Shortest Path)

The following scenario has been designed to illustrate a shortest path solution:

You work near the White House, and after you get off work, you'd like to attend a baseball game at the nearby ballpark. What's the shortest path you could take to get to the ballpark?

Important

The source and destination points were selected from endpoints of edges within the graph.

  Source Destination
WKT POINT(-77.03511810000001 38.89876175) POINT(-77.00585175000001 38.87462997)
Location Description The corner of Madison Place Northwest and Pennsylvania Avenue Northwest The corner of N Street Southeast and Southeast 1st street
WMS Location ../img/tutorial_solve_sp/dc_roads_sp_source.png ../img/tutorial_solve_sp/dc_roads_sp_dest.png

To generate the solution:

  1. Call the /solve/graph endpoint with the following JSON parameter block:

    Solve Graph Endpoint Call (Shortest Path) JSON Payload
     1
     2
     3
     4
     5
     6
     7
     8
     9
    10
    
    {
      "graph_name": "graph_rest.dc_shape_graph",
      "weights_on_edges": [],
      "restrictions": [],
      "solver_type": "shortest_path",
      "source_nodes": ["POINT(-77.03511810000001 38.89876175)"],
      "destination_nodes": ["POINT(-77.00585175000001 38.87462997)"],
      "solution_table": "graph_rest.dc_shape_graph_solved_shortest_path",
      "options": {}
    }

    Note

    Because the tutorial graph was created using WKT linestrings, the /solve/graph call provides the source and destination points as WKT points.

  2. The response should contain the following JSON block:

    Solve Graph Endpoint Response (Shortest Path)
    1
    2
    3
    4
    5
    6
    7
    
    {
        "info": {
            "status": "OK"
        },
        "result": true,
        "result_per_destination_node": []
    }
    
  3. The solution can be viewed in Workbench by:

    1. In the left pane, click the Data tab.
    2. Click the > next to the graph_rest schema to expand it (if not already expanded) to view its list of tables.
    3. Click the dc_shape_graph_solved_shortest_path table and then WMS Preview on the context menu
    4. Click Update to view the solution on the map
dc_roads_graph_solved_shortest_path.png

Solve the Graph (Multiple Routing)

The following scenario has been designed to illustrate a multiple routing solution:

You're currently taking the subway to Union Station to visit Washington D.C. for the day. You would like to see some of the most iconic monuments and buildings in Washington, D.C. before returning back to Union Station. Starting from Union Station, what's the quickest route between each stop before returning back to Union Station?

Important

The source and destination points were selected from endpoints of edges within the graph.

  Source Destination Destination Destination Destination
WKT POINT(-77.00576019 38.89677811) POINT(-77.03517151 38.8898201) POINT(-77.03626251 38.88068008) POINT(-77.04974365 38.89020157) POINT(-77.01207733 38.89072037)
Location Description Union Station Near the Washington Monument Near the Jefferson Memorial Near the Lincoln Memorial Near Capitol Hill
WMS Location ../img/tutorial_solve_mr/dc_roads_mr_source.png ../img/tutorial_solve_mr/dc_roads_mr_dest_wm.png ../img/tutorial_solve_mr/dc_roads_mr_dest_jm.png ../img/tutorial_solve_mr/dc_roads_mr_dest_lm.png ../img/tutorial_solve_mr/dc_roads_mr_dest_ch.png

To generate the solution:

  1. Call the /solve/graph endpoint with the following JSON parameter block:

    Solve Graph Endpoint Call (Multiple Routing) JSON Payload
     1
     2
     3
     4
     5
     6
     7
     8
     9
    10
    11
    12
    13
    14
    15
    
    {
      "graph_name": "graph_rest.dc_shape_graph",
      "weights_on_edges": [],
      "restrictions": [],
      "solver_type": "multiple_routing",
      "source_nodes": ["POINT(-77.00576019 38.89677811)"],
      "destination_nodes": [
        "POINT(-77.03517151 38.8898201)",
        "POINT(-77.03626251 38.88068008)",
        "POINT(-77.04974365 38.89020157)",
        "POINT(-77.01207733 38.89072037)"
      ],
      "solution_table": "graph_rest.dc_shape_graph_solved_multiple_routing",
      "options": {}
    }

    Note

    Because the tutorial graph was created using WKT linestrings, the /solve/graph call provides the source and destination points as WKT points.

  2. The response should contain the following JSON block:

    Solve Graph Endpoint Response (Multiple Routing)
    1
    2
    3
    4
    5
    6
    7
    
    {
        "info": {
            "status": "OK"
        },
        "result": true,
        "result_per_destination_node": []
    }
    
  3. The solution can be viewed in Workbench by:

    1. In the left pane, click the Data tab.
    2. Click the > next to the graph_rest schema to expand it (if not already expanded) to view its list of tables.
    3. Click the dc_shape_graph_solved_multiple_routing table and then WMS Preview on the context menu
    4. Click Update to view the solution on the map
dc_roads_graph_solved_multiple_routing.png

Download & Run

Included below is the complete tutorial containing all the above requests and the necessary JSON files:

To run the complete sample, ensure the graphs_rest.sh and the JSON files are in the same directory; then switch to that directory and do the following:

Run Example
1
./graphs_rest.sh <kinetica_url> <username> <password>