Version:

AuditsΒΆ

Audits provide a means for reviewing inferences usage and accuracy.

To initiate an audit search:

  1. Provide a Name for the audit.
  2. Optionally, provide a Description.
  3. Provide a comma- or whitespace-separated list of keywords for which to search through deployed models. Keywords can be grouped together using quotes.
  4. Optionally, select a Start date and End date to bound the search.
  5. Click Search.
../_images/aaw_ui_audit.png

Should the audit find anything, the Audit Results screen will become available.

  • Click + Create New Audit to start the audit search process over.

  • Type into Filter to filter down the results

  • Click show to display any archived deployed models.

  • Click export to export the table's values as JSON or CSV

  • Click the Start Date or End Date field to adjust the date boundaries. Click + Add under Columns and provide a Filter value to add column filters. Click Apply to display the changes to the results.

    Note

    Only columns from the datasets in the deployments returned from the initial audit will be available for selection.

  • Click a deployment in the results to open the Audit Inferences page.

../_images/aaw_ui_audit_results.png

On the Audit Inferences page, additional filters can be applied.

../_images/aaw_ui_audit_inf.png

Click an inference to open the audit graph, which displays information about the model/deployment, the inference output, and the inference input. Click Back to return the Audit Inferences page.

../_images/aaw_ui_audit_graph.png