Links

Verification

Introduction

ISD uses machine learning algorithms, Natural Language Processing (NLP), and statistical analysis to evaluate new releases and identify potential risks in comparison to the base releases. It integrates with the widely used log and metrics monitoring tools to perform analysis during the rollout process.
ISD integrates with a few monitoring tools. To see the monitoring tools that ISD supports, refer here.

Prerequisites

  • ISD platform installed. If ISD needs to be installed, follow the instructions here.
  • ISD Spinnaker
  • Configure CD Integration
  • A log or metrics monitoring tool for observing applications
  • Application configured for collecting metrics and logs through the supported monitoring tools

Workflow

  • Create Application: You need to create a new application and then you can add components to the application like pipelines and then deploy it. To create a new application, refer here.
  • Create Pipeline: A pipeline is a series of sequential steps that are performed as part of an ISD application. ISD has a host of pre-built stages which you can use to perform fairly complex tasks. To create a pipeline, refer here.
  • Add Verification Stage: After creating your pipeline, you are able to add the Verification Stage to your pipeline. To add Verification Stage follow the steps below:
    1. 1.
      Select your pipeline, where you need to add the Verification Stage. Click "Add Stage" and then select the type "Verification" from the new stage type drop-down menu as shown in the image below.
    2. 2.
      Next, you get the option to configure the verification gate as shown in the image below:
    3. 3.
      Update the Verification configuration attributes as described below on the above screen.
      • Verification configuration
        • Environment: Select your environment from the drop-down menu
      • Template Configuration
        • Log Template: A collection of all the information needed to run the log analysis. Select or Create a Log Template. To create a log template, refer here.
        • Metric Template: A collection of all the information needed to run the Metric analysis. Select or Create a Metric Template. To create a metric template, refer here.
        • LifeTime: Minutes to let the analysis run before making a final determination.
        • Marginal Score: If the score is equal to or higher than the Marginal but lower than the Pass Score, “Review” status is shown in the Analysis screen
        • Pass Score: If the Score is equal to or higher than Pass Score, the stage will Pass
        • Baseline Real Time: Start time of stage execution will be taken as Baseline Start time
        • Baseline Start Time: Baseline Start Time for the analysis
        • Canary Real Time: Start time of stage execution will be taken as Canary Start time
        • Canary Start Time: Canary Start Time for the analysis
    4. 4.
      Click "Save changes".
  • Run Pipeline: After updating the verification configuration details, click “Run Pipeline” button. It immediately triggers the execution of the pipeline and generates the reports.
  • View Report: After the successful execution of verification, you are able to view the report by clicking the “View Report” button.
  • Verification Report: After clicking the view report, verification details display here as shown in the image below. To know more about the Verification Report, refer here.