Argo Rollouts analysis with ISD and NewRelic
Last updated
Last updated
This document explains the end-to-end flow for the analysis run with the NewRelic data source.
Follow the steps below for the end-to-end workflow for analysis run and to get an analysis report.
Note: You must add all the integrations through ISD UI only.
To add a NewRelic integration as your data source to allow ISD to perform your metric analysis, follow the steps given below:
From the ISD dashboard, click "Setup" and click "Integrations" and then Click "+New Integration" button as shown in the image below:
The list of available integrators and their respective fields appears. Select the NewRelic integration and fill out the information about it that appears on the right pane of the screen.
Update the following information on the above screen:
Account Name: User-defined account name for your NewRelic access.
Account id: Provide “account id” to identify the account.
API Key: NewRelic API Key.
Permissions: To restrict permissions to this account, you can select the User Groups.
Once you have updated all the information, click the "Save" button. The newly created NewRelic integrator appears as shown below:
Create a metric template after adding the NewRelic integrator.
We support the following two modes of template creation
Gitops mode template creation
Template creation in ISD UI
You can create a metric template in a GitHub repository where your deployment manifest files are saved. The sample Metric Template for NewRelic data source is available here.
OpsMx provides the two types of sample Metric Templates for NewRelic s follows:
Minimal yaml file (newrelic-app-health-generic-minimal.yaml)
Extended yaml file (newrelic-app-health-generic-extended.yaml)
Minimal yaml file:
The following sample NewRelic minimal yaml file contains the mandatory parameters to create a metric template. You can use this sample yaml file instead of creating a new template.
Parameters details are as follows:
name: Give a name to the Metric Template. (This Metric Template name, must be used in OpsMx Provider configmap file)
accountName: Metric provider account name (Must be provided the same account name, which you have given while adding the NewRelic integrator in ISD UI)
metricType: Type of the metric.
advancedProvider: Provide the name of “NEWRELIC”.
groups: Groups are the set of metrics to be configured for analysis. Each group can carry multiple metrics and has a group name associated with it, to be specific in the group field.
riskDirection: Direction in which the metric difference is allowed to expand. You can choose the value as Higher, Lower, ‘Higher or Lower’.
group: group name
Extended yaml file:
The following sample NewRelic extended yaml file contains all the available parameters even non-mandatory to create a metric template. You can use this sample yaml file instead of creating a new template.
Parameters details are as follows:
name: Give a name to the Metric Template (This Metric Template name, must be used in OpsMx Provider configmap file )
accountName: Metric provider account name (Must be provided the same account name, which you have given while adding the NewRelic integrator in ISD UI)
metricType: Type of the metric.
advancedProvider: Provide the name of “NEWRELIC”.
metricWeight: Numerical importance given to a metric. It can range from 0 as lowest and 1 as highest.
criticality:
Normal: To remove the metric from the metric group for score calculation if it has no data.
Critical: To fail the entire analysis if this metric fails or has no data.
MustHave: To fail a metric if data is missing.
nanStrategy: Handles NaN values which can occur if there is no data in a particular interval for metric data
Note:
If you specify metricWeight, criticality and nanStrategy at global level, it is applicable to all the metric groups.
If you specify metricWeight, criticality and nanStrategy at local level, it is applicable to only that particular metric group and it will override the same parameters at the global level if already specified.
groups: Groups are the set of metrics to be configured for analysis. Each group can carry multiple metrics and has a group name associated with it, to be specific in the group field.
riskDirection: Direction in which the metric difference is allowed to expand. You can choose the value as Higher, Lower, ‘Higher or Lower’.
criticality:
Normal: To remove the metric from the metric group for score calculation if it has no data.
Critical: To fail the entire analysis if this metric fails or has no data.
MustHave: To fail a metric if data is missing.
groups: Groups are the set of metrics to be configured for analysis. Each group can carry multiple metrics and has a group name associated with it, to be specific in the group field.
customThresholdHigherPercentage: Percentage difference beyond which the metric is treated as fail
customThresholdLowerPercentage: Percentage difference beyond which the metric is treated as fail
nanStrategy: Handles NaN values which can occur if there is no data in a particular interval for metric data
watchlist: Metrics marked in watchlist will be shown first in the metric analysis report.
metricWeight: Numerical importance given to a metric. It can range from 0 as lowest and 1 as highest.
group: group name
You can create a Metric Template on the Setup → Analysis Templates page in ISD UI. To create a metric template in ISD UI, follow the steps below:
From the application dashboard, click "Setup" and click “Analysis Templates” and then click "+New Template" button. Refer to the image below.
After clicking the “+New Template” button, two options appear for you to choose the type of template you want to create. Select the “Metric Template” from the available options as shown in the image below.
The new Metric Template window appears. Update the necessary parameters and click “Save” button. Refer to the image below.
Update the following parameters in the above screen:
Metric Template Name: Give a name to the Metric Template. (This Metric Template name, must be used in OpsMx Provider configmap file)
Select Datasource: Select “NEWRELIC” as data source from the drop-down.
Select Accounts: Select the account of interest in the configured data source from the drop-down. Metric provider account name (Must be provided the same account name, which you have given while adding the NewRelic integrator in ISD UI).
Metric Scope Placeholder: Metric Scope Placeholder will be replaced by Baseline and New Release values in the Metric Query.
Query Name: A meaningful name given to a query or a group of similar queries.
Query: Query to fetch the metric from the data source provider.
Risk Direction: Direction in which the metric difference is allowed to expand. You can choose the value as Higher, Lower, ‘Higher or Lower’.
Threshold percentage: Percentage difference beyond which the metric is treated as fail.
Criticality:
Normal: To remove the metric from the metric group for score calculation if it has no data.
Critical: To fail the entire analysis if this metric fails or has no data.
MustHave: To fail a metric if data is missing.
Watchlist: Metrics marked in watchlist will be shown first in the metric analysis report.
NaN Strategy: Handles NaN values which can occur if there is no data in a particular interval for metric data.
Weight: Numerical importance given to a metric. It can range from 0 as lowest and 1 as highest.
After creating Metric Template, it appears in the list for an application on the “Analysis Templates” page as shown below:
To create an application, refer here. This application must be specified in the “OpsMx Provider Configmap”.
Create “OpsMx Provider Configmap” with opsmx metric provider information, including “metric template name” and “application name”. Sample “OpsMx Provider Configmap” yaml file is available here. To create “OpsMx Provider Configmap” refer here.
Note: The user is given the flexibility to create metric and log templates in ISD and also, to maintain them as config maps via GitOps.
In the “OpsMx Provider Configmap”, If gitops is set to “true”, the metric provider prioritizes the presence of metric template as config map, and if not found, tries to load it from ISD.
In the “OpsMx Provider Configmap”, If gitops is set to “false”, the provider only loads the metric template from ISD.
Note: If you want to load the metric template from ISD, do not specify the following parameters in the “Analysis template”.
Note: Must be provided the same Metric Template name in OpsMx Provider Configmap, which you specified in the Minimal yaml file\ Extended yaml file\ ISD UI.
Specify the “OpsMx Provider Configmap” under the job section in the Analysis template. Sample "Analysis Template" is available here. To create an Analysis Template, refer here.