Every Site Reliability Engineer (SRE) knows that the more DevOps tools you use to ensure adequate monitoring coverage, the more likely you’ll end up overloaded with alerts and data analysis tasks. Paradoxically, this avalanche of alerts and data might actually cause you to miss precisely the issues you are trying to identify. To help in this situation, SignifAI delivers powerful real-time and predictive insights to DevOps teams by correlating their event, log and metrics data using a combination of artificial intelligence, machine learning and the team’s own expertise.

SignifAI offers 60+ integrations right out-of-the-box with technologies like AWS, New Relic, AppDynamics, Nagios and Pager Duty. The available integrations cover the most popular DevOps tools used for infrastructure, application, notification, collaboration and deployment tasks. In this week’s post we’ll take a look at how easy it is integrate New Relic’s application and infrastructure monitoring capabilities with SignifAI’s machine intelligence platform.

What is New Relic? New Relic’s digital intelligence platform lets developers, ops, and tech teams measure and monitor the performance of their applications and infrastructure.

The benefits of New Relic and SignifAI integration

Our mission at SignifAI is to augment a DevOps team’s existing tools with the power of AI and machine learning so they can perform faster and more accurate root cause analysis. We also designed our platform so that it would fit into existing triage workflows vs working in a way that is different to what a team is unaccustomed to.

Integrating New Relic with SignifAI delivers the following benefits above and beyond what New Relic alone offers:

  • Correlation: New Relic is a data silo of application and some infrastructure monitoring data. SignifAI uses AI and machine learning to correlate New Relic’s data with additional sources of monitoring data including logs, metrics and events like Spunk, Elastic, Datadog, etc. In turn, these powerful correlations will give you much richer context around an alert than just the associated New Relic data.
  • Alert Noise: SignifAI doesn’t just correlate the monitoring data from different tools, it correlates the associated alerts as well. So, instead of getting multiple alerts from multiple tools concerning what ultimately is a single issue, SignifAI intelligently groups all the relevant alerts together into an issue card. This makes it easy to see what alerts should be prioritized, which tools are reporting issues and what the underlying data is that can help get you to a remediation faster.
  • Predictive Insights and Anomaly Detection: SignifAI looks at your New Relic data both in real-time and historically to then correlate it with your other log, metric and events data to surface predictive insights and outliers in real-time or in daily, weekly and monthly alerts.
  • Knowledge Capture: SignifAI’s machine intelligence is trained using algorithms based on industry and vendor best practices, SignifAI’s own operational expertise plus most importantly, your expertise. As your team resolves issues, SignifAI uses your documented solutions, hints, annotations, retros and runbooks to deliver a fully customized monitoring solution specifically tailored to your environment.

Getting started: Active Inspector vs Web Collector

There are two different ways in which SignifAI can integrate with New Relic:

Web Collector
SignifAI’s Web Collector sensor integrates over a webhook and passively collects the data and metrics you’ve already configured to capture in New Relic. In order to enable this type of collection you will need to have the right permissions, as well as the ability to choose which type of events, incidents, or data points you wish to send to the SignifAI platform.

Active Inspector™
SignifAI’s Active Inspector™ collects information in a secure way using a platform-specific API. Using this method of collection, you are not required to configure collected metric/event types or limits. Instead, SignifAI will automatically collect the most relevant data points, events, and metrics with the highest value for analysis and actionable information. It then then applies anomaly detection algorithms and predictive analysis to notify you in advance of potential issues. This means SignifAI will detect potential problems from your New Relic data without any pre-configuration of alerts or setting up a webhook. Providing pattern analysis and surfacing unknown patterns from your entire data already exists inside your New Relic platform.

Integrating New Relic with SignifAI’s Active Collector

  • Locate your API key on New Relic’s API Keys page. To find your REST API key: From the New Relic menu bar, select: Account → Account settings → Integrations → API keys. Then select Show key.
  • A table of the Admin users’ API keys appears below the REST API key, with the Admin’s full name and the date their key was last used. You can view your own Admin’s API key by selecting Show key next to your name in the Admin table. The keys for all other Admins are partially obscured.
  • Log in to the main SignifAI console and navigate to the Sensors tab.
  • Select New Relic and choose the Active Inspector tab.
  • Copy and paste your API Key from New Relic console into the Inspector field.
  • Click Activate.

Integrating NewRelic with SignifAI’s Web Collector

Connect SignifAI to New Relic’s Webhook Channels to automatically analyze all New Relic metrics and events (like response time, Apdex score, and alerts) in context with the rest of your infrastructure and other monitoring tools.

It’s possible to set webhooks for all events in your New Relic account, or specify Alert Policies for each of your applications, APIs, or Hosts.

Option 1: If you’re using NewRelic Legacy alerting system

  • Log into the SignifAI console.
  • Navigate to the Sensors page
  • Choose New Relic
  • Click on the Collector URL tab.
  • Copy the Web Collector URL for New Relic.
  • Log in to your New Relic console
  • On the Channels and Groups tab of New Relic’s alerting notification settings page, create a new Channel and paste SignifAI’s collector URL.
  • For ‘Custom Payload’(s), select JSON ‘Payload Type’

All done! Make sure you are not filtering webhooks based on priorities. Make sure to send all webhook events to SignifAI as our platform parses all types of events, alert state changes, and acknowledgements so you can take full advantage of the Active Inspector™ and Web Collection in a much better way.

Option 2: If you’re using NewRelic New Alerts Manager

Step 1: Copy webhook

  • Log into the SignifAI console
  • Navigate to the Sensors page
  • Choose New Relic
  • Click on the Collector URL tab
  • Copy the Web Collector URL for New Relic

Step 2: Create a notification channel

  1. Log in to your New Relic console
  2. Click on new Alerts manager tab
  3. Click on Notification channels tab
  4. Click on add new notification channel button
  5. For channel type, select webhook
  6. Paste SignifAI’s collector URL into the Base URL and create channel

Step 3: Create SignifAI alert policy

In order for SignifAI to unleash its full potential with New Relic, you have to create a new alert policy with following conditions:

Appdex condition

  1. Click on the New Alerts manager tab
  2. Click on on Add New Alert Policy
  3. Edit the alert policy name as you wish and click Create Condition
  4. Leave Condition Categorize as default and click Next
  5. Select all entities and click Next
  6. Define any thresholds based on your needs. For example: “apdex has a score below 0.8” and click Create condition

Error percentage condition

  1. Click Add a Condition
  2. Repeat 4 & 5 above
  3. Define any thresholds based on your needs. For example: “Error Percentage is above 3% for at least 5min” and click Create condition

Response time condition

  1. Click add a condition
  2. Repeat 4 & 5 above
  3. Define any thresholds based on your needs. For example: “When Response time (web) has an average above 0.35 sec for at least 5min” and click Create condition

Step 4: Link your SignifAI alert policy to SignifAI

  1. Inside your SignifAI alert policy, go to Notification channels tab
  2. Click Add Notification Channels
  3. Select Webhook
  4. Select SignifAI and click Update Policy

Next steps