Prerequisites
- A Grafana stack with IRM or OnCall, and permission to create a service account and an outgoing webhook in it.
- The URL of your Grafana stack.
Step 1: Setup Grafana IRM integration
-
Sign in to your Grafana instance and navigate to Grafana OnCall settings -> tab Organization. Copy the IRM API URL and keep it in a note.
-
Navigate to Service Accounts and create one with the following permissions
IRM:OnCaller
-
Create a token for service account
-
Set a name and an expiration date, generate the token and keep it in a note
Step 2: Add Grafana IRM connection to NOFire AI
-
Go to Connections and click Connect on Grafana IRM.
-
Enter credentials: Provide the following credentials
- Name (for example, production-oncall)
- Grafana IRM on-call URL
- Sevice Account Token
- Grafana URL of your stack
-
Copy the NOFire AI Webhook URL and Token
-
Navigate to the Grafana OnCall Integrations and select create an Outgoing Webhook
-
Enter the credentials in the form
- Assign the team
- Select
Alert Group Createdas Trigger Type - Select the Grafana IRM Integration you want this webhook to be applied. You can leave this empty and will apply in all your integrations
- Paste the generated NOFire AI webhook URL from step 4
- Paste the generated NOFire AI webhook Token from step 4
- Create the webhook
Test the connection
- Open the Connections dashboard and make sure that the Grafana IRM connection status is READY.
- Trigger a test alert in Grafana IRM, or wait for the next real alert group.
- NOFire AI starts a root cause analysis for that alert. If nothing starts, the webhook did not reach NOFire AI.
Troubleshooting
Alerts fire in Grafana but NOFire AI starts nothing
Alerts fire in Grafana but NOFire AI starts nothing
The outgoing webhook trigger type must be
Alert Group Created. Make sure that the URL and the token match the ones on the NOFire AI connection.The connection fails to authenticate
The connection fails to authenticate
The service account is missing the
IRM:OnCaller permission, or the token expired.