Runscope Integration



Configure xMatters

Configure Runscope

Test the integration


Download resources

The information in this article is the intellectual property of xMatters and is intended only for use with xMatters products by xMatters customers and their employees. Further, this intellectual property is proprietary and must not be reused or resold.


This article provides installation, configuration, and implementation details when integrating xMatters On-Demand with Runscope.

How it works

Runscope provides cloud-based and hybrid on-premises solutions that allow businesses to monitor, test, and debug web service APIs. Runscope API tests can be used to test against services available in the public cloud, running on a private network behind a firewall, or running on a local development environment.

Coupled with the power of xMatters alerts, the integration:

  • Quickly identifies and notifies the on-call resource on a variety of devices.
  • Allows for voice, SMS, and push messages to users.
  • Allows users to reply with "Rerun" from their device to run the test again.

Event injection is initiated when a Runscope test has run and failed, or if there was a Live Traffic Alert match. Runscope builds a payload and sends it to the xMatters inbound integration URL configured in the webhook. 

The integration includes the following inbound integrations: 

  • Test Results handles notifications about test results by notifying a recipient (an individual or a group) defined in the communication plan's form.
    Recipients can respond with "Acknowledge", which causes xMatters to stop notifying other users but keeps the event alive, or "Rerun", which causes the integration to trigger another test run in Runscope and ends the event in xMatters.
  • Live Traffic Alerts creates an FYI event to notify a recipient or recipients configured in the corresponding plan's form when Runscope detects a Live Traffic Alert rules match. The notification includes a link the recipient can click to view the details and Acknowledge the match. 

If a Runscope test fails while there is a related active event in xMatters, a new event is not created. If a Runscope test has run and passed, the integration terminates all active events related to the test. 

NOTE: By default, only the response callback type is enabled for Test Results form. 

Download the integration package

To begin, download the communication plan attached to this article; it contains everything you need for this integration. 

Configure xMatters

The first step in setting up your integration is to configure xMatters.

Set up an integration user

This integration requires a user who can authenticate REST web service calls when working with events – these permissions are provided by the "REST Web Service User" role in xMatters.

For Free and Trial customers, your system has an "Integration User" already configured with the REST Web Service User role, so you don't need to burn up an extra user from your limited supply. Make sure you've changed this user's password from the default, then you're good to go.

For everyone else, we recommend you create a user specifically for this integration because this user appears as the initiator or submitter of events from the integration (in messages, the Communication Center, event reports, etc.). Give this user the "REST Web Service User" role and a profile that lets you easily identify the user as specific to the integration – for example:

  • User ID: runscope
  • First name: Runscope
  • Last name: Integration

Note: Make sure you keep the user ID and password of this user handy. You'll need them when configuring other parts of this integration.

Create users and groups that will receive notifications

The integration notifies the groups or users defined as recipients in the communication plan's Live Traffic Alerts form. If the recipients are not defined, the xMatters event will not be created. 

Import the communication plan

The next step is to import the communication plan.

To import the communication plan:

  1. In the target xMatters system, on the Developer tab, click Import Plan.
  2. Click Choose File, and then locate the downloaded communication plan (.zip file).
  3. Click Import Plan.
  4. Click the Edit drop-down list for the plan, and select Access Permissions.
  5. Add the integration user, and then click Save Changes.
  6. In the Edit drop-down list, select Forms.
  7. For the Live Traffic Alerts form, in the Web Service Only drop-down list, click Sender Permissions.
  8. Enter the integration user, and then click Save Changes.
  9. Click Edit beside the form and select Layout.
  10. In the Recipients area, specify a recipient (a user or a group) for events, and then click Save Changes.
  11. Repeat steps 7-10 for the Test Results form.

Configure Runscope endpoint

After you have imported the communication plan, you need to set the authentication for the Runscope endpoint.

  1. On the communication plan, click the Integration Builder tab, and then click the Endpoints button to display the endpoints for the integration.
  2. Update the "Runscope" endpoint to use Basic authentication, select the Pre-emptive check box, and then enter valid credentials for Runscope.

Configure inbound integrations

You need to retrieve the URLs of the inbound integrations to configure Runscope.

To configure an inbound integration and retrieve its URL:

  1. In the Integration Builder, expand the list of inbound integrations.
  2. Click the name of the integration to view its details.
  3. Scroll down to How to trigger the integration at the bottom of the page, and select the integration user as the authenticating user (make sure the authentication method is set to URL authentication). The URL trigger is updated to reflect the new user.
    • To be able to select the integration user, you need to be a supervisor of that user and the user needs to be assigned to the REST Web Services role.
  4. Click Copy beside the Trigger field:



Configure Runscope

Now that you've configured xMatters, you can configure Runscope to integrate with xMatters. The following sections require you to log into Runscope and access the Tests and Alerts settings pages.

Add WebHooks

Runscope uses webhooks to initiate the web service calls when Runscope tests run or when Live Traffic rules are triggered. The latter are logical conditions that will vary from help desk to help desk.

Test Results 

Purpose: Injects an event into xMatters when a test fails.

  1. To configure a Test Results webhook, click the Tests tab, hover the mouse over the test and then click Edit:
  2. In the Test Editor, expand Test Settings, then click Notifications.
  3. Paste the URL from the "Test Results" inbound integration into the Callback URLs window, and then click Save:

Note the "Test Results" inbound integration URL.

Live Traffic Alerts 

Purpose: Injects an event into xMatters when Live Traffic Alert rules have a match.

  1. To configure a Live Traffic Alerts webhook, click the Alerts tab, hover the mouse over the alert, and then click the Edit Alert icon (the pencil):

  2. In Edit Traffic Alert dialog, click Webhooks.
  3. Paste the URL for the "Live Traffic Alerts" inbound integration into the Callback URLs window, and then click Save:

Note the "Live Traffic Alerts" inbound integration URL.

Test the integration

To test the integration, run a test with a configured webhook and/or a test that will trigger the rules defined in the Live Traffic Alerts.


There are several places you can inspect when troubleshooting why an event doesn't seem to make it over to xMatters. 

Inbound to xMatters

The first place to look is the Integration Builder Activity Stream. While on the Integration Builder tab, expand the Inbound Integrations section, click the gear icon beside the intended integration service, and then click Activity Stream.

The Activity Stream contains the incoming (and for outbound integrations, the outgoing) request, any logging statements as well as the final event creation messages.  

Outbound from xMatters

For the two-way integration from xMatters to Runscope, the primary source of logging is the Integration Builder Activity Stream for that particular integration.

For example, if you are troubleshooting why a test was not run again after a user replied with "Rerun", check the Activity Steam for the Response Callback outbound integration.  

Download resources


Have more questions? Submit a request


Please sign in to leave a comment.
Powered by Zendesk