How to Test and Monitor Alexa Skills in the Bespoken Dashboard

alexa skill monitoring Bespoken Dashboard

Now that you can run automated tests on your Alexa skills using Bespoken. Take a closer look at your Alexa skill data, and check out the different notifications available to help you automatically monitor Alexa skills 24/7/365.

No one is immune to outages or bugs. That’s why in tandem with offering automated testing, we offer monitoring services for your HTTP- or Lambda-based Alexa skills. We will watch out for issues like:

  • Core Alexa or Google outages
  • Lambda, Dynamo, S3 outages
  • Bugs within code

When we detect an issue, you will get an email alert. By enabling Monitoring, you will keep users happy and avoid 1-star reviews. And you can avoid difficult conversations by keeping your stakeholders happy, too.

Automated Alexa Skill Validation

To get started with Bespoken Validation and Monitoring, you need an Alexa skill and a Bespoken Dashboard – create a free account. Once you have saved a test script in the Bespoken Dashboard, take a look at what comes along with your new Alexa skill testing functionalities.

For a detailed post about how to get started with the Bespoken Validation, go to this blog post.

If you’re like me, when you’re testing your skills, after you have come up with a satisfactory test sequence, you will want to continue to test that same sequence continuously. This guarantees an acceptable user experience – avoiding those bad reviews.

Baked into our skill Validation experience is a 24-hour monitoring service, because testing your test script once or twice a day does not create a reliable Alexa skill in an artificial intelligence powered environment like Alexa. When you save your test sequence, click the ENABLE MONITORING icon. Bespoken will automatically take the script and check its status every 30 minutes.

Along with voice-first specific monitoring, we will also send you the proper notifications to help you maintain a high-quality voice experience for your users.

Notifications

If you’re following along, you’re well on your way to becoming fully aware of your voice app’s behavior. The next step is to understand the different types of alerts you will receive so you can take appropriate steps to fix issues.

With monitoring enabled, we will automatically alert you when the skill does not respond correctly to your tests. Additionally, you configure notifications based on response times and the number of errors seen by your app. To set these, go to the settings tab for your skill.

monitor Alexa skills notifications image

Validation Notices

Next, Bespoken will email you when there is a change in validation results. Remember when you saved that test script in the Dashboard? Yeah, that one. In this validation notification, Bespoken has detected an unsuccessful result in line 3 of the test script. And you will see the interaction included in the email. See example below. When the error is fixed, you will get a simple OK notification.

monitor Alexa skills error email example image

Weekly Results Summary

Along with error notifications emails, you will get a weekly Validation summary. This will show you an overview of your skill’s test results for the week – and we will show you a simple comparison of how the results compare to the previous week. Now you will see the date and time tests change from successful to unsuccessful and can take the proper steps to remediate the issues and make that a regular part of the quality assurance process.

monitor Alexa skills weekly validation summary email image

How to Get Bespoken Notifications

Need some help getting started? Please join us for a special webinar. We will be showing you how to set up monitoring and alerting for your voice apps step-by-step.

Automated Monitoring and Alerting for Alexa Skills

Tuesday, May 15

10 am PT | 11 am MT | noon CT | 1 pm ET

Register

The webinar will cover:

  • How Bespoken Monitoring works and why you need it
  • Walkthrough of setting up Bespoken Monitoring for a skill
  • How to access to key data like – uptime and response time
  • Monitoring best practices – like how to pinpoint errors in your voice-app interaction
  • Q&A

Not sure if you can make it? No problem. Register like normal and we will email you the full recording. Save your spot today.

Leave a Reply

Your email address will not be published. Required fields are marked *