Now that you can run automated tests on your Alexa skills using Bespoken. Take a closer look at your Alexa skill data, and check out the different notifications available to help you automatically monitor Alexa skills 24/7/365.
No one is immune to outages or bugs. That’s why in tandem with offering automated testing, we offer monitoring services for your HTTP- or Lambda-based Alexa skills. We will watch out for issues like:
- Core Alexa or Google outages
- Lambda, Dynamo, S3 outages
- Bugs within code
When we detect an issue, you will get an email alert. By enabling Monitoring, you will keep users happy and avoid 1-star reviews. And you can avoid difficult conversations by keeping your stakeholders happy, too.
Automated Alexa Skill Validation
To get started with Bespoken Validation and Monitoring, you need an Alexa skill and a Bespoken Dashboard – create an account. Once you have saved a test script in the Bespoken Dashboard, take a look at what comes along with your new Alexa skill testing functionalities.
For a detailed post about how to get started with the Bespoken Validation, go to this blog post.
If you’re like me, when you’re testing your skills, after you have come up with a satisfactory test sequence, you will want to continue to test that same sequence continuously. This guarantees an acceptable user experience – avoiding those bad reviews.
Baked into our skill Validation experience is a 24-hour monitoring service, because testing your test script once or twice a day does not create a reliable Alexa skill in an artificial intelligence powered environment like Alexa. When you save your test sequence, click the ENABLE MONITORING icon. Bespoken will automatically take the script and check its status every 30 minutes.
Along with voice-first specific monitoring, we will also send you the proper notifications to help you maintain a high-quality voice experience for your users.
If you’re following along, you’re well on your way to becoming fully aware of your voice app’s behavior. The next step is to understand the different types of alerts you will receive so you can take appropriate steps to fix issues.
With monitoring enabled, we will automatically alert you when the skill does not respond correctly to your tests. Additionally, you configure notifications based on response times and the number of errors seen by your app. To set these, go to the settings tab for your skill.
Next, Bespoken will email you when there is a change in validation results. Remember when you saved that test script in the Dashboard? Yeah, that one. In this validation notification, Bespoken has detected an unsuccessful result in line 3 of the test script. And you will see the interaction included in the email. See example below. When the error is fixed, you will get a simple OK notification.
Weekly Results Summary
Along with error notifications emails, you will get a weekly Validation summary. This will show you an overview of your skill’s test results for the week – and we will show you a simple comparison of how the results compare to the previous week. Now you will see the date and time tests change from successful to unsuccessful and can take the proper steps to remediate the issues and make that a regular part of the quality assurance process.
Need some help getting started? Join us at our upcoming webinars here!