Bespoken LLM Benchmark: Does ChatGPT know more than Google and Amazon?
Learn more
June 10, 2021 in Blog

Truly Automated Testing via Test Case Generation

At Bespoken, we have tried to make it as easy as possible to create automated test cases via our easy-to-use Dashboard and test scripting syntax. But we know that Conversational AI application builders are busy, and automated testing can often seem like a burden rather than a boon, especially in terms of getting started.

To assist with this, we have added new ways to create test cases automatically. They include:

  • Using our new Bespoken Phone to directly call a phone number and generate tests from recording
  • Generating tests from the Dialogflow CX flow builder
  • Generating tests from the Genesys Flow API
  • Generating tests from call recordings

We have other integrations in the works as well. Overall, our goal is to make it as easy (and automatic!) as possible for people to get started with test automation.

Generating Tests Directly Via Phone Call

Using the Bespoken Phone, automatic test generation is as easy as making a phone call. Here is a video of the Bespoken Phone in action:

It really is just as easy as dialing a number and talking. This is a fantastic way to get started fast with automated testing.

The test case it creates looks like this:

---
- test : audio to test
- $DIAL :
  - prompt :
    - "Welcome to the best spoken airlines"
  - set finishOnPhrase :
    - "you're calling about"
- Bookings :
  - prompt :
    - "Okay"
    - "New flight reservations"
  - set finishOnPhrase :
    - "you traveling from"

Just like that, you can get started with creating automated tests.

Generating Tests Via the Dialogflow CX and Genesys APIs

Here is an example Dialogflow CX flow:

The detailed Bookings Flow looks like this:

We can leverage the Dialogflow CX APIs to automatically read this flow and generate test cases  using our simple command-line utility. To run it, we just enter:

node ./src/index.js projectId PROJECT_ID agentId AGENT_ID

This generates a series of test cases for each of the flows:

And here is a look at one of the generated test cases:

We leverage the same approach to generate test cases from Genesys PureCloud.

Generating Test Directly from Call Recordings

We can also generate tests directly from call recordings. Take a listen to this call:

And here is a test we generate from it:

---
- test : audio to test
- $DIAL :
  - prompt :
    - "Welcome to the best spoken airlines"
  - set finishOnPhrase :
    - "you're calling about"
- Bookings :
  - prompt :
    - "Okay"
    - "New flight reservations"
  - set finishOnPhrase :
    - "you traveling from"

Easy, right?

Summary

Automated testing makes building for voice and chat even faster and easier. And now with these test generation tools, the automation itself is even easier. To get started setting up your own awesome testing regimen, just reach out to contact@bespoken.io.

Leave a Reply

Your email address will not be published. Required fields are marked *