love2dishtech / botium-core

The Selenium for Chatbots - Bots Testing Bots

Botium - The Selenium for Chatbots

IF YOU LIKE WHAT YOU SEE, PLEASE CONSIDER GIVING US A STAR ON GITHUB!

UPDATE 2020/06/15: As Chatbots grow in importance, automated testing solutions will remain critical for ensuring that Chatbots actually do what their designers intend. We've been busy working on a product that allows testers to have visual insights and deeper understanding in their Chatbot's performance, offering several solutions to boost their interaction! Botium Coach will be introduced to the market as part of our online event on the 24th of June.

Quickstart

Read the Getting Started guide or the Botium in a Nutshell blog series to get started with Botium!

What is Botium

Selenium is the de-facto-standard for testing web applications. Appium is the de-facto-standard for testing smartphone applications. Botium is for testing conversational AI. Just as Selenium and Appium, Botium is free and Open Source, and available on Github.

As awesome as Botium Core is, you most likely don't want to use Botium Core directly, but one of the user interfaces of the Botium Stack Members - see Botium Wiki or our Getting Started guide

What is Botium good for ?

Botium supports chatbot makers in training and quality assurance:

• Chatbot makers define what the chatbot is supposed to do
• Botium ensures that the chatbot does what it is supposed to do

Here is the “Hello, World!” of Botium:

#me
hello bot!
#bot
Hello, meat bag! How can I help you ?

The chatbot is supposed to respond to a user greeting.

Understanding the Botium Stack

When we talk about Botium, we usually mean the whole Botium Stack of components. It is built on several components:

• Botium Core SDK to automate conversations with a chatbot or virtual assistant
• Botium CLI, the swiss army knife to use all functionality of Botium Core in the command line - Continue
• Botium Bindings, the glue to use Botium Core with test runners like Mocha, Jasmine or Jest - Continue
• Botium Box, the management and reporting platform for making chatbot test automation fast and easy - Get Community Edition here
• Botium Coach for continuous visualization of NLP performance metrics - See Botium Coach Wiki

To name just a few features of Botium:

• Testing conversation flow of a chatbot
  • Capture and Replay
  • Integrated speech processing for testing voice apps
• Testing NLP model of a chatbot
  • Domain specific and generic datasets included
  • Paraphrasing to enhance test coverage
• E2E testing of a chatbot based on Selenium and Appium
• Non-functional testing of a chatbot
  • Load- and Stress testing
  • Security testing
  • GDPR testing
• CI/CD integration with all common products in that space (Jenkins, Bamboo, Azure DevOps Pipelines, IBM Toolchain, ...)
• and many more

How do I get help ?

• Read the Botium in a Nutshell series
• If you think you found a bug in Botium, please use the Github issue tracker.
• The documentation can be found in the Botium Wiki.
• For asking questions please use Stackoverflow - we are monitoring and answering questions there.
• Enter our Discord channel

Connectors

Botium Core provides the core functionality. For attaching Botium to your chatbot, there are lots of connectors available for most important chatbot technologies, frameworks, APIs, SDKs, cloud services etc. Sample configurations and scripts are included with each connector.

All connectors are hosted on Github

See here for the latest connector updates.

Contributions

Contributions are welcome! Please read our Contribution Guide!