Analyzing the Bot

Listening to action event

to track chat events simply use

const { Router } = require('botnaut');
const botRoot = new Router();

botRoot.on('action', (senderId, action, text, req) => {

    if (action) {
        // send info that `action` was passed
    }

    if (req.isText()) {
        // was pure test
    }

    // or use whole request event
    myMagicTracker(req.data);
});

Logging AI success rate

aiHandled property is set to true, when intent was matched (using ai.match() method or ai.navigate()). Otherwise it is set to false.

You can set req.aiHandled to true with method req.markAsHandled()

const { Router, ai } = require('botnaut');
const botRoot = new Router();

botRoot.use(ai.match('intent'), ...);

botRoot.on('action', (senderId, action, text, req) => {

    // logging winning intent
    if (req.aiIntent) {
        const { aiIntent, aiIntentScore, aiHandled } = req;

        // intent = intent name
        // aiIntentScore = score 0.0 - 1.0
        // aiHandled = whether the intent was handled or not
    }

    // logging all intent scores
    if (req.confidences) {
        Object.keys(req.confidences)
            .forEach((intent) => {
                const score = req.confidences[intent];
            });
    }
});

When you need to collect AI feedback from navigator/makeSure matchers use ai.onConfirmMiddleware(<handler>) middleware.