What to do when a particular step is failing with low confidence?
There will be few cases where you might face issues with a particular test case step failing with low confidence. To troubleshoot such scenario we advise to use the Prompt Analyzer feature which can be accessed in the test case step result. The screenshot below shows how to access Cyara Prompt Analyzer (PA) on example: Once you click the PA icon, a new Prompt Analyzer page will open. It has few important fields and information regarding the step which failed such as: "Expect to Hear" verbiage, "Major/Minor" confidence threshold, a player that allows to listen for a step recording, and Analyze button, and some other options. The screenshot below demonstrates the Prompt Analyzer window: To troubleshoot the issue you need to listen the step recording which should match with the verbiage specified in the Expect To Hear (ETH) field. If you notice that some words are missing from the ETH, edit the ETH on the same page and click the Analyze button. When ...