Answer feedback
Rate bot answers, see which documents the bot read, and review ratings in a bot's Feedback tab.
You can rate any bot answer as good or not good, in the Chat Workspace and in the website widget. Bot owners review rated answers in the Feedback tab, along with the documents the bot read for each answer, so they know which document to fix.
Rate an answer
Under every finished answer are three buttons: Copy, Good answer (thumbs up) and Not a good answer (thumbs down).
- Click a button to rate. The selected button is filled and stays visible, even on older answers.
- Click the other button to change your rating; click the selected one again to clear it.
- Each answer has one rating, and you can rate only answers in your own conversations.
When you choose Not a good answer, a short form opens right below:
- Reason: pick Incorrect, Off-topic, Incomplete or Other. Click it again to unselect.
- Add a comment: add details if you like, up to 500 characters.
- Click Send to save the reason and comment. Pegasus shows "Thanks for your feedback."
- Click × to close the form. The not-good rating is still saved, just without a reason.
If saving fails, Pegasus shows "Could not save your rating. Try again." and keeps the previous rating.
Ratings in the widget
Visitors who use the website widget get the same two rating buttons under each answer, and the same reason form for a not-good rating. The form says the rating is shared with the bot's operator.
Visitors do not see the documents-the-bot-read line.
Documents the bot read
If you own the bot (you created it, or you own the team it belongs to), each answer in your conversations has a small line right under the text, above the buttons: Documents the bot read: followed by a list of files.
- Each file appears once, with the sections (headings) the bot read after a ›.
- If the bot read more than three files, the line shows the first three and a +N button to see the rest.
- Files are in the order their excerpts were given to the bot.
This lists the document excerpts the bot was given when it answered. It is not a per-sentence citation: the bot may read an excerpt and not use it. The line does not appear when:
- The answer needed no documents, for example a greeting.
- The answer is from before Pegasus had this feature.
- You are chatting with a bot shared with you, or the person asking is a widget visitor.
A bot's Feedback tab
Bot owners open the bot from Manage Chatbots, then choose the Feedback tab to see rated answers, newest first. Each entry shows:
- The rating (Good or Not good), the reason (if any), the channel (Widget or Dashboard) and the time.
- The Question and the Answer. Long answers are shortened; click Show more to read the whole answer.
- The rater's comment, if any.
- The documents-the-bot-read line for that answer.
Use the two filters above the list to narrow it: Rating (All, Not good, Good) and Channel (All, Widget, Dashboard).
The tab lists rated answers only, not whole conversations. It includes every widget rating and the ratings in your own dashboard conversations. Other team members' dashboard conversations never appear here.
Reading a not-good rating
For each not-good answer, look at the documents-the-bot-read line first:
- No file holds the right answer: the bot could not find the information. Add or fix the document, then retrain.
- The right file and section are listed but the answer is still wrong: check whether the section is clearly written, or try Max Mode so the bot reads more of your documents.
Not available through the API
If you call a bot through the API with a Personal Access Token, answers cannot be rated and do not include the documents the bot read.