Reviews and feedback

Feedback from the people who use a Coworker is the raw material for its reviews. A Supervisor reads that feedback, looks at the conversations behind it, adjusts the Coworker, and records the outcome.

Giving feedback#

Under each reply from a Coworker in chat are a thumbs-up and a thumbs-down.

• Select the thumbs-up when the reply was good.
• Select the thumbs-down when it was not. You can then pick a flag, from no flag, hallucination, stale data, misread and gap, and describe the problem in the "What went wrong?" box. Select Send.

Anyone who can chat with a Coworker can give feedback on its replies. Your Coworker's Supervisor and admins can read conversations that have been flagged, as part of reviewing the Coworker.

Finding reviews that are due#

Open Governance and choose Reviews.

• Upcoming lists reviews due in the next two weeks, or already overdue, for the Coworkers you can see. A monthly review falls due 30 days after the last one, and a quarterly review 90 days after the last one. For a Coworker that has had no review, the clock starts from when it was hired. If nothing is due, the page says "Nothing due in the next two weeks."
• Recent reviews lists the ten latest recorded reviews with their date, outcome, who recorded them and the summary. Selecting a Coworker's name opens its review page.
• Choose a Coworker to review… with Start review opens a review for any Coworker you pick.

A Coworker's details page also has a Reviews list with its full history, and a Start a review button for its Supervisor and admins.

The review page#

The review page is titled with the Coworker's name and the path Governance / Guided review. Choose Monthly review or Quarterly deep review at the top.

Only the Coworker's Supervisor and admins can read its feedback, edit instructions, test changes and record a review. If you are someone else, the page tells you which actions require being the Supervisor or an admin.

Feedback#

The Feedback section counts thumbs up and thumbs down since the last review of this type, or "on record" if there has not been one. Below the counts are up to ten of the most recent thumbs-down or flagged items, each with its date, flag and comment. Select an item to open its conversation, marked (view transcript); an item with no conversation shows (no linked conversation). The review opens on the first flagged conversation for you.

The transcript#

The transcript shows the whole conversation with the flagged message highlighted. Messages after it are dimmed and marked "not included in the replay below".

Testing a change#

You can check whether a change to the Coworker's instructions would have helped.

1. In the Instructions panel on the right, edit the text. You can test your draft before saving it.
2. Under "Test the instructions below against this transcript", select Test with current instructions.
3. Read the Alternate response. The conversation is replayed up to the flagged point with your draft instructions.

The test produces a fresh reply for you to read. Nothing is saved to the conversation and nobody else sees it.

Select Save instructions to keep your change. The Knowledge Bases panel lets you Attach a Knowledge Base or Remove one without leaving the review.

Finish review#

When you are done:

1. Choose an outcome from the list: Healthy, Watch, Sunset or Due.
2. Write a Summary.
3. Select Save review.

You return to Governance, where the review appears under Recent reviews. Recording a review does not change the Coworker's phase; to retire it, see Advancing a Coworker and retiring it.