Skip to content
Andrew Deighan

work / ai-help

04AI Help and host assistant

AtlasOra

A guest help assistant that answers only from a 497-entry knowledge base, and a host assistant that can change only a fixed set of fields.

1The problem

The guest help assistant was found inventing facts, such as dates.

2What I built

A guest help assistant grounded in a 497-entry knowledge base. For each question it retrieves the closest entries and answers from them.

A separate host assistant drafts profile and listing text and can change only a fixed set of fields.

Guest question to grounded answer
Guest question to grounded answer1. Guest asks a question (Person) 2. Retrieve closest entries (Data): From a 497-entry knowledge base 3. Answer from those sources only (Model): No numbers, policies, dates or features that are not in its sources 4. If it fails: Not resolved: Pointed to support 5. Support team (Person)Guest asks a questionpersonRetrieve closest entriesFrom a 497-entry knowledge basedataAnswer from those sources onlyNo numbers, policies, dates or featuresthat are not in its sourcesmodelNot resolvedPointed to supportfallbackSupport teamperson
stepa personfailure pathright-hand tag: model or rule used

3How the AI is controlled

It may
  • Answer guest questions from the closest knowledge base entries. a1
  • Draft host profile and listing text. a4
It may not
  • State numbers, policies, dates or features that are not in its sources. a2
  • Change anything outside a fixed set of fields (host assistant). a4
Who approves
  • Unresolved issues go to support. a2
When it fails
  • The safeguards are instructions and grounding. There is no automated checker on its answers. a5

4The result

Run log5 rows · source: fact file
MeasureValueFact
Knowledge base entries497a1
Unsourced numbers, policies, dates, featuresbarreda2
Unresolved questionsto supporta2
Host assistant editable fieldsfixed seta4
Automated checker on answersnonea5

This was built after the assistant was found inventing facts such as dates.

There is no automated checker on its answers. The safeguards are instructions and grounding.