Setup, widget, and operations · August 13, 2026 · 7 min read
15 Checks Before Publishing an AI Support Widget
“15 Checks Before Publishing an AI Support Widget” starts with prelaunch checks for desktop, mobile, answers, and handoff and testing representative, paraphrased, and unanswerable questions, then hands off conversations that lack evidence or require real work. Test widget opening, long-answer scrolling, links, refresh, and handoff on desktop and mobile. A pass on an internal domain does not prove the customer production origin is ready. This guide addresses “15 Checks Before Publishing an AI Support Widget.” The decision becomes easier when the operating boundary is clear. The four lenses are prelaunch checks for desktop, mobile, answers, and handoff, testing representative, paraphrased, and unanswerable questions, handoff that preserves transcript and summary, and business hours, time zone, and notification recipients.
Author · Simon Choi
Start with the operating decision
For the topic “15 Checks Before Publishing an AI Support Widget,” ask a narrower question than “should we adopt AI?” Decide which requests may be answered, which approved source should support each answer, and which conditions require a person. An automation-rate target can leave difficult cases trapped with AI; a scope-and-handoff target makes ownership visible.
Deyo's relevant building blocks are approved knowledge, a website widget, human handoff, and operational review. Write down prelaunch checks for desktop, mobile, answers, and handoff as an observable rule rather than an aspiration. The team can then apply the same rule when reviewing real conversations after launch.
1. Evaluate prelaunch checks for desktop, mobile, answers, and handoff
Applied to day-to-day operations, this criterion means the following: Test widget opening, long-answer scrolling, links, refresh, and handoff on desktop and mobile. A pass on an internal domain does not prove the customer production origin is ready.
To verify prelaunch checks for desktop, mobile, answers, and handoff, save the relevant Widget or Install setting in Deyo Settings and reload the widget on an approved real origin. Record one end-to-end run on desktop and mobile, including open, send, link, and human handoff.
2. Evaluate testing representative, paraphrased, and unanswerable questions
Applied to day-to-day operations, this criterion means the following: A test set of ideal questions misses production failures. Include typos, short prompts, mixed intents, and questions absent from knowledge, with the expected handoff outcome for each.
Add the responsible source or curated Q&A in Deyo Knowledge, then run a normal question, a paraphrase, and an unanswerable question in the Playground. Treat testing representative, paraphrased, and unanswerable questions as passing only when both the answer and displayed evidence meet the expectation.
3. Evaluate handoff that preserves transcript and summary
Applied to day-to-day operations, this criterion means the following: A useful handoff shows the customer's question, answers already given, sources used, and the reason for escalation. A bare ‘connecting you to an agent’ status makes the agent investigate from the beginning.
Deliberately create a test conversation that exercises handoff that preserves transcript and summary. In Deyo Inbox, verify the transcript, handoff reason, and assignee state; reply to the customer from Inbox rather than treating a Slack or email alert as the reply surface.
4. Evaluate business hours, time zone, and notification recipients
Applied to day-to-day operations, this criterion means the following: Alerts should reach the people accountable for response. Trigger a test handoff and verify Slack or email delivery, link access, and the Inbox reply path; remove former staff and personal channels.
Deliberately create a test conversation that exercises business hours, time zone, and notification recipients. In Deyo Inbox, verify the transcript, handoff reason, and assignee state; reply to the customer from Inbox rather than treating a Slack or email alert as the reply surface.
The complete 15-item list
15 Checks Before Publishing an AI Support Widget promises 15 distinct items; all are listed here. The number is not a ranking, and each item still needs validation through the relevant Deyo workflow.
- 1. Open and close the widget
- 2. Mobile viewport and keyboard
- 3. Greeting and AI name
- 4. A normal FAQ answer
- 5. A paraphrased question
- 6. A question with no evidence
- 7. A conflicting-policy question
- 8. Long answers and scrolling
- 9. Opening source links
- 10. An explicit human-support request
- 11. Handoff context and reason
- 12. Slack and email alerts
- 13. An agent reply from Inbox
- 14. Blocking an unapproved origin
- 15. Conversation state after refresh
A concrete Deyo validation example
The validation scenario for “15 Checks Before Publishing an AI Support Widget” uses a visitor opening the widget on the production origin. The operator adds the relevant help article in Knowledge and tests a normal phrasing plus a short paraphrase in the Playground. If the current source appears with the answer, the same question is sent through the website widget.
Next, the wording is changed to require real work and trigger handoff. Record the scenario as passing only when Inbox shows the full transcript, handoff reason, assignee state, and an available customer reply action.
What Deyo can support today
The recommendations for “15 Checks Before Publishing an AI Support Widget” stay within current Deyo product evidence. For this topic, Deyo can test representative questions in the Playground; install a customer-support widget on a website; move the same conversation from AI to a human; send human-handoff alerts by Slack or email. These are tools for operators to prepare knowledge and review conversations, not a promise that every customer issue will be resolved automatically.
A practical sequence is to add knowledge, test it in the Playground, install the widget, and review real conversations. Begin with one request type, verify answer and handoff behavior, and expand only after the operating owner accepts the result.
Launch checklist
Use this checklist to turn the recommendation into a testable operating change. Record the owner and review date so later knowledge changes can be connected to answer quality.
- 1. prelaunch checks for desktop, mobile, answers, and handoff: Test widget opening, long-answer scrolling, links, refresh, and handoff on desktop and mobile. A pass on an internal domain does not prove the customer production origin is ready. Save one passing example and one human-handoff example against this rule.
- 2. testing representative, paraphrased, and unanswerable questions: A test set of ideal questions misses production failures. Include typos, short prompts, mixed intents, and questions absent from knowledge, with the expected handoff outcome for each. Save one passing example and one human-handoff example against this rule.
- 3. handoff that preserves transcript and summary: A useful handoff shows the customer's question, answers already given, sources used, and the reason for escalation. A bare ‘connecting you to an agent’ status makes the agent investigate from the beginning. Save one passing example and one human-handoff example against this rule.
- 4. business hours, time zone, and notification recipients: Alerts should reach the people accountable for response. Trigger a test handoff and verify Slack or email delivery, link access, and the Inbox reply path; remove former staff and personal channels. Save one passing example and one human-handoff example against this rule.
Blog
Keep reading
Setup, widget, and operations
How to Design Business Hours and Handoff Notifications
A Deyo-grounded guide to “How to Design Business Hours and Handoff Notifications,” covering business hours, time zone, and notification recipients and combining always-on AI with business-hours staff.
Read articleSetup, widget, and operations
How to Configure Korean, English, and Japanese AI Support
A Deyo-grounded guide to “How to Configure Korean, English, and Japanese AI Support,” covering consistency between interface language and the customer's language and choosing among website, file, and Q&A sources.
Read articleSetup, widget, and operations
How to Add an AI Customer Support Chatbot to Your Website
A Deyo-grounded guide to “How to Add an AI Customer Support Chatbot to Your Website,” covering the website embed script and installation verification and allowed domains and public-widget security.
Read article