TABLE OF CONTENTS
Overview
A subject matter expert (SME) is someone with knowledge of a topic that pertains to their organization. In Stack Internal, SMEs can help review AI-generated answers and other knowledge when a human check is needed.
Stack Internal automatically builds, scores, and populates lists of SMEs by topic, based on user contributions to the knowledge base. Site administrators can then manage each topic's SME list, moving, adding, and removing SMEs as needed.
About trust
Trust is how Stack Internal helps people understand how reliable a piece of knowledge may be. It uses signals from content, contributors, and expert review to generate a trust score. If a trust score is low, Stack Internal users can request an SME review.
Even a high automated trust score does not replace human judgment–user input is still needed in many cases. When SMEs review requests, they use their knowledge of the topic and the context provided. This results in one of the strongest signals Stack Internal can use to improve trust in knowledge.
The SME role in the trust loop
An SME adds a human check when Stack Internal needs more confidence in an answer. SME reviews help confirm the information is accurate, current, and useful before others rely on it.
When Stack Internal uses content that's been verified by an SME, it displays a "Validated by an expert" badge in the chat response.
When users see that badge, they can be more confident that the information returned by Stack Internal is accurate and current.
Users initiate the SME verification process through the web chat interface, MCP, or API. In the chat, users may see a Verify with SME button if the response Stack Internal provided wasn't already verified by an SME. When they click the button, Stack Internal sends a message to the SME. The user then sees confirmation that Stack Internal sent the message.
When a user requests verification of a response, Stack Internal sends a verification request to the first SME on that topic's active SME list. If that SME doesn't respond, Stack Internal will send the request to the next eligible SME. It will continue this process until it gets a response or exhausts the SME list.
You as an SME
Based on how you've contributed to your organization's knowledge base, Stack Internal may designate you as an SME in one or more topics. This is an honorable distinction, a recognition of the value you bring to your organization.
When a user requests SME verification for an eligible Stack Internal response, Stack Internal checks the response topic and finds an eligible SME. It then sends a verification request in Slack. If you're the SME Stack Internal identifies, you'll see a Slack message like this:
Each Slack request includes the question, the AI-suggested answer, and supporting source content. You can hide or reveal the source documents by clicking the Hide button. If Stack Internal's response is correct, click This is correct.
If you can't confirm the answer, or the answer is incorrect, don't click This is correct. Instead, simply ignore the verification request. Stack Internal will then forward the request to another eligible SME.
Verification requests in Slack
Follow these steps when you receive an SME verification request in Slack:
- Carefully read the question and the suggested answer.
- Click on and read the sources.
- Click This is correct if the answer is correct for the topic. If the answer isn't correct, or is outside your scope of knowledge, ignore the verification request.
If you verify the response, Stack Internal records your confirmation and updates the request message. Stack Internal does not update external documents or other source content.
SME best practices
- If you receive a verification request, review the full question–not only the suggested answer. Confirm an answer only when it is accurate, complete enough for the question, and within your topic expertise.
- Use the source details as context. They can help you assess the answer, but remember you're validating only the Stack Internal response. You're not being asked to verify or correct the source content.
- If a request falls outside your expertise, leave it unconfirmed so Stack Internal can route it to another eligible SME. Ask a site administrator to update your assigned topics when your responsibilities change.
Become an SME for a topic, or leave a topic
If you think you're qualified to be an SME, ask a site administrator to add you to the topic's active SME list. Tell them which topic you want to cover and why you are an appropriate reviewer. The administrator decides whether to add you.
If you're an SME for a topic and don't want to be, ask your Stack Internal site administrator to remove you from the topic's SME list.
Get help
If you have questions or issues, reach out to our support team for help.