Start with the next action.
Before choosing the model, the framework, or the screen, I want to know what someone is trying to do next.
“Answer questions about our documents” is a capability. “Help a new teammate find the right onboarding step” is a direction. That difference changes what needs to be retrieved, what an answer should look like, and whether AI is useful at all.
The first version can be small: one person, one recurring question, one answer they can check. Watch what happens after the answer. That is where the product starts to become clear.
Try this in the workbench