Skip to content

Instantly share code, notes, and snippets.

@vcidst
Created July 9, 2024 13:02
Show Gist options
  • Save vcidst/5835bbbfe6c2d9028b8f1b46b4f7561e to your computer and use it in GitHub Desktop.
Save vcidst/5835bbbfe6c2d9028b8f1b46b4f7561e to your computer and use it in GitHub Desktop.
Enterprise Search Debugging for Rasa Pro 3.8+
graph TD
A[Start] --> B[Are debug logs enabled?]
B -- No --> C[Enable debug logs and restart]
B -- Yes --> D["If the assistant uses LLM Router,
was the appropriate command predicted?"]
D -- No --> E[Look into LLM Router configuration]
D -- Yes --> F["Did command generator
trigger SearchAndReply command?"]
F -- No --> G["Look into modifying
Command Generator prompt"]
F -- Yes --> S["Did you overwrite pattern_search
to use `action_trigger_search` action?"]
S -- Yes --> H["In Enterprise Search Policy, was
Rasa able to connect to Vector Store/IR?"]
S -- No --> U[Do that!]
H -- No --> I[Check vector store/IR configuration]
H -- Yes --> J["Does the search query
contain relevant context?"]
J -- No --> K[Consider using custom IR]
J -- Yes --> L[Read the prompt sent to LLM]
L --> M["Are the documents
relevant to the user query?"]
M -- No --> N[it is a search issue!]
M -- Yes --> O[Is the LLM answer correct?]
O -- No --> P["Try prompt engineering or
a different LLM model"]
O -- Yes --> Q[End]
Loading
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment