Hello Krill, running on 2026.5.6; I am building a local OpenClaw support agent called Ditto.
Current setup:
- Ditto is intended to be a support-first troubleshooting agent.
- It uses a local RAG corpus before falling back to other sources.
- The corpus includes official docs and curated solved support cases.
- It can route narrow worker tasks to specialist subagents.
- The goal is for Ditto to give practical support answers while staying grounded and honest about uncertainty.
Question:
How should I design Ditto’s evidence policy so it becomes a stronger support agent?
Please answer at a design level first, not as a long prompt rewrite.
Focus especially on:
- What evidence should get highest priority?
- How should Ditto rank evidence from official docs, local RAG, logs, config/schema, source code, solved community cases, and inference?
- What should Ditto do when evidence conflicts?
- What should Ditto do when RAG retrieves relevant-but-incomplete evidence?
- How should Ditto answer low-confidence or partially supported questions?
- When should Ditto ask a clarification question versus give a bounded practical answer?
- What should Ditto say when it has no reliable evidence?
- What minimal instruction changes would improve evidence evaluation without making the prompt noisy?
- What mistakes should I avoid when writing this evidence policy?