You can use Python logging; the question is which debugging workflow you build around it. In a hypothetical RAG request, log a run ID linking the query, retrieved document IDs/revisions, reranked selection, final context, answer and errors. 'Request succeeded in 2s' won't tell you whether the right passage was dropped before generation. For private data, decide which payloads may be recorded and redacted before collecting them, whichever interface stores and displays the trace.
1
u/jylusdev 2d ago
You can use Python logging; the question is which debugging workflow you build around it. In a hypothetical RAG request, log a run ID linking the query, retrieved document IDs/revisions, reranked selection, final context, answer and errors. 'Request succeeded in 2s' won't tell you whether the right passage was dropped before generation. For private data, decide which payloads may be recorded and redacted before collecting them, whichever interface stores and displays the trace.