It’s pretty important to have your setup in a way that allows you to audit your agents responses specially when it comes to agents that perform tasks that can cause disruption. What you really really want is a way to look into what went wrong if and when something goes wrong.
Agents have autonomy they have tools access they don’t operate within a sandbox for real world tasks if you don’t have auditing available you can never be sure on what went wrong lets assume you have an agent that sets up meetings based on your emails. Things that can go wrong are maybe wrong date wrong time parsing wrong email. There can be discussion thread where the people are talking about setting up a meeting and mention. After friday. What if agent sets up a meeting on Sunday you need to have governance to make sure that doesn’t happen and also to look into the issue if it happens. It is observability.
Logging is important as you might need to know what tools were called in what order. Structured output can also help you in searching the logs for a specific run. It can also help you in following the reasoning as you can also log reasoning.
It is important to have a list of agents that are being used and how they are used everybody in the organization must know what agents are available for what purpose. It is also important to know risks associated with an agent some agents can be disruptive to production some might not be an issue in production as they might run passively. It is called inventory.
Another important aspect of governance is guardrails. They are agents that look into output of other agents but also input you monitor what input can go into a specific agent for example you don’t want your keys to go into a web search. Similarly you have guardrails for output you don’t want PII to be part of the response from an agent.
Flow
- Guardrails -> What to protect how to protect.
- observability -> Observe what’s happening in decision making.
- Logging -> Adds auditibility makes thing deterministic.
- Inventory -> List of available agents.