Tools are the primary method for LLMs to interact with external providers. Observee offers detailed logs on every tool that is called from your MCP server. Depending on whether you have an API key or not — see developers configuration for more information — the information available in the logs will differ. If you have signed up for Observee and have generated an official API key through the platform, you will be able to see the following:

  • Tool Input
  • Tool Response
  • Duration (as in, how long it takes between request and response)
  • Timestamp
  • Status (as in, did the server return a success or a failure)

For those who are running Observee without an API key, the tool input and response will not be shown.

Furthermore, Observee collects data on the amount of instances a particular tool has been called, as well as the error count of an individual tool. This is so that analytics can be accurately tracked.