Skip to main content

High-level components

  • Account
    • Project
      • Run Context
        • Run
          • Run Tool
      • Tools

Account

The Account is the main entity. Is in the context of an Account that everything relative to a project exists. Meaning an Account can have multiple users (seats), projects, settings, billing details, and more.

Project

Creating a new project is the first step to start monitoring your agents. Every run context lives in the project.

Run Context

Is the holder of multiple LLM runs. It represents a thread of LLM calls that are to be monitored in the same context. In order words it is the same as if they were part of the same correlation id with different span ids.
The run context holds the input & output tokens, the operation costs, durantion and status (success or error).

Run

Every dspy.Predict, ReAct and ChainOfThought are considered to be a run, where it can have other Runs on it’s own.
Be aware the ReAct operation might invoke, internally multiple Predict operations.A Run know which tools where called, when and what were their inputs and outputs.Also a run has the signature input and output fields as well as the error details in case on any non-managed exception and the dspy level (recommended no catch at the top-level only).

Tool

A tool is a function that can, conceptually be invoked by a ReAct operation.
For a tool to be considered as Monitoring Relevant it must be annotated with the @nanomon decorator.