Monitor applications¶

Consistently monitoring applications allows you to proactively detect issues, troubleshoot performance bottlenecks, and quickly respond to service disruptions, minimizing downtime and improving the overall user experience. To access monitoring information, go to the Applications page and click on the app you want to view.

From here, you can access the following monitoring options:

• Service health: Provides a dashboard that displays memory, CPU, and network usage.
• Activity log: Displays access, runtime, build, and version history logs.
• Tracing: Displays traces from the model or agentic workflow. Search and filter traces, review duration and token usage, and expand spans to view attributes, logs, input, and output.

Resource usage¶

The Service health tab allows you to monitor usage, service health, and resource consumption for individual applications. Monitoring resource consumption is essential for cost management to ensure that resources are used efficiently, helping optimize cost.

To access application monitoring capabilities, on the Applications page, click the app you want to view and select Service health. From here, you can:

Activity logs¶

DataRobot records the following activity logs for custom applications:

To access these activity logs, from the Applications page, click the app you want to view, and select Activity log.

Build and runtime logs¶

From the Build logs and Runtime logs tabs, you can browse logs that detail the history of compiling, building, and executing the custom application. This includes dependency checks, packaging, and any warnings or errors thrown.

Access logs¶

From the Access logs tab, you can monitor the history of users who have opened or operated a custom application.

You can also view access logs directly from an application source. Navigate to Registry > Application sources, locate the application source for your custom application, and expand the dropdown to view the applications built from the source. Then, click the custom application you want to view the access logs from to access a detailed view.

On the Overview tab, scroll down to the Access logs section.

The access logs detail users' visits to the application, including their email, user ID, time of visit, and their role for the application.

Tracing¶

The Tracing tab of an application displays traces from a model or agentic workflow. Each trace includes a combined span list and timeline that shows the order and duration of actions carried out by the model or agent. Use the search row to filter traces by last timestamp, status (Success or Alert), and type, including generation type (operational spans or generation-specific spans). Application tracing uses the same interface as deployment tracing.

While developing an agent locally, you can add custom OpenTelemetry spans and attributes (for example, runtime configuration values) so they appear in traces after deployment. For setup steps and code examples, see Add custom tracing to agent.

Traces represent the path taken by a request to a model or agentic workflow. DataRobot uses the OpenTelemetry framework for tracing. A trace follows the entire end-to-end path of a request, from origin to resolution. Each trace contains one or more spans, starting with the root span. The root span represents the entire path of the request and contains a child span for each individual step in the process. The root (or parent) span and each child span share the same Trace ID.

To view or change your organization's retention settings, see Configure OTel retention.

Traces appear in a list by Root span name. Each entry shows the status of the trace and the timestamp. Select a trace to open the detail pane, which shows high-level metadata for the request alongside a combined span list and timeline.

Depending on the request, the list and detail pane can include the following fields:

Search and filter traces¶

Use the search row above the trace list to locate traces.

Review spans¶

Select a trace to review its spans. The span list and timeline appear together: each row shows the span name, duration, and token usage, and a timeline chart shows when the span ran relative to the rest of the trace. Expand a parent span to show its child spans. Restricted span appears when you do not have access to the deployment or service associated with the span.

In the span view, filter spans by duration, tokens, name, or status code, or isolate identical spans.

When you select a span, high-level metadata, logs, input, output, and remaining metadata are available on the same page. Formatted text in a span appears alongside attributes. Click the span service or model name to access the deployment or resource (if you have access).

When you expand a span, logs appear with the span attributes, input, and output. The results shown are a subset of the full deployment logs.

Tracing table OTel attributes¶

For Cost, Prompt, Completion, and Tools, DataRobot reads specific span attributes across all spans that belong to the trace. Other fields (such as Timestamp, Latency, and Tokens) come from trace and span metadata rather than these attributes.

Attribute keys must match exactly (including the underscore in gen_ai). Names such as genai.prompt or GenAI.prompt are not read for the Prompt and Completion columns.

Automatic instrumentation (including DataRobot agent templates) often sets gen_ai.prompt, gen_ai.completion, and sometimes tool_name. For custom or external models, frameworks differ: tool execution may not emit tool_name even when tools run (for example, some LangGraph callback flows). In that case Prompt and Completion can populate while Tools remains empty until tool_name is configured on a span that runs inside the tool—see Implement tracing.