Skip to content

On-premise users: click in-app to access the full platform documentation for your version of DataRobot.

Moderation

For a deployed LLM with evaluation and moderation configured, on the deployment's Activity log > Moderation tab, view a history of evaluation and moderation-related events for the deployment. These events can help diagnose issues with a deployment's configured evaluations and moderations.

To view the moderation events log, navigate to the Activity log > Moderations tab. The most recent events appear at the top of the list. Each event shows the time it occurred, a description, and an icon indicating its status.

Status for moderation events

All moderation events have a failure event type.

Moderation events represent deployment actions and can help you review the status of your deployment and the health of the management agent. Currently, the following events can appear as moderation events:

Event type Description
Moderation metric creation error Reports errors encountered while creating a custom metric definition. For example:
  • Failed to create custom metric. Maximum number of custom metrics reached.
  • Failed to create custom metric for another reason (with details).
Moderation metric reporting error Reports errors encountered while reporting a custom metric value. For example:
  • Failed to upload custom metrics.
Moderation model scoring error Reports errors encountered during the scoring phase of the model. For example:
  • Failed to execute user score function.
  • Cannot execute postscore guards.
Moderation model configuration error Reports errors encountered while configuring moderation for the model.
Moderation model runtime error Reports errors encountered while running moderation for the model. For example:
  • Model Guard timeout.
  • Model Guard predictions failed.
  • Faithfulness calculations failed.
  • ROUGE-1 guard configured without citation columns.
  • NeMo guard calculation failed.

Updated March 20, 2025