# Monitor generative AI metrics

> Monitor generative AI metrics - Monitor LLMs and generative AI solutions to measure alignment,
> return on investment, provide guardrails.

This Markdown file sits beside the HTML page at the same path (with a `.md` suffix). It summarizes the topic and lists links for tools and LLM context.

Companion generated at `2026-05-06T18:17:09.583286+00:00` (UTC).

## Primary page

- [Monitor generative AI metrics](https://docs.datarobot.com/en/docs/api/dev-learning/accelerators/model-eval-metrics/genai-metrics.html): Full documentation for this topic (HTML).

## Related documentation

- [Developer documentation](https://docs.datarobot.com/en/docs/api/index.html): Linked from this page.
- [Developer learning](https://docs.datarobot.com/en/docs/api/dev-learning/index.html): Linked from this page.
- [AI accelerators](https://docs.datarobot.com/en/docs/api/dev-learning/accelerators/index.html): Linked from this page.
- [Model evaluation and metrics](https://docs.datarobot.com/en/docs/api/dev-learning/accelerators/model-eval-metrics/index.html): Linked from this page.

## Documentation content

[Access this AI accelerator on GitHub](https://github.com/datarobot-community/ai-accelerators/blob/main/generative_ai/Using%20Custom%20Metrics%20to%20effectively%20monitor%20Generative%20AI/Using%20Custom%20Metrics%20to%20effectively%20monitor%20Generative%20AI.ipynb)

While it gets easier to build generative AI solutions with each passing day, it is becoming evident that it is critical to effectively monitor these solutions to measure alignment and ROI, and to provide guardrails. Monitoring generative AI solutions or [LLMOps](https://www.pluralsight.com/resources/blog/data/what-is-llmops) is a multi-faceted endeavor and requires more than simple out-of-the-box metrics. Each business is unique and the solutions they build require customized monitoring metrics.

This accelerator illustrates how businesses can use DataRobot to effectively and holistically monitor generative AI solutions, using metrics that segment into themes for covering the monitoring requirements of a majority of businesses.