# Monitor generative AI metrics
URL: https://docs.datarobot.com/en/docs/api/dev-learning/accelerators/model-eval-metrics/genai-metrics.html

> Monitor LLMs and generative AI solutions to measure alignment, return on investment, provide guardrails.

# Monitor generative AI metrics

[Access this AI accelerator on GitHub](https://github.com/datarobot-community/ai-accelerators/blob/main/generative_ai/Using%20Custom%20Metrics%20to%20effectively%20monitor%20Generative%20AI/Using%20Custom%20Metrics%20to%20effectively%20monitor%20Generative%20AI.ipynb)

While it gets easier to build generative AI solutions with each passing day, it is becoming evident that it is critical to effectively monitor these solutions to measure alignment and ROI, and to provide guardrails. Monitoring generative AI solutions or [LLMOps](https://www.pluralsight.com/resources/blog/data/what-is-llmops) is a multi-faceted endeavor and requires more than simple out-of-the-box metrics. Each business is unique and the solutions they build require customized monitoring metrics.

This accelerator illustrates how businesses can use DataRobot to effectively and holistically monitor generative AI solutions, using metrics that segment into themes for covering the monitoring requirements of a majority of businesses.

---
