「カスタム指標」タブ¶
On a deployment's Custom Metrics tab, you can use the data you collect from the Data Export tab (or data calculated through other custom metrics) to compute and monitor up to 25 custom business or performance metrics. These metrics are recorded on the configurable Custom Metric Summary dashboard, where you monitor, visualize, and export each metric's change over time. この機能により、組織固有の指標を実装して、DataRobotに組み込まれている[サービスの正常性] (service-health)、データドリフト、精度の各指標によって提供されるインサイトを拡張できます。
本機能の提供について
Custom metrics don't support segmented modeling.
To access custom metrics:
-
上部のナビゲーションバーで、デプロイをクリックします。
-
On the Deployments tab, click on the deployment for which you want to create custom metrics.
-
デプロイで、カスタム指標タブをクリックします。
カスタム指標を追加¶
The Custom Metrics tab can track up to 25 metrics. To add custom metrics:
-
On the Custom Metrics tab, click + Add Custom Metric.
-
In the Add Custom Metric dialog box, click Add external metric, click Next, and then configure the metric settings:
フィールド 説明 名前 (Required) A descriptive name for the metric. This name appears on the Custom Metric Summary dashboard. 説明 A description of the custom metric; for example, you could describe the purpose, calculation method, and more. Y軸の名前 (Required) A descriptive name for the dependent variable. This name appears on the custom metric's chart on the Custom Metric Summary dashboard. デフォルトの間隔 Determines the default interval used by the selected Aggregation type. HOURのみサポートされています。 ベースライン Determines the value used as a basis for comparison when calculating the x% better or x% worse values. 集計タイプ Determines if the metric is calculated as a Sum, Average, or Gauge. 指標の方向 Determines the directionality of the metric and changes how changes the metric are visualized. You can select Bigger is better or Lower is better. For example, if you choose Lower is better a 10% decrease in the calculated value of your custom metric will be considered 10% better, displayed in green. タイムスタンプ列 (Required) The column in the dataset containing a timestamp. This field can't be edited after you create the metric. 値列 (Required) The column in the dataset containing the values used for custom metric calculation. This field can't be edited after you create the metric. 日付形式 The date format used by the timestamp column. This field can't be edited after you create the metric. モデル固有 When enabled, this setting links the metric to the model with the Model Package ID provided in the dataset. This setting influences when values are aggregated (or uploaded). For example: - Model specific (enabled): Model accuracy metrics are model specific, so the values are aggregated completely separately. When you replace a model, the chart for your custom accuracy metric onlys show data for the days after the replacement.
- Not model specific (disabled): Revenue metrics aren't model specific, so the values are aggregated together. When you replace a model, the chart for your custom revenue metric doesn't change.
-
Click Add custom metric.
Upload data to custom metrics¶
After you create a custom metric, you can provide data to calculate the metric:
-
On the Custom Metrics tab, locate the custom metric for which you want to upload data, and then click the Upload Data icon.
-
In the Upload Data dialog box, select an upload method, and then click Next:
Upload method 説明 データをファイルとしてアップロード In the Choose file dialog box, drag and drop file(s) to upload, or click Choose file > Local file to browse your local filesystem, and then click Submit data. You can upload up to 10GB uploaded in one file. AIカタログを使用 In the Select a dataset from the AI Catalog dialog box, click a dataset from the list, and then click Select a dataset. The AI Catalog includes datasets from the Data Export tab. APIを使用 In the Use API Client dialog box, click Copy to clipboard, and then modify and use the API snippet to upload a dataset. You can upload up to 10,000 values in one API call.
カスタム指標を管理¶
On the Custom Metrics dashboard, after you've added your custom metrics, you can edit, arrange, or delete them.
To edit or delete a metric, on the Custom Metrics tab, locate the custom metric you want to manage, and then click the more options icon:
-
To edit a metric, click Edit, update any configurable settings, and then click Update custom metric.
-
To delete a metric, click Delete.
To arrange or hide metrics on the Custom Metric Summary dashboard, locate the custom metric you want to move or hide:
-
To move a metric, click the grid icon (
) on the left side of the metric tile and then drag the metric to a new location. -
To hide a metric's chart, clear the checkbox next to the metric name.
Configure the custom metric dashboard display settings¶
以下の設定を行い、ダッシュボードに表示するカスタム指標の計算を指定します。
| 設定 | 説明 | |
|---|---|---|
 |
モデル | カスタム指標を表示するデプロイのモデル（現在または以前）を選択します。 |
 |
範囲 (UTC) | カスタム指標を表示する期間の開始日と終了日を選択します。 |
 |
単位 | 日付スライダーの時間単位を選択します。 選択した時間範囲に基づき、単位を毎時、毎日、毎週、毎月から選択します。 時間範囲が7日を超える場合、単位を毎時にすることはできません。 |
 |
表示を更新 | Refresh the custom metric dashboard. |
|
リセット | Reset the custom metric dashboard's display settings to the default. |