# Use the ROC Curve tools
URL: https://docs.datarobot.com/en/docs/classic-ui/modeling/analyze-models/evaluate/roc-curve-tab/roc-curve-tab-use.html

> Learn how to access the visualization tools available on the ROC Curve tab.

# Use the ROC Curve tools

The ROC Curve tools provide visualizations and metrics to help you determine whether the classification performance of a particular model meets your specifications. It is important to understand that the ROC Curve and other charts on that tab are based on a sample of calculated thresholds. That is, DataRobot calculates thresholds for all data and then, because sampling provides faster performance (returns results in the UI more quickly), it uses a maximum of 120 thresholds—a quantile-based representative selection—for the visualizations. Manual calculations are slightly more precise, therefore, the initial auto-generated calculations and the manually generated will not match exactly.

## Access the ROC Curve tools

1. To access theROC Curvetab, navigate to theLeaderboard, select the model you want to evaluate, then clickEvaluate > ROC Curve. TheROC Curvetab contains the set of interactive graphical displays described below. TipThis visualization supports sliced insights. Slices allow you to define a user-configured subpopulation of a model's data based on feature values, which helps to better understand how the model performs on different segments of data. See the fulldocumentationfor more information. ElementDescription1Data SelectionSelect the data sourcefor your visualization. Data sources can be partitions—Holdout,Cross Validation, andValidation—as well as external test data. Once you select a data source, the ROC curve visualizations update to reflect the new data.2Data sliceBinary classification only. Selects the filter that defines the subpopulation to display within the insight.3Display ThresholdSelect adisplay thresholdthat separates predictions classified as "false" from predictions classified as "true."4ExportExport to a CSV, PNG, or ZIP file:Download the data from your generated ROC Curve or Profit Curve as a CSV file.Download a PNG of a ROC Curve, Profit Curve, Prediction Distribution graph, Cumulative Gain chart, or a Cumulative Lift chart.Download a ZIP file containing all of the CSV and PNG files.See alsoExport charts and data.5Prediction DistributionUse thePrediction Distributiongraph to evaluate how well your classification model discriminates between the positive and negative classes. The graph separates predictions classified as "true" from predictions classified as "false" based on the prediction threshold you set.6Chart selectorSelect a type of chart to display. Choose from ROC Curve (default), Average Profit, Precision Recall, Cumulative Lift (Positive/Negative), and Cumulative Gain (Positive/Negative). You can also create your owncustom chart.7Matrix selectorSelect a type of matrix to display. By default, aconfusion matrixdisplays. You can choose to display the confusion matrix data by instance counts or percentages.  You can instead create a payoff matrix so that you can generate and view aprofit curve.8+ Add payoffEnter payoff values to generate aprofit curveso that you can estimate the business impact of the model. ClickingAdd payoffdisplays aPayoff Matrixin theMatrixpane if not already displayed. Adjust thePayoffvalues in the matrix and set theChartpane toAverage Profitto view the impact.9MetricsView summary statistics that describe model performance at the selected threshold. Use theSelect metricsmenu to choose up to six metrics to display at one time.
2. To use these components, select adata source and a display thresholdbetween predictions classified as "true" or "false"—each component works together to provide an interactive snapshot of the model's classification behavior based on that threshold.

> [!NOTE] Note
> Several [Wikipedia pages](https://en.wikipedia.org/wiki/Receiver_operating_characteristic) and the Internet in general provide thorough descriptions explaining many of the elements provided by the ROC Curve tab. Some are summarized in the sections that follow.

## Classification use cases

The following sections use one of two binary classification use cases to illustrate the concepts described. In both cases, each row in the dataset represents a single patient, and the features (columns) contain descriptive variables about the patient's medical condition.

The ROC curve is a graphical means of illustrating classification performance for a model as the relevant performance statistics at all points on the probability scale change. To understand the reported statistics, you must understand the  four possible outcomes of a classification problem; these outcomes are the basis of the [confusion matrix](https://docs.datarobot.com/en/docs/classic-ui/modeling/analyze-models/evaluate/roc-curve-tab/confusion-matrix-classic.html).

### Classification use case 1

Use case 1 asks "Does a patient have diabetes?" This hypothetical dataset has both categorical and numeric values and describes whether a patient has diabetes. The target variable, `has_diabetes`, is a categorical value that describes whether the patient has the disease ( `has_diabetes=1`) or does not have the disease ( `has_diabetes=0`). Numeric and other categorical variables describe factors like blood pressure, payer code, number of procedures, days in hospital, and more. For use case 1:

| Outcome | Description |
| --- | --- |
| True positive (TP) | A positive instance that the model correctly classifies as positive. For example, a diabetic patient correctly identified as diabetic. |
| False positive (FP) | A negative instance that the model incorrectly classifies as positive. For example, a healthy patient incorrectly identified as diabetic. |
| True negative (TN) | A negative instance that the model correctly classifies as negative. For example, a healthy patient correctly identified as healthy. |
| False negative (FN) | A positive instance that the model incorrectly classifies as negative. For example, a diabetic patient incorrectly identified as healthy. |

The following points provide some statistical reasoning behind using the outcomes:

- Correct predictions:
- Incorrect predictions:
- Total scored cases:
- Error rate:
- Overall accuracy (probability a prediction is correct):

### Classification use case 2

Use Case 2 is a model that tries to determine whether a diabetic patient will be readmitted to hospital (the target feature). This hypothetical dataset has both categorical and numeric values and describes whether a patient will be readmitted to the hospital within 30 days (target `variable=readmitted`). This categorical value describes whether the patient is readmitted inside of 30 days ( `readmitted=1`) or is not readmitted within that time frame ( `readmitted=0`); other categorical values include things like admission id and payer code. Numeric variables describe things like blood pressure, number of procedures, days in hospital, and more.

> [!NOTE] Note
> DataRobot displays the ROC Curve tab only for models created for a binary classification target (a target with two unique values).

---
