Additional Example of Model Comparison
Begin by selecting Help > Sample Data Library and opening Car Physical Data.jmp.
1.
Select Analyze > Fit Model.
2.
Select Type and click Y.
3.
Select the following columns and click Add: Country, Weight, Turning Cycle, Displacement, and Horsepower.
4.
Click Run.
5.
Save the prediction formulas to columns by selecting Save Probability Formula from the Nominal Logistic red triangle menu.
1.
Select Analyze > Predictive Modeling > Partition.
2.
Select Type and click Y, Response.
3.
Select the Country, Weight, Turning Cycle, Displacement, and Horsepower columns and click X, Factor.
4.
Make sure that Decision Tree is selected in the Method list.
5.
6.
Click Split 10 times.
7.
Save the prediction formulas to columns by selecting Save Columns > Save Prediction Formula from the Partition red triangle menu.
1.
Select Analyze > Predictive Modeling > Model Comparison.
2.
Select all columns that begin with Prob and click Y, Predictors.
3.
Figure 9.7 Initial Model Comparison Report
4.
Select ROC Curve from the Model Comparison red triangle menu.
ROC curves appear for each Type, one of which is shown in Figure 9.8.
Figure 9.8 ROC Curve for Medium
5.
Select AUC Comparison from the Model Comparison red triangle menu.
Figure 9.9 AUC Comparison for Medium

Help created on 7/12/2018