Example of Boosted Tree with a Categorical Response

In this example, you construct a boosted tree model to predict which printing jobs are affected by a defect called banding.

Select Help > Sample Data and open Bands Data.jmp.

Select Analyze > Predictive Modeling > Boosted Tree.

Select Banding? and click Y, Response.

Select the Predictors column group and click X, Factor.

Enter 0.2 for Validation Portion.

Click OK.

The Boosted Tree Specification window appears.

(Optional) In the Reproducibility panel, select Suppress Multithreading and enter 123 for Random Seed.

Because the boosted tree fit involves a random component, these actions ensure that you obtain the exact results shown below.

Click OK.

Figure 7.2 Overall Statistics for Nominal Response

Because the response, Banding?, is categorical, the Boosted Tree analysis provides a Misclassification Rate under Measure and a Confusion Matrix report. The Misclassification Rate for the validation set is 0.2222, or about 22%.

Click the red triangle next to Boosted Tree for Banding? and select Show Trees > Show names categories estimates.

A Tree Views report appears, with outlines for the layers. You can examine the layers to see the trees that are fit and the predicted values.

Figure 7.3 Layer 1 of the Boosted Tree

10.

Click the red triangle next to Boosted Tree for Banding? and select Save Columns > Save Prediction Formula.

Columns called Prob(Banding?==noband), Prob(Banding?==band), and Most Likely Banding? are added to the data table. Examine the Prob(Banding?==noband) column to see how model predictions are calculated from the layers.