Suppose you got the following confusion matrix for a model by using a cutoff of 0.5. Calculate the sensitivity for the model.

Actual/Predicted Not Churn Churn
Not Churn 1200 400
Churn 350 1050

Now suppose for the same model, you changed the cutoff from 0.5 to 0.4 such that your number of true positives increased from 1050 to 1190. What will the be the change in sensitivity?

Note: Report the answer in terms of new_value - old_value, i.e. if the sensitivity was, say, 0.6 earlier and then changed to 0.8, report it as (0.8 - 0.6), i.e. 0.2.

Comments