We can learn more about our model with the modelfox app. Run modelfox app and open your browser to http://localhost:8080.

Click the “Create Repo” button to create a new repo. Repos allow you to manage and compare multiple versions of the same model, just like git repos hold multiple versions of the same codebase. Click “Upload Model” to upload the first version of your model.

Click Training Metrics in the sidebar and have a look at the confusion matrix.

It looks like false negatives are a bit high. This means we are predicting people are healthy when they actually aren’t. It would be better if the model had fewer false negatives, even if it means more false positives, because doctors can rule out heart disease with further testing. Let’s make that change by going to the Tuning page. Drag the tuning slider to see how different thresholds affect precision and recall.

When we lower the threhold, we predict that more people have heart disease which results in lower precision but higher recall. Once you’ve chosen a threshold, you can update your prediction code to use it.