Clik here to view.
Confusion Matrix – Another Single Value Metric – Kappa Statistic
Background: This is another in the line of posts on how to compare confusion matrices. The path, as has been taken in the past is in terms of using some aggregate objective function (or single value...
View ArticleEthical/Policy issues concerning Targeting Systems
Targeting Systems can be used to target a very variety of “things”. The things can be people, tax filings, medical claims, flights, customers, and many others. For example, targeting systems can be...
View ArticleClik here to view.
Targeting Systems vs. Classification Systems
It is generally said that targeting system is a degenerate classification system with only two labels. However, this is misleading. For example, consider that you are trying to identify a list of...
View ArticleComparing two confusion matrices
Comparing two confusion matrices is a standard approach for comparing the respective targeting systems, but by no means is it the only one. As we will discuss in the coming days, you can also compare...
View ArticleClik here to view.
Comparing Kappa Statistic to the F1 measure
We looked at Kappa Statistic previously, and I have been evaluating some aspects of it again. To remind ourselves, Kappa statistic is a measure of consistency amongst different raters, taking into...
View ArticleWhy “Accuracy” of a Classification System may be a Useless Metric?
Recently, I received a slide deck extolling the virtue of an exciting new classification system with a purported accuracy of 62.5%. While the number itself is not very high to begin with, the value of...
View Article
