As @kevin1 pointed out here
a “placebo train mode” is perhaps a way of placating the tweakers but Sense’s current approach, imho, is more reliable in the longer term. Bigger data = bigger confidence. Statistics. Go figure!
I don’t disagree that feedback (to the user) of a “confidence level” would be a nice feature … it’s something I have suggested for the UI. It shouldn’t, however, be conflated with or necessarily relied upon for “training”.
Consider, there are a couple of “confidences”:
-
A (partial) signature is related to a particular device
-
A signature represents the COMPLETE device disaggregation
I would break that down as being the confidence in detecting (1) on/off vs the confidence in (2) the complete tracking. AO devices with low DC power (via a transformer) are hard for (1) and easy for (2). Dynamic devices like an OLED TV may be easier for (1) but almost impossible for (2). What I’m getting at, and the problem with “confidence”, is that to a certain extent the confidences are built-in and are more like 0 or 1 than 1-to-100.
That said, I think there is room for confidence feedback somewhere in the system.