I’m back after a number of months and sense has detected a bunch of things (and even merged them) - its clever, but the issue is its not clever in the way I need it to be clever.
Its still very tough to just wait for the device to be detected!
Annoyingly the sense has classified my cleaners vacuum, but hasn’t classified my washing machine or dryer (but it has my dishwasher, 2 TVs and coffee machine).
The issue with the lack of ability to ‘train’ is still likely to be an ongoing problem in that the devices I WANT to show up, i’m supposed to wait an unknown amount of time for.
Whereas I can highlight here is my system with the thing off, now its on. Repeat the next day, and maybe a different time of day. Any good AI in the back end could extrapolate that, and if more info is needed then declare that (if its a niche piece of hardware).
I’m still waiting for it to detect my Tesla Model 3 (6 months later).
The example of ResNet also isn’t overly accurate as AI can be trained. Language Models, forms understanding, Object Vision, Face recognition - they all require a TRAINING phase - here’s a 1000 pictures of an orange, AI now knows what an orange is… A more accurate analogy is the Human Biome project - you can detect bacteria in the gut, some you know, but MILLIONS we don’t (in a single person). So require many humans with the same bacteria to identify them (i guess the human genome project is similar, but that’s been cracked) - its impossible to train a model here as you don’t know what you’re detecting.
Equally if you have detected a device, that doesn’t exist in the database, maybe unlock a beta function that shows ALL detected devices in a users house, that the user can self name. The user simply sets an alert on that device when it turns on, they can narrow down what that device is, and provide a device type (and confidence score). This is crowd sourced learning and very efficient (but you will need a different AI model to interpret the results).
All of a sudden I get unknown device
show up in my app. Set the alert to tell me when its on and off, and over a week i’ll probably figure out what it is and can submit it.
It seems you’re taking a purist approach which relies on the device being correctly identified (and even then its not always 100% correct).