New this ... some thoughts after reading some comments


#1

I thought I was the only one thinking about device detection. Finding the forum I see I am not unique!

  • several comments about why sense is counter intuitive. I understand that. It would be great to hear what we might be able to do to help. Are there other devices that we could buy and plug our devices such as refrigerator, coffee maker into for temporary training? Are there other clamps we can install in panel temporarily and move them around?

  • I joined a university after many years in industry. Seems like a lot of opportunity for new thoughts by engaging student teams. I also understand need for keeping core knowledge proprietary. Maybe there is a balance to get more parallel learning to problems highlighted by users.

  • having device level monitoring is what initially attracted me to sense. The total house monitoring it now does well. Is the top level summary being used effectively? Is there more that could be done sharing data series across users? Block by location for common external weather effects etc. generate possibilities to create projects for students and others to explore. Are there system integration possibilities? I have insteon all over the house. Nest thermostats.

A few thoughts. I am interested to see this work. There are many it seems who feel the same. Having some productive way to do more would be terrific and if I have to spend some more money that would be ok.


#2

@monty,
A few observations from my perspective:

  • If you truly believe in open sharing of data to leverage university work, then you should switch from Nest to Ecobee. Ecobee offers anonymized user datasets to a curated pool of researchers. I’ve had the pleasure of seeing some of Dr. Chong’s (Cornell) research on the subject of heating and cooling algorithms that has evolved using Ecobee data.
    https://www.ecobee.com/wp-content/uploads/2017/01/DYD_Researcher-handbook_R7.pdf
    Disclaimer - I gave up on Nest about 3 years ago when they seemingly lost all innovation after the Google acquisition. Ecobee starting offering room sensors then, Google just started.
  • Read up on MIT and CMU work on REDD and BLUED datasets used for most US university research on electrical disaggregation. Both datasets are straightforward measurements of voltage and current at a 16KHz sample rate, plus ground truth data measurements at either 1 Hz or 1 sample per minute. Even at a 16kHz sample rate (266.67 samples per 60Hz cycle), the researchers do some pre-processing on the data to reduce data size by removing repetitive data, though they offer the raw data as well.
    http://redd.csail.mit.edu/readme.txt
  • Sense is specced at sampling 4M data points per second, or a 1 MHz sample rate (2 voltage samples and 2 current samples). Given that data measurement rate vs the Sense data upload rate several users have metered, the Sense probe is clearly doing lots of pre-processing of the raw current and voltage measurements to extract relevant features and minimize the amount of data uploaded. I’m sure this reduced format and associates processing are part of Sense’s secret sauce. Researchers couldn’t use it without deep explanations of the preprocessing and the format is likely subject to change (firmware update anyone).
  • What’s more, is that university bound data sets would likely require ground truth measurements for all of the end devices. Very few researchers would want to initially jump into the game with an gigantic, completely untagged data set. So I don’t think the current Sense dataset is a good match for university sharing.