Disappointed in device discovery


#81

You can mimic this at 1 hour resolution using export and a few nice features of Pivot Tables in Excel.

  • Download a month or day
  • Create a pivot table with:
    • DateTime as the rows
    • Device Names as the column
    • Summation as kWh
    • Filter set to “Total Usage” (if you are looking at net usage, include “Solar Production” in the filter as well)
  • Once your have created the Pivot Table, add a second “kWh” to the summation
  • Rename the new column in the PivotTable as “Running Total”, “Meter Reading”, or whatever you want for accumulated energy usage.
  • Then left click on an entry in that column to change it to a running total vs. DateTime. Depending on your version of Excel, the route to “running total” selection will be different.

I created this one from my September hourly download in about 5 minutes (after looking up how to create a running total in a pivot table):

Pivot Table 1-hour data from Sep 01, 2018 to Oct 01, 2018.csv (12.1 KB)


#82

But I need minute resolution.


#83

When will device detection improve via IoT integration? Did I miss the webinar summary posting? I don’t have a $200 Phillips light but I do have LOTS of devices that know exactly when they are on and off. Sounds like it’s the solution for smart device detection, right? Can we ask for one manufacturer a month? Is that reasonable? Maybe NEST thermostats then WEMO then LiftMaster, Pentair, etc. in 6 months you could make a lot of user’s experiences wholely improved!


#84

@Grandpa2390 you can use my C# API wrapper to get that data :slight_smile:


#85

@frankwin.hooglander
Sweet! Thanks!

I downloaded it. but I’m not quite sure what to do with it. I remember a long time ago I found where someone had created a program to gather and record information from the Nest thermostat, and it was an app that would run on Splunk. Is this something like that?

I’m running Macintosh btw.

I’m researching this, but you will probably respond before I find the answer. Programming is not my strong suit. I wish it were.

edit8: well I’m at my wit’s end. Maybe a good night’s sleep will give me a fresh approach at REST APIs or whatever it is I need to get your software running. :frowning:


#86

I keep trying to compile different things, but I am getting errors that I can’t resolve. ugh.


#88

You’ll need Visual Studio to run that.

You can also install Postman and use the attached config file to get some data that way. (just remove the extra .xml extension that I had to add to be able to attach the file here).Sense API.postman_collection.json.xml (14.6 KB)

In the Get Authentication Token request you’ll have to add your Sense email + password


#89

I’ve got visual studio. nothing will compile. I’m getting errors about the using command being invalid.

I’m missing a dependency, but I can’t figure out what it is


#90

You’ll probably just have to restore the Nuget packages.


#91

Fascinating thread, but what does this have to do with “device discovery”. Sense is supposed to be able to do that for the large market, not just the programmers among us.

Might I suggest a separate thread for people developing their own layers and apps on top of Sense?


#92

It’s relevant to the thread.

@frankwin.hooglander Thanks for trying. But I don’t think it’s going to happen for me. I installed Nuget package extension, and tried to open it up in postman and got no results.Thanks for trying to help me, I don’t want to keep wasting your time. A person like me needs an executable. lol.


#93

So after over a month of silence from support on my ticket opened in early October for poor auto discovery, I requested an update on the status and to be honest was quite disappointed by what came back. Back in October I was told that they could see the devices in the logs that were never being discovered, they asked for all the specific model numbers and details which I provide and then yesterday I was told that my poor Auto Discovery issues are only a “medium priority bug” and I might see something in late January. The replacement monitor has been installed for 2-1/2 months (yes I had to start all over again, Yeah!) I have a grand total of 4 devices that are not Hue lights discovered.

It seems the priority is new features vs fixing the foundations of the product that are still not working as advertised which is quite disappointing. At this point I guess I’ll just have to accept that it will likely never work any better than it is now, will always only show a portion of my power use (often double now with the Smart Plug double-counting Always On issue) and move on and never recommend this solution to anyone else.

It’s extremely disappointing that their attention has focused on these new features when so many people continue having disappointing results with the foundations (auto discovery) of the product.


#94

I can’t speak for the exact issues you’re referencing without looking at the support tickets, but yes, some bugs receive higher priority than others. Our dev and data science teams are small and priorities get shifted around occasionally as other issues arise. Some bugs break more than others and those must receive priority. We also have to constantly assess the reach of a bug. Priority tends to be given to bugs affecting the widest set of users over isolated, device-specific issues.

I hear your complaint about new features. There’s always a balance to strike between fixing what’s current and building stuff anew. That’s not unique to us (I had some banging-my-head-on-the-table moments this weekend with some audio software that got updated without fixing certain issues first). We’re always keeping that division in mind and re-assessing what deserves resources. Still, even while we’ve been building new app features, we’re still pushing out bug fixes (see the three patches to v23 as an example, but many more happen behind the scenes that never receive release notes). All that said, discovery is more in the realm of the data science team. While the software team has been working on new app releases, the DS team is constantly focused on improving device detection. While they certainly have their hand in the app side of things, their work on the core functions of the Sense app has in no way been hindered by recent app updates. It’s worth mentioning too that fixes here do not come easy. It’s not a simple matter of the DS team flicking a backend switch and suddenly devices can start popping up. Detection fixes require a lot of attention and a lot of data. Those two things can take a fair amount of time. Support could have been more transparent about this upfront and I’ll be sure to pass your feedback along to the relevant teams here.

Lastly, in many cases, newly released features have been all about improving device detection. Philips Hue and the smart plug release immediately come to mind here. These took a ton of dev resources, but they’re giving us fantastic data to improve device detection for everybody. We already have a lot of ground truth data rolling in from smart plugs and the DS team can’t wait to get their hands on more.

Sorry for the incredibly lengthy response, but I get the frustration. Most of us here use Sense as well and deal with the same bugs. Luckily, device detection issues as bad as yours are rare, but they do happen. Homes vary and devices vary and these can really get in the way of a good device detection experience. If you’d like to discuss further, shoot me a PM.