Anybody want to understand how Sense works?

It’s probably a lot like this Google experiment that categorizes sounds in a high-dimensional space. From some of the Sense videos, it looks like they use at least a 17 dimensional feature space for categorizing devices. Wouldn’t it be fun to see a T-SNE view on the world of on and off-signatures ?

2 Likes

This is great, @kevin1. I shared this with some folks internally. Would love to make a similar video for Sense :slight_smile:.

2 Likes

That is a great way of doing dimension compression!

I actually remember it … an audio geek forwarded it because we were discussing issues around HRTF (Head Related Transfer Functions) for 3D audio. Hard. In that case you need to simulate (and replicate) the near impossible: 3D dynamic spaces of materials and then “phonons”. 3D Game simulation of audio is way behind the video. Makes me wonder if there could be a silent version of Sense’s 17DOF … less a POV shooter and more like navigating Google Earth (Street View when you want, even go inside the house). “Asia” occupied by TVs and media electronics; “Antractica” filled with heat pumps and furnaces; North Africa gets AC and so on. I’m very confused already thinking about it. Maybe just a house sim? Go into the kitchen: “What, you’ve got like 19 toasters here!”

1 Like