Is My Smartphone Listening?

The common myth: your smartphone listens to your conversations to serve you ads. You mention coffee to a friend and suddenly Instagram shows you coffee ads.

This is almost certainly not what’s happening. The battery math alone rules it out. Continuously running voice recognition, or even just recording the microphone and shipping audio off-device, draws far too much power. You’d notice. The phone would be warm and dead by noon.

The one real exception is wake words. “Ok Google”, “Hey Siri”: these work because they’re handled by a dedicated low-power hardware buffer that listens for a single fixed pattern. The rest of the chip sleeps. It’s efficient precisely because it’s narrow.

So if the NSA wanted to listen for people saying “bomb”, or Google wanted to catch you mentioning you need a new bike: could they? In principle yes, but it would require the same kind of dedicated hardware that makes wake words work, extended to hold many keyword patterns, and ideally updateable remotely rather than burned into silicon – and somehow get people not to ask questions about what those update packages are for.

Unrelated: Google Pixel phones have a feature called Now Playing. It identifies the song currently playing in the room and shows it on your lock screen. Like Shazam, but always running, silently, in the background.

It works exactly like wake word detection: but instead of one keyword, the chip holds thousands of audio fingerprints of songs, updated over the air as new music comes out.

I don’t know anyone who asked for such a feature, but it sure works beautifully. Sure was worth the required effort to build custom silicon to make this feasible. Google really does know what we want.