In the picture below, the power button is off, but the device is still active.
Is the power button just handled at the software level rather than being a physical battery disconnect, as I assumed?
Yes, and some early units went out with firmware that didn’t run the relevant monitor task when waiting for WiFi 
The workaround to shut it down in that case is to turn the switch off and then press the reset button…