This is what your neighbor was thinking every time your wife spoke to him at her birthday pool party