The Preferred Term Is "Doff"

From now on, I'm going to apply the term "doff" to whenever I remove my headphones to talk to someone.

Example: "So I was walking down the street the other day when I ran into Hank so I doffed my headphones and went 'Dude! Have you heard the new Death Grips single yet? It's raw as hell' and then I kept walking because it wasn't actually Hank and I felt embarrassed."