It wasn't wearing the yarmulke that pissed Herbie off. It was the fact that his choice to be an atheist wasn't being respected.