Cheap Substitutes Can Be a Vice