One Kernel at a Time