The "curse" began after the second time Voldemort had applied