Casting for the American Harry Potter had gone better than expected