A problem with WordPress’ built-in picture gallery is that it will include a featured image in the gallery itself if one exists. See the solution