Just found out why... the images that didn't render thumbnails were HUGE!

Is there a way to resize from within the album, or do I have to resize and reload?

Guess not, custom thumbnails time!