Well, not necessarily space ship models, but the technique would be the same for ship models or other genres:

I drill a small starter hole, then use a hobby knife and fine needle files to shape the window.