Sometimes, when you are in one of these “sub windows” (e.g., the “smart lookup window”) pressing control+spacebar brings up a context menu similar to the alt+spacebar action.  One of the resulting selections is “close.”  This works for me most often.