66 mn years is plenty of time to diversify a lot from a few, so you might be correct that "lots of species wouldn't have viable seeds". Perhaps they didn't, and just the (relative) few that did are the basis of what we have today.