People who are 80-90 or even higher population aren't off limits anymore. You can't focus on people low population, because they're not gathering resources.

I'm still doing fairly decently in raiding.. when my army hasn't been destroyed at least. Just gotta branch out.