It is a factor with some nonzero impact overall, yes. But the average town won't see any of that. They're all concentrated at capitol cities and vacation areas. So if some rando guy in rando city is wondering why no women within 5 miles want him, the elite are not on the minds of any of his prospects.
Mashed, but the key is lots of cream cheese