It depends. Are you inviting other people who are the problem? Hard for anyone to know. My list is much more trim, but some of those people could have hundreds of inactive people on their invite list and I would never know. But, that is LESS likely to happen when you keep your invite list trimmer (to just the people you know are reliable).