Well, packets go from top to bottom until they are ACCEPTed, DROP, or JUMPed to another chain.
So if you have 10k ip addresses to drop from, each packet will have to process through 10k rules.
I suppose a rule of thumb would be: If you need to ask, it's too many rules.
