Just for the sake of argument, was it a large body of water?
You are well within your rights to harvest them, but if that pond/lake is small there might be a "shortage" of perch if all the larger fish are removed. Not a complaint, just an observation.
Luckily perch are notorious for being accomplished breeders, and the numbers should sustain harvesting.
On the plus side, if the perch have "overpopulated" that waterway, that could account for lack of bass.
Harvesting perch (and sunfish) will do wonders for the bass population if the fry aren't eaten by numerous panfish.
Could be a win-win scenario, but it will take years to see if that happens.
In any case, it looks like you got some filleting and frying to do!