You'd have to set off a bomb to spook perch away. Drilling holes with an auger attracts perch, we drill holes to attract them all the time. I don't really care if people drill next to me if they stop and chat. Good grief, they are only some slimy little fish.