It can be VERY frustrating when they will not hit anything. I think those fish are pretty spoiled with all the Smelt, Alewives, Spottails, Ruffes, Perch, Bugs etc.. It always is tough this time of year. I could see my jig down 16 ft the other day! clear water. Sometimes they like very little movement on the jig end, and yes downsizing can work, so can upsize. Keep Jigging, thats what i do. Good luck!~