I wouldn't go on the ice as far up as Button Bay or Arnold's Bay either, last few days have been warm and it already looked sketchy last week. From the Bridge to about Potash Bay was good last time I was out (Thursday) with 7 - 10 inches of ice. Not sure how much the warm weather has melted things, so be careful.
Good quality bait nearby can be found at BJ's Farm Supply on Panton Road in Panton and Rack & Reel on Rt 7 in New Haven. Good people running both places too.