it may or may not in your lake. try it both ways to find out. if the bite is okay and then you get the light going, see if they quit.
at night, you have to have light. i fish a lot at night and catch fish all night until they just look at the bait and swim away slowly.
for me, light does not affect the bite in a negative way. it helps the bite by bringing in more plankton.
if you think or know light is hurting your bite, then use a hunk of foam or what ever and make a floor and have light aiming sideways to the hole so your not shooting direct light down the hole. you can use a hole cover for when your light is on then.
i head lamp that has a dimmer comes to mind too. that's what i use and i use an ammo box with a cob light bar hot glued to the side of the lid and a switch on top.
take perch for example, they bite after the sun is up and quit before the sun goes down. your light won't hurt the bite from them. most fish bite in day light and many continue after sunset.
i also use led's on a strip and are attached to the two bars over head and i use a remote control dimmer/on/off switch. this would be good for your set up it seams like, if you like it dark. this will go down to about 10% of the full light of what ever led's your using now.