If I had to bank fish in Silver lake, i'd spend all my time at the tire barge - not the current break at the enterance to the marina, but the actual tire barge on the shore towards the Northeastern side of the marina next to the ramp.
It's submerged now, but it's a proven place - just check out the number of boats that hit it every weekend.
I doubt you can fish the docks there. I've got a boat in Twin Coves (run by Marinas International) & you have to have a pass-card to get in. I'm pretty sure that Silver Lake is the same way, but I've pulled a few off of that tire barge which should be accessible to the public.