Do you notice that as you move from spot to spot you catch fish at first when you get to a new spot and then they quit biting?
At the marina I have 4 or 5 slips that I fish on a rotating basis. Catch a few quick fish and move. By the time I finish the rotation they usually bite again at the first spot. I never wait for the fish to bite in one spot. I think there are more fish there but you usually catch a few of the more aggressive ones first. By the time you return the school has forgotten and the new aggressive ones bite.
When in the boat I have enough spots to fish so I usually don’t return to one but if you only have a few places that you know of, just rotate them. If you rest a spot for an hour the fish will usually bite again.
If you only have one place to fish just take a short break, don’t fish at all for 15 min. and then change colors or types of bait and usually they will bite some more. It’s important that you don’t have any bait in the water during the break.