Are you just tossing it out or do you have it weighted in a bucket? Could be a current or wind current is carrying your bait away. I haven't baited a whole in several years but when I did I always had better luck tying a five gallon bucket weighted with bricks to a log with holes drilled in the lid and a few on the side (obviously you will need a cordless drill to make this happen). If there is cats in the area then they will zoom in on that spot. It could also be there are no cats in the area that you have baited. Hope you get it figured out and good luck to you.