Klockness, I have thought a bunch through the same issue. I have a four year old and a two year old. After running a bunch of numbers through a bunch of scenarios and weighing our values, I finally decided that for the same or less money than buying a boat, I could kayak fish a bunch, including with the kids, fish from the beach, and then go on a few guided trips a year. This allows me to fish a lot, but also have some great, unique experiences, for both myself and the kids. It does mean letting go of some of that desire to do it all myself, but in the end, we get to live all the great values of the kayak fisherman while still both some comfortable, cooler filling fish hauls, i.e. whites or stripers, and some unique experiences. At least, I hope, as most of this is as of yet still in theory since they are young. But I can say, my four year old has over a dozen species to his name and thinks that fishing is supposed to be from a yak!
Many men go fishing all of their lives without knowing that it is not fish they are after. Henry David Thoreau