How to travel with a (small) child in Vietnam?

My partner and I have done quite a bit of travel with each other over the last few years and are now expecting a baby. We realise that we probably won't be able to travel in the same way that we have in the past, but we're still keen to keep to dream alive so to speak.

I've always wanted to go to Vietnam after being a bit disappointed with the overly touristy Thailand, so I'm trying to plan a family holiday there.

I think the easiest way to do it would be to rent a house / villa (potentially with another couple and child) and use that as our base to do day trips or overnight stays at nearby places.

I'm particularly interested in the cuisine and would love to be somewhere within walking distance to local markets to buy fresh produce / seafood as well as sample the street food. We'd probably be looking at going for around 2 weeks so other attractions like beaches, walking, etc would be great to have handy too.

Can anyone make any recommendations about child friendly, safe places to Vietnam that I might be able to do this?