If you have children (especially younger children) you will always have to consider the location and accommodation that you are choosing to stay in when going away a little more than perhaps you would if you were going with friends or as a couple. There are many family friendly holiday destinations all over the world, some are designed with children very much in the forefront such as Butlins and some that just offer a little more in the way of convenience or family entertainment.
One of my main pieces of advice when booking a family holiday is to go off recommendations or reviews. A place can appear very suitable on the surface, but often the experience can be a little different. If you ave any doubts always talk to the accommodation providers first and explain your situation, ask them what they have in terms of facilities and entertainment and if there are any restrictions concerning children (such as not being allowed in the bar or restaurant after a certain time).