Would you buy a house with no backyard/sloped backyard?

My husband and I have been looking for a house for the past 5 months, we have a checklist of things we would like and things that would be nice to have, we have struggled to find the 'perfect' house so we have started to consider houses that don't necessarily have everything we want. We've found a gorgeous house that ticks most of the boxes but doesn't have a pool or usable backyard we don't have kids yet but we can't help but think is it the right place to buy if it doesn't have a yard for kids to play in or a pool for them to learn to swim? The house is quiet spacious and has scope to convert an area into a rumpus room, There is a nice park near by and we are active people so would take our kids out, and we are thinking it will be out first house so we might not stay there forever but we feel like it's such a large investment we want to make the right decision. I'm so confused! What would you do?