Why do people who have never taken care of kids think they know how "easy" it is simply by observation?

What is their gripe with stay at home parents? Surely stay at home parents don't walk up to them in the streets and complain about how hard their day was, so why do they even care?