There are times as a lay Buddhist when, imho, you do need to remember that the layperson's path involves a bit of dust however much we try otherwise, and not to stress about this. For example, when I am playing hide and seek with my youngest daughter at the local park, we just tear around the place, have fun, laugh etc. It's a normal and healthy part of raising kids, to let go and just engage with them like this. I'm not very sober while I do this, I just let go and have fun with her, and she really appreciates this.
At other times, she sees me in a more sober, serene mood, such as in the mornings when I have just meditated. But then also, I make sure to engage with her, to not be distant or detached. Kids need us to be emotionally engaged with them, that's part of child rearing.
Because my daughters see that my Buddhist practice does not hinder me from living what they perceive as a 'normal' life, they feel better inclined towards it.
They know that their dad, who as a general rule is careful even about tiny creatures, who tries not to speak badly about others, and who meditates, is nevertheless not 'boring' and is able to have fun in life too. Sometimes this involves a bit of joking around, and yes some idle chatter inevitably. But it's important to me that my kids not be put off Buddhism for life, by a perception that when their dad got serious about the Dhamma, he stopped having simple, childlike fun with them. I would not want them to think about the Dhamma like that.
I do admire the life of the monk, as 'pure as a polished shell', but as long as I am raising my dear kids, it's not possible or even appropriate for me to imitate it.
With metta and respect