The suttas record many instances of people leaving wives and children as they go to the homeless life.
That said, I expect that it was socially more acceptable to do this back then than it is now.
“I hope, Anuruddha, that you are all living in concord, with mutual appreciation, without disputing, blending like milk and water, viewing each other with kindly eyes.” (MN 31)
What is the final conviction that comes when radical attention is razor-edge sharp? That the object of the mind is mind-made (manomaya). (Ven. Ñāṇananda)
"If you have always believed that everyone should play by the same rules and be judged by the same standards, that would have gotten you labeled a radical 50 years ago, a liberal 25 years ago and a racist today." (Thomas Sowell)