one other thing that might be worth considering, is for the two of you to sit down with a professional relationships counsellor (I recommend getting a down-to-earth, non
-religious one). Then, with a third party present, you can discuss any issues you have, and your husband can discuss any issues he has. They are supposed to be impartial, but if he is worried you could even offer it be a male counsellor, or even a male and
a female, to really provide some balance. (So he doesn't feel like it's just two women (yourself and the therapist) ganging up on him.
My (now ex) and I had some of this kind of counselling as we were already breaking up (and due to various serious events, it was sadly irrevocable, by that stage, that we would
break up). But I can recall after that session thinking, "if only we had tried this earlier on, things could have been different, and we might have been able to resolve certain issues, and stay together".