Yes, I understand this fear.
My experience has been that if you "give it a go", you find that it enriches your life. And over time, the more you put into it, the more it continues to enrich the quality of your life.
Even if perfection is not attained... and even if
perfection, in the form of arahantship and nibbana is not possible at all... you will have a mind that is far happier and healthier than the alternative.
Just my take.
"Do not force others, including children, by any means whatsoever, to adopt your views, whether by authority, threat, money, propaganda, or even education." - Ven. Thich Nhat Hanh
"Whether I were to preach in brief, Sāriputta, or whether I were to preach in detail, Sāriputta, or whether I were to preach both in brief or in detail, Sāriputta, rare are those who understand." (A I 333, Sāriputtasutta)