Yes, I understand this fear.
My experience has been that if you "give it a go", you find that it enriches your life. And over time, the more you put into it, the more it continues to enrich the quality of your life.
Even if perfection is not attained... and even if
perfection, in the form of arahantship and nibbana is not possible at all... you will have a mind that is far happier and healthier than the alternative.
Just my take.
"Having understood name-and-form, which is a product of prolificity,
And which is the root of all malady within and without,
He is released from bondage to the root of all maladies,
That Such-like-one is truly known as 'the one who has understood'." (Snp 3.6)
"Whether I were to preach in brief, Sāriputta, or whether I were to preach in detail, Sāriputta, or whether I were to preach both in brief or in detail, Sāriputta, rare are those who understand." (A I 333, Sāriputtasutta)