How can we take refuge in our kamma if we know that we are bound to samsara due to our ignorance? This is like circular thinking. Many of our actions and intentions arise due to ignorance, craving, greed, delusion, etc.
If this weren't the case, we would have already gone beyond. That includes going beyond kamma and vipāka.
How could proper refuge be anything outside of the triple gem?