Apologies aren't indulgences purchased from the church. They don't automatically absolve you of your sins.
I have always thought the idol to these kind of believers was the Bible. Not the teaching within. The actual book above the teachings. Not as a tool to learn how to live but as a sword and shield used to justify their hate.