You say you are not pleasant to look at. Have you considered that maybe that's just because you're not your type?
Madness string 85900
Thus, even assuming that reading sometimes has an adverse effect upon moral conduct, the effect is not likely to be substantial, for those who are susceptible seldom read.