>>132928206Because as you can see i later manga volumes, Kazuma is a VERY self-righteous person.
If a shinki believes deep down that what he is doing isn't wrong, then the god isn't stung.
Basically he likes to convince himself he is doing the right thing; for example:
"If I don't vent my sexual frustration towards Veena, I might assault her!"