Of course he'd only speak about physcial violence. That's not evil though. Evil is the exercise of power, the imposing of one's will upon others by overt or covert coercion. The core of evil is ego-centricity, whereby others are sacrificed rather than the ego of the individual. It might result in violence but many times it never results in someone being physically hurt but still damage that spreads like a disease.
Peck says "Evil is defined as the use of power to destroy others for the purpose of defending and preserving the integrity of our own sick selves"
"The words 'image,' 'appearance,' and 'outwardly,' are crucial to understanding the morality of evil. While they seem to lack any motivation to be good, they intensely desire to appear good. Their 'goodness' is all on a level of pretense. It is, in effect, a lie. This is why they are the 'people of the lie.'"
Then, he tries to help them, where others have abandoned them.