Exactly. People usually know their neighbors enough to know whether they'll get a reasonable response or not.

If the neighbor had antisocial personality traits (narcissism is most common), trying to talk to them would only trigger a conflict which cannot be resolved.