Maybe it's just influenced from people telling you about the kind old man that used to live there. (And the fact that he died there)

I guess it depends, do you believe in the "supernatural."