Annoying.

I wasn't annoyed by you or your presence.
I was annoyed by the way I felt when I was around you.
I should have known that.
But I didn't know, or I did know,
But I was just ignoring it...