It really is a habit thing, I carry my trash in my pocket till I find a bin.

Another thing to note is that, unless you saw someone litter, it's possible the trash WAS in a bin but an animal took it out or the wind carried it away.

I went to toss a wrapper once and a squirrel scared the life out of me