It may be less E.S.P. (or nonverbal communication/information, such as interpreting things from tone of voice, posture, or how someone smells) than that you have a greater tolerance for uncertainty than average. That discomfort with uncertainty leads people to adopt (not necessarily consciously) algorithms that will get them an answer quickly. Algorithms that can be as bad as "believe the first person you talk to" (or, equally fallible, "believe the most recent thing you've heard or seen") or "always trust doctors, even on matters completely unrelated to their medical training."

I don't know whether I'm as skeptical as you are, but I'm certainly capable of saying "I don't know" on some topics, the Simpson trial being a good example.