Non-smokers AND non-drinkers, do people look at you in bewilderment and ask what you do for fun?

When people find out I don't smoke or drink, they look at me like I just walked out of a spaceship. :P