I hope you don't class me as a weirdo for taking photographs! I have no problems with people taking photos of me or my family in a public place. I would hope that the photographer would ask though if he/she were deliberately focussing on us. Why do you feel the need to be wary of having your photograph being taken?
You don't need a permission or a model release to 'take' a picture in a public place, you only need that if you intend to publish it.
