sounds horrendous and someone does have it in for you as the peasants usually give up and find some new 'outrage' to screech about.
change your identity and move right away..or become a detective and get a bit clever.
can you get a friend who isn't known to talk to the those who have made comments ?..you know as though he's an outraged 'child protector' and wants to know more about the 'sex offender' as he's moving nearby and so on.
And maybe then you might get to find out the perpetuator of it as it is always one or two...sue the bastards for harassment and move to Spain with the settlement.
Or get a
huuuge sign in your front garden saying
SEX OFFENDER LIVES HERE AND WILL FOR THE NEXT 50 YEARS
and let all the real estate agents know and post notices in all the 'for sale' houses and pretty soon anyone who owns a property will be looking for the person who is doing all this to throttle them for you.
worked in the USA. (the guy also bought a few house for sale at knock-down prices and then sold his..and the others for a big profit !!)
