Neighbor verbal abuse

Hi, I don't know if this matter merits heavy weight but I would still nonetheless like to know my options. My neighbors are a family of 8 people. Husband, wife, a son, 4 daughters and husband's younger brother. He is jobless and wifeless . He is basically treated as their pet goon. So that he does their dirty work for them. The guy randomly hurls sexual insult against our family, especially me and my mother over petty issues. My mother usually scolds him back but none if his family members intervene or try to get him to resolve the matter amicably. My father and both brothers are advised to stay out of the fight so they do. Even I don't interfere. Recently it has become a obsession of his to verbally abuse me and comment on my physical features in a derogatory manner , no matter the issue. Everyone in the society knows this and condemns him . I hope I can get them to testify it if needed but I am waiting for suitable time to gain recorded evidence to call police. But there are times I want to hit him with a stick. He is in his 40s-50s age and about 4'11" height. Should I take matter in hand by hitting him ? Or should I wait for evidence and let police handle it ? I m also worried about retaliation. I am 26 yrs old about to join government job.