Can I block my child's father to visit us as we feel unsafe with his presence ?

Hi, I have been married for 3 years and it was a love marriage. Our relationship started ruining when I learnt that he is a porn addict and also he has this female weakness. When I was pregnant he started contacting call girls asking for nudes. Also he left me alone and went to his native when I was 5 months pregnant and was looking for women to sleep with. He has also physically abused me by pushing me when I was pregnant. I forgave him everytime. He never used to work properly or provide for me . I was and still the only one earning. After my delivery, our relationship detoriarted even more . Once I caught him mastubrating next to my sleeping baby boy which really pissed me off. He has even threatened to hurt me and kill me . In short he has ruined the peace of the family with his so called manly behavior. I asked him to leave my place .. its been 4 months since he is with his parents. And I do not want to live with him anymore. Also I feel threatened by him as well he has pushed my kid during a fight. So I do not want him to come visit us on the pretext of meeting my kid. I don't feel safe with him. Kindly help me and guide me so as what can I do in this case.