Legal implications of calling off wedding before engagement by groom

Dear Sir /Madam, My family had decided for my marriage and hence they met a family and saw the girl as well. During the visit since my family was ok with girl and they asked for my number since I stay away from home due to Job. Now after almost 23 days of my family visit to girl's home I did received a call from her and we had normal call checking on likes and dislikes, hobbies etc.. After there due my work schedule I was unable to receive any call and since due constant call and message from girl side during my work hours, I message girl that I won't be able to go further with this relationship. The day when I message her was 15-16 days before the engagement date. I was informed on 27th March that engagement is scheduled for April 17.... Now girl's family is threatening my family to pay 10lacs or they will to court on account of causing mental harassment to girl. My question is does this even make a scenario in the eye of court and will it have any impact on groom/ boy?? If yes what.. and how I can defend my self since my reason to call off wedding or engagement was due to constant call and message from girl's and her family during my work hours.