Falsely implicated in FIR

I am living in Duplex with my family. My neighbor falsely trying to lodge FIR against me stating that due to sound he is unable to sleep. He is 70 year old leaving alone and converted his Duplex in temple. He now also stated baseless allegation of threatening through Reporters and Supporters. Police authorities each time investigated the matter with other neighbors and found nothing as stated in complaint. Now, he with his supporter pressuring police authorities to lodge FIR with false claims. It is pertinent to mention here that his allegations are just opposite to what he is complaining. Number of times his sent supporters to our house some of them have threatened us. Similarily, large gathering of Devotees come for Hawan in his Duplex in every Amawasya and Poornima, Everyday 1-2 hour Ghanta etc. are used during Arti. Despite of above we have never complained. But, now he is leveling baseless allegations. What can we do now. I am government servant, so I dont want to indulge in all these.