Construction of temple by society member whoever two member in vicinity of that construction oppose

In a 100 people society, actual living members are around 50-60. now the other members of that society want to build a temple on a land of society which was kept for septic tank according to site plan. now the option of septic tank has gone due to sewerage system and that land is not in use from more than 15 years. but as per site plan temple was in different place. now that that alleged construction on septic tank plan is in front of my house. we two member in extreme vicinity are opposing of that construction due to disturbance which will arise in future and beacause we don't believe on temple worships. if the temple built there it will create a permanent nuisance and disturbance and some people says that temple infront of any house is not good as per vastu shashtra. now other members of society are going to get a resolution to get permission for that. they not listening our problem. they have majority in there side. can we oppose them by court in future asspect. can we stop them permanently on the basis of our right to peace. can we win to stop them on minority basis. please guide me