Legal advice required as I have been scammed

I was searching for a plot to buy in the end of 2023 through a home loan. Through an online portal a broker approached us and he showcased us a few plots and at the end of the month we applied for a housing loan under reputed bank and the broker with his contacts said that I have a higher sanction limit and thus we can afford two plots from the layout we were happy with. The broker and the seller regularly met with us and ensured through smooth talk the housing loan would be sanctioned and they would handle all the process,Finally the bank had approved the property and we were able to secure a loan of 68Lks against two properties of 1200 Sqft, each plot costing us 43Lks and 34 Lks sanctioned against each one of them we paid the remaining amounts through NEFT. After doing our legal checks with a local lawyer and getting legal advice from the bank, we had to pay additional amounts for insurance and then we had to pay a commission to the broker for all his activities, he charged for transfers, bank visits and various items. Post the sanction of the loan I registered the property under my name and after which I have been paying the EMIs regularly. Nearly after 6 months we went to the property to install a fence and we were disrupted by the locals and by few people claiming that the property belongs to them. After a heated argument we realized that the broker and seller through his internal connections with the bank has sanctioned the same property to various individuals and has scammed us. The bank refuses to address this issue or stop the EMIs and a representative has threatened to take us to Jail if we refuse paying the EMI. We are in dilemma on how to proceed, both the broker and the owner have been ignoring our calls in spite us calling from various numbers. What should be our legal remedy out of this?