Setback area issue

Dear Sir/ma'am, I have started my home renovation work march,2020. Before that I follow all necessity and gov. rules like apply to panchayat, paid construction charge, measured the land by a amin(pierogi). After measurement he told us that we have 3 ft dispute all sides and write and sketch out the plot. Our neighbour also present that time and agree with that and also sign the application form submitted to panchayat. So we started work but due to lockdown it's stop. Now all done except plastering. But the problem is after that our neighbour also started some construction work and did a new measurement . That time our plot's east side dispute became 3ft to about 1ft. They started problem, as we have no sufficient dispute. Actually ours Amin's measurement was totally wrong. We give them this 2ft shortage from our another side land near to it. This mutual is actually done by panchayat member(head) and write all things accordingly in paper. Sign many neighbours with us. But still they don't allow us to start plastering east side. They demand one after another things. Now told to first registry this exchange, then we can work. But our others neighbours told not to register this as they are not good and has demand one over another. They ( others neighbours) told us to give them a part of another plot in lease, so they will do something there and will manage the problem by taking as our side/good wishers. Now we are totally confuse, what should we do? Sometimes we think to go to court and to take steps against our Amin, who create this by wrong measurement. So what we can do? Please help.. My family is totally mentally depressed, confuse about what will do...