Registered Agreement cancellation process.

There was approx 5000 sqft land which purchased in 2009, 2011 and 2012. There is 3 Plot area. In June 2016, there was some dispute with another dealer. At the time of settlement we agree on following point. 1- He has given land all together one place where 1744 sq ft was already mine but main dispute was on that, he was saying, it is not as per Naksha and some area is in his Plot, so He has taken money 150000 vai check and adjusted the land and cutted 750 sqft (from 5000 sqft) for road. All these details we have written on 100 Rs notary stamp. 2- Now the remaining land he has given next to that and we have done registry for that. 3- and for My land which he has taken approx 4400 sqft he has done a registered agreement along with some other land owner for registering within 3 year which will be completed in next year july. Now when we are going to construct home on land he is again creating problem and saying that existing 1744 sqft land (point 1) still not on correct position and also linking with some other land dispute with other dealer, which is not on related to this land. We want to know that, Can i apply for the cancellation of registered agreement? if he is not allowing me to construct on my plot? Can i challenge in court with agreement done on 100 rs stamp? Please help thanks