For father's property

Sir, we all brother together made an agreement in 1994 in that my brother and me got our father's home.After that in which we all brother decided that which part of the house for me and which part to my brother's.For that we gone for agreement on 100 rupees non judicial stamp with all our family signature and noterised ( notery )on 2013. In which l got first and third part of the house and my brother second and fourth part of the house. We all are well. And apply for house patta . We submitted application to gram Panchayat. After that my brother brought back application form gram Panchayat saying that we will make it later. I didn't know about this matter.Aftersome time my friend told me that my brother brought back patta application. When l asked my brother that why he brought back application.He said that he wants first and third position of house. I told that it's mine according to our family agreement. After that he filed civil case saying that my father had given him full house on orally ( mukh jabani) in 1980 we both living in out of state for business. He also take temporary stay from court because the way for going in the house from first part of the house. Which is mine. In our agreement l have to give way and l am ready to give. I told my advocate that l am ready to give way to him Which is in agreement. He wants kabja. Pl. Give me advice how to remove temporary stay and case favours to me. He doesn't have any proof .