Registered gift deed cancellation by father

Hi my name is radhakrishna and in 2007 my father wanted to construct a 3 floor building on his land where all were staying and due to job i was placed either in chennai or sometimes for different projects abroad since ours is a big joint family where we all stay together (my father,mother,elder brother and familyand youger brother and family and i have one brother and sister who are mentally challenged) the place was not enough and as i was in IT field my earnings when compared to my siblings was more so he wanted me to take house loan on my name my father he is a central govt retd and he gets pension my elder brother is a state govt teacher and has a secured job my youger brother is a private school teacher so in 2007 the plan was sanctioned and according to that we got a permission to construct slit+3 floors and the third and second floor was registered to elder brother and me.we took the loan and my father used the money i took for construction for all the three floors. now as we stopped him from constructing illegally in the parking lot he got angry and he complained aginst us in Police station and also through court he sent us a notice that he wants to cancell the gift deed. i want to know on what basis can he ask the court for cancellation of gift deed. he has given us the rights of first floor tearrce to construct thehouse and we can show that the property they constructed was using our money still is it possible to cancel the registered gift deed thank you