Builder Issue - After 7 years of Possession builder asking more amount and parking is not given

Hello Sir, Took flat in the year 2012 with bank loan, in the agreement & sale deed. it is mentioned that common related parking and land area will be given as per rules. In the apartment total 15 flats, builder has 4 flats (took loans on them, and can not sale to any - some litigations). Hence 11 flats and he constructed penthouse (2 no's) without any permissions, which is illegal and in common area (parking area) constructed illegal 1 bedroom house and given for rent. After a year i.e. from 2014 he vacated the flat and sold to someone and shifted his home to some other place and since then he has not handed over the building or formed society, not alloted parking to the owners. Now, when all the owners formed internally as society (which is not registered) but managing by us by forming president, general secretary, Vice president, treasury and members. After locking the rooms in common area which come under maintenance. Now builder saying that i have not given parking areas, you have to give me 5 lacs (which is due amount), it is my building - i will give you the amounts back (2012/13 rates) vacate the flats and he making all useless comments to all flat owners about other flat owners. Request your advise please.