Apartment Association causing trouble

Hi, My question is regarding to my apartment association. First I would like to tell whole story. We have 2 blocks in our Apartment i.e. Block A and Block B. First Block got ready and then Block B got ready after a year of construction. Our builder formed an association on February 2017, no election happened. He just called an emergency meeting and took every residents owners. I was also part of the meeting. Builder nominated 3 people who he knew and announced that Association was formed. Later, these 3 association people included their close friends in the association as member, No election held. Initially these 3 persons were good. After that, these people started forcing on other resident and started bully residents except for their close friends (who are also residents). If anyone raise their voice and show concern regarding to any association members, all these association members group with each other including the President, bully the fellow. Because of this reason, some people preferred to keep quite, as no one wants to loose peace. Once Block B got ready and new residents started moving in. There was a pressure of including residents of B block from some people. Therefore, these association members and president called for AGM. Association President mailed every resident that there will be re-election, but he made all residents fool and play some tricks/game to avoid re-election, President got successful in that also. After getting forced from residents, he agreed to do election for filling the vacant seat of association members. Also, he deceived the builder by ignoring him, who picked him as candidate of president when association was formed. Due to this reason, he had a fight with builder also, subsequently Builder stopped interacting with him (President). But President till now has become so stubborn and refused to acknowledge anyone. His behavior started causing a lot trouble to other residents as time goes on. Some strong residents requested him for another AGM. He initially did not reply for their messages. Later, the same residents again sent the reminder, he still did not reply and asked someone else from association to reply to their message. He clearly denied to set up an AGM and again started playing tricks and games, he replied that AGM can not be done as it has already happened 6 months ago and only special meeting can be called. when residents started asking him to organize the special meeting, then he stopped replying. Later people sent him reminder, then he refused to organize the meeting and started provoking other members not to attend that meeting. He started telling to his Association close members to resist this special meeting. Now residents are feeling helpless, he is not willing to confront anyone from society. Please suggest, how can we get rid of these people who are not willing to do anything in the society, make group and bully other residents, when asked for meeting, he never shows willingness.