If I need to pay the commission??

Sir, i had done housing loan from muthoot home finance. 10 days back I got flat in my possession.before loan I handed over my documents file to an agent for the loan purpose.I told him i get Rs.30 lacs from bank I will pay your commission of 5% what he said.That means from the loan amount only. Meanwhile the loan process was quiet time consuming. I was in personal contact with Bankers.The agent didn't helped in any documentation or any information.I had to take leave several time myself and rush. Further the loan sanctioned was of Rs.24,50000/- I had to take loans from my office where i do job and also from my relatives. I told him that I cant pay your commission as loan amount I got was 5.5 lac less. Then he started to delay our cheque from bank. Prior to this bank had sent our DD photograph by the name of the party I had to take flat from.The cheque was delayed for 15 days after submitting all documents which were required to be submitted .We had to argue to bank for the same .I had to file police complaint. Tot the DD. Now the agent is again demanding the money.I had filed police complaint against him. what action I can take against him if again demanded. Regards, Now t