How do I get back money from my lawyer?

I paid a lawyer upfront fees of Rs 50000/- for divorce case, where my wife filed a petition seeking a mutual consent divorce. The lawyer I hired stated that he will fight the case in case I am asked alimony. In this case, the issue was mutually resolved and me and my wife are back together. However the lawyer I hired has not returned the fees I paid him. He did not even go to the court as well anytime before on my behalf. The money is with him for the past 1 year. He even charged Rs 2000 during the first visit, Rs 1000, twice for the second and third visits just to hear my case and subsequently the updates. Even the calls I made to him were very few, may be 2 or 3. Only advise he has given is to just wait and watch. I am asking him to refund the amount after deducting his consultation fees. He says that he has distributed the money to his partners and I have to wait for another two weeks till he collects the money back from them. This answer is coming from him after several visits to his office, phone calls and messages. How do I proceed in this case?