Seller Refusing to refund Token Amount

I was on lookout for a pre-owned SUV and came across a nicely maintained 2013 XUV W8 on OLX on 4th of May. The Car had done 44000 as per the ad pictures. I visited the seller the same day evening an checked out the car. The car was nicely maintained, and the seller asked me if I wanted the Car urgently. I replied saying I will apply for loan for some amount, and as soon as I have the funds I will complete the transaction.I texted him the same night that I was interested in buying it for 8.10 lacs but he insisted that he would wait for a buyer with 8.5 lacs. I told him i didn't mind stretching upto 8.3, he sent me a sms with his bank details and told to transfer Rs. 50000 as token amount. I didn't transfer the amount and told him I will come with my mechanic and evaluator. He replied saying that he already found a buyer for 8.4 but I was free to come with the evaluator.On the 7th of May, my evaluator checked the car and we okayed on the deal at 8.4 lacs. I transferred a amount of Rs. 40000 through net banking as the token amount. At the same time, I told him my loan will get processed soon and I will take the delivery in couple of days especially as it was my birthday on 11th. He kept quiet. The ODO read 45564.3 days later my loan amount got disbursed and I called him to inform the same and to start the car transfer procedure. I told him we can go together to the RTO office the next day to get the NOC. He told me to wait on the payment as he wanted the money into two different accounts. The next morning I called him, he didnt answer, so I went to the RTO, got the form and visited him. He told me the car was hypotheticated to the bank. I told him, I will transfer the amount now, and he can close the loan account. He refused saying he has already spoken to his bank and will handle it. He also refused to initiate the RTO NOC procedure and insisted that he wanted the car till the end of the month. I told him lets start with the process, either RTO or loan, but he straightaway refused. I requested him to give it sooner, as I would loose nearly 1 months warranty and insurance and my EMI's had already started. He refused again.My friends told me he might be shipping around more buyers for the car. As this had caused so much trouble to me personally, I called him up and told to return the token and that I was no more interested in buying his car and would rather buy a new vehicle. He abused me over the phone. My brother too called him to reason with him, but he was in no mood. He is now refusing to give me back the token amount.Yesterday he messaged me, that I have only two options. Buy the car from him at the end of the month / Find him another buyer at 8.4 lacs Else he will deduct his Car loan EMI and whatever loss he incurs from my token amount. Please help. What are my legal options?