Refund of token money

Dear sir I have given token money of Rs 1 lac for booking resale flat of 1 bhk to seller, through broker on 14th May 2019. The flat is in Bhandup location, Mumbai. Total flat cost agreed was Rs 95 lacs with bank loan portion of Rs 80 lacs. However, after approaching bank, I have been told that only Rs 73 lacs can be sanctioned based on valuation of that property. Meanwhile, my grandfather is also hospitalized wherein there will be angioplasty operation hence I require money as of now. I conveyed the same to seller on 28th June 2019 and both brokers. They told it is you who backing out and hence refund of Rs 1 lac can not be given back. I have given Rs 1 lacs by cheque as per MoU on letterhead of broker signed by seller and me. The seller is saying he has moved to rented house considering that i will purchase his house by June end which we were targeting initially (not in writing anywhere). Both seller and brokers are together and told me to take whatever action possible. Please help in the matter. How should I recover this initial token amount? Can I approach police in this case.