Should I return the non-refundable rental token amount

I recently gave my flat for rent to a lady who was supposed to occupy the flat 17 days later. Before taking the token amount I did mention the token amount isn't refundable and also asked the lady to perfectly survey and then confirm if the location is suitable as per her requirement. I was in no hurry but the lady pleaded and I took the token amount. As I was leaving for a trip (out of India), we decided to make an agreement 20 days later. Then after a few days, when I was on my trip, I received a message from the lady that said she doesn't want to occupy the flat as the location is far from her working place & wants the token amount back. I replied to the lady that I had already mentioned her about the non-refundable token amount and to survey the area beforehand. But frankly, I decided to sort the matter on my return and refund the amount to the lady as she was in need. However, when I was on the trip, the lady started blaming me for being in a hurry and taking the money. I returned yesterday and the lady has filed an FIR against me. I explained the scenario to the police and he agreed. But what should I do now... The lady is threatening me. I faced loss because of her as my flat is vacant now. I want to return her the money but her behaviour retrains me from doing so. Please advise if I can take any legal action against her or should I just refund her.