Extra money taken as Rent by Fraud person

Hi, I've been living in the current house since May,2018 with 2 more people. One of them lets say X has been running a scam by telling us wrong rent amount of the house. The actual rent is Rs.23000. X has told me that rent is Rs.33000 and has told the third roommate that rent is Rs.36000. So I've been paying 11000 and other guy has been paying 12000 summing upto 23000(whole rent). The fraud guy has been staying here for free. I've also paid a deposit of 40000 and other person has paid 30000. When asked about the rental agreement, he said there's no rental agreement as this is builder's house. But X has made an agreement with the actual owner stating 2 more people along with him will be staying. X also told us that there's broker involved in between and has taken 10000 as brokerage from each of us. Recently we got to know from owner that no brokerage was involved as well. To resolve the problem both of us along with owner had a discussion with X to return the money and owner has given a notice of 3 months to him. X said yes to all in front of owner. and later X is telling us "If I was not asked to vacate then I would've returned some of your money, now that I've been asked to leave, I won't be returning a single rupee. you do whatever you want". We both said that in that case, we'll not pay the rent for next 3 months. Now he is threatening us that he will deduct the rent from our deposit amount and will return the remaining. What are our options now? and how should we proceed? Note: As legal document as all we have is online money transfer statements.