Since you know that it is a government area encroached by the previous owner, hence it will always be a problem especially if the neighbors are envious about your purchase then they may create problem to you by making a complaint about this encroachment to the authorities concerned. At that time the authorities may swing into action for demolition.
There is nothing wrong in renovating the shoddy interiors but you can decide to leave the encroached built up area as it is without touching it and keep enjoying it for now at least for another couple of years so that you will become a familiar person with your neighbors hence you may not face problems with the neighbors until you disturb them.
Whatever you may consult an advocate in the local and take his assistance over the proposed demolition or any other aspect that you think of carrying it out now.