Have you been served with a notice to pay the defaulted property tax.
If so you can find the details in the notice itself that from which period are they levying this tax.
If you have evidence for the date of construction of the said temporary structure over your terrace, you can produce the same and deny their claim and issue a legal notice to the authorities concerned denying their allegations as well as follow it up through legal course of act in furtherance.