To exit the Partnership, you need to resign. You can resign from the LLP as a result of which the LLP would stand dissolve unless a new partner steps in before your resignation.
Post resignation, you'll have to make a paper publication in this regard.
There's no way you can shift the burden of filings etc. On the shoulder of the other partner. He's responsibility as much as you for ensuring all these compliance.