1. Yes, having sex with married lady is offence u/s 497 IPC and your husband would lose the job if you lodge complaint. 2. If your husband is not repentant or does not reform himself I find no reason why you should continue this relationship. 3. In that event lodge fresh complaint of torture and adultery and let him face the rigours of law once again. 4. Apart from fling those case do apply for your maintenance as well.