You are correct. Without intimation and without your consent the builder can not build and hand over which not promised in the agreement.
You can opt to go before the consumer court or to the RERA authority for appropriate reliefs.
You may have to provide documentary proof like sale agreement, allotment letter, email correspondences, payment details, etc.. so to prove your case.