1. Well, if you wish to now handover the remaining to be finished which is not a good idea though, you will have to first cancel the agreement , pay the penalty , if there is such clause and then engage a new contractor on fresh rate of work.
2. Since the present contractor has done half of the work and not much payment id needed to be paid , it is advisable that you continue with the same contractor. This would save your money and litigation as well unless he is ready to quit his work.
3. So talk to him and make a supplementary agreement fixing a fresh firm date of completion and penalty clause if he fails to complete the work. However if he is ready to quit the work and handover the site and you have no issue to u=incur extra cost then take it back and engage a new contractor after getting a cancellation agreement from the previous contractor.