1. Try to settle the dispute amicably first by way verbal negotiations involving family elders.
2. if that yields no result then take legal recoruse,
3. Ask your brother to file a suit for restitution of conjugal rights in which suit he cal claim for visitation of the chilld.
4. The said suit would give you further protection in the event your bhabhi files any criminal case.