Finalized adoption

I adopted my granddaughter from Oregon 3 yrs ago, I live in California. I fostered my granddaughter for a year under the supervision of CPS in California. During the process to become her foster parent, cps notified me that I could not live with my boyfriend, whom I had been living with for 5 years because he has a felony DUI from years before, and a neighbor told them that we drink and fight. I moved out of the home and now have my own home. the adoption has been final for more than 3 yrs, and my boyfriend stays at my house about every other weekend. CPS is now telling me that he cannot be there. I am also the caretaker of my 88 yr old dad, and my boyfriend is a major help to me to maintain the house and the 10 acres I now own. I cant live there by myself with my granddaughter and maintain everything. Also Jerry (BF) has never disciplined my granddaughter, i insist that is my place, but he has backed my be saying "you better listen to your grandma". It is our plan that when my dad passes away that Jerry will move in with me. I am 62 yrs old and my granddaughter is 12, and becoming a teenager and i really dont think i can manage until she is grown by myself. Can CPS tell me who I can live with once the adoption has been final for so long?