Advice on having a baby in my mid 40s?

Had my son in my mid 20s and left his Dad at 2 after he was super abusive towards me. Raised my son alone and my mom always shamed me to not date because it “wasn’t in the best interest of my son” so I would just tell people I didn’t like kids and wasn’t having more. Fast forward I’m 42 met a wonderful man who is looking for marriage and kids but he’s hesitant about my age. I thought and it and actually got excited about the idea of a husband and kids but then feel bad for my 18 year old son like I’m starting over while he goes to college in a year. I was complaining to my friend about these cats I’m fostering that are pooping and peeing in my house and destroying my carpet and she said if I’m complaining about cats I shouldn’t be trying to have a baby. That made me feel bad. I also have PCOS. So advice on those of you who had kids in your mid 40s especially with adult children at home?