Am I being totally selfish?

My boyfriend and his parents are very estranged. He lives with his dad but they never speak. His mom left when he was younger. Latley he has been telling me he wishes he had more regular parents. I encouraged him to cantact his mom. He did and they hit it off really well. He goes to visit her almost every weekend. I am really happy for him but now I don't get any time with him. Am I being selfish for wanting to spend time with my boyfriend?