Regret for working?

I got a job and I'm pretty happy. My husband did not want me to work because he believes children need a stay at home parent. After many months of fighting he gave up and here I am back to work. Last night, he told me that I will regret my decision because they grow up so fast. He says I'm a little selfish because we don't need my income. He wanted to stay home at first but after I left the kids with him for 2 days and it changed his mind. He doesn't want to stay home anymore and his excuse is children need their mother more. Do you think I will regret my decision ? I like this job and nanny only cost 20% of my salary so it's a win win situation. I admit I don't see them a lot only on the weekend but then I enjoy every minute of it.

I don't know that I would quit if we could afford it, I would probably just work less often. I miss the hell out of my little guy when I am on a 3 day (12 hr shift) stretch. I am acutely aware of how fast he is growing up and that I am missing part of it.