"I have this picture in my head, of just me in a field with my kids and Ed Sheeran's kids and we're just hugging each other and picnicking and getting drunk."
The crooner – preparing to head on another world tour later this month – said he often has to remind himself how lucky he is if he is not "feeling" his work.
He added that the idea of becoming a full-time dad was a "fantasy", with few people "brave" enough to make the choice.
Bublé said: "I don't know a friend who doesn't have the same thought, I mean we never do it. We never seem to really do it, very few of us are brave enough to say, 'No, I just want to do this', but I think it's a fantasy."
He took two years off when his eldest son Noah was diagnosed with liver cancer in 2016, before the boy made a full recovery.
Bublé also claimed he would have been more successful if he had not started a family, and thinks about what could have been 'all the time'.
He admitted: "You can't do both successfully. Relatively, you can have success, but I think one always suffers.
"It's funny, if you talk to my manager, he's a beautiful guy, but he's managed a lot of big careers. He'd say flat out, 'If Bublé didn't get married and have those kids he'd be a bigger star, easily, truthfully… my manager always says to me, 'It isn't tough to make the decisions. kid, it's tough to live with the consequences of those decisions."
Bublé and Luisana got engaged in 2009 and were married two years later, in 2011.
In February, she showed her latest growing baby bump in his new music video, 'I'll Never Not Love You'.
Luisana said on Instagram after having their fourth baby: "From love comes life, light and her... our baby Cielo Yoli Rose Bublé. You finally arrived to our lives with your 3,8 kg!!!
"Thank God for this infinite blessing, we love you!! Noah, Elias, Vida and your mom and dad."