The former EastEnders actor says time goes so fast and he wants things to slow down at times.
He admitted that while his and Stacey's son Rex is only one, he's already missing the baby stage of fatherhood.
Joe, 38, said: "I look at photos of Rex, like, literally a year ago, and he was a tiny, tiny little baby and it just goes so fast.
"And now, he's like a little terror. He's up and down the stairs.
"He's in the cupboards. He knows where the chocolates are hidden. Like, he is on it. He's like a little grown-up. So, it goes so fast."
"So, yeah, I'm not gonna lie. I think I might have one more in me, you know? I'm getting a little bit broody."
Joe, who appeared on I'm A Celebrity... Get Me Out Of Here! in 2008 before winning the show, continued: "Yeah, I'm really starting to miss the baby period 'cause it does go so fast, and that is such a precious little time when the baby is first born.
Going into detail about raising his first son Harry from a previous relationship, Joe said he regrets not always being there due to the breakdown of his relationship.
Joe told Dave Berry on new podcast Dadpod: "With my first child, Harry, there was a period where mine and Harry's mum's relationship affected my relationship with him.
"I didn't get to see him for a period of time, so I missed out on quite a lot. Now, me and my son Harry, we spend all the time together.
"He's, like, my shadow. I love him, but there was a period where I just couldn't see this happening in the future. So, I did miss out quite a lot of Hal growing up, as a baby."
Speaking on Loose Women earlier this month, Joe stunned Nadia Sawalha by saying he thinks he has 'one more in him' in relation to growing his family.
Joe said: "The baby bit goes so fast but I just, I think I've got one more in me ladies."
Looking shocked, Nadia replied: "Oh dear, I've got an image there..."
As well as 14-month-old Rex, Joe and Stacey live with her sons Zachary, 12, and Leighton, eight, from her previous relationships.