In his latest confession, James revealed that he and his wife played the numbers game, where couples tell each other how many people they've slept with.
He told The Sun: "Chloe claims that I’ve slept with 1,000 women.
"My wife and I did the numbers game and I was having absolutely no part in it.
“Instead I said the standard response of 12 — no more, and no less.
"All that stuff, it’s completely irrelevant. Do I need to go into the minutiae of details of the past? No."
He also hinted that Chloe is a fan of watching porn, despite her claiming that he watches it every time she works out.
Chloe said: "It’s true. He watches porn when I’m working out."
James replied: "Whenever she goes to type in YouTube on her phone it comes up YouPorn, so put that in the newspaper."
The pair have always been open about their sex lives, with Chloe revealing earlier this year that James always wants to have sex in the afternoon.
Talking on their new Couples Quarantine with James Haskell and Chloe Madeley podcast, she revealed: "He will only now have sex in the afternoon when I work, train, cook, clean.
"We are in this weird situation when I have to give up time professionally, personally, domestically or it doesn’t happen. Which I think is unbelievably unfair on me."
James replied: "At night because I work quite hard in the day, I train, I am getting older, my body is pretty battered."
Meanwhile, James also revealed to The Sun that the pair have discussed having children for the first time during the coronavirus lockdown.
James said that Chloe was "previously undecided" about having a family, but seems to have changed her mind during the pandemic.