That is the opinion of former Red Devils star Paul Ince, who believes the midfielder has been nothing but problematic at the club.
The Frenchman has had a rollercoaster few months after contracting coronavirus.
Upon recovery, Ole Gunnar Solskjaer started him in United's opening game of the season against Crystal Palace, which they lost.
Pogba made the XI against Brighton the next weekend and on both occasions, he looked off the boil and was hauled off.
The World Cup winner was also in the line-up that was thrashed 6-1 by Tottenham and he was heavily criticised.
It saw Solskjaer take him out of the firing line and he was a notable absentee against Chelsea and Paris St-Germain last week.
And Ince believes it might be time for Pogba to leave Old Trafford after years of rumours.
"Paul Pogba should be on the pitch (against Chelsea), this is a big, big game," Ince told beIN Sports.
"For him to be sitting on the bench and watching, with no disrespect, McTominay and Fred playing in his position, I would be saying, 'I must be doing something wrong if I can't get in this team'.
"I know he has had an injury and he might be trying to bring him on a little later on.
"But I think it is time to move on. He has come out in the last two weeks and said he wants to join Real Madrid.
"I think his performances since he has been here have been inconsistent.
"Paul Pogba is a world-class player and when he moved to Old Trafford I thought, 'great', but all he has done is been a problem.
"The fans have gone against him and now Bruno Fernandes has come in and shown what you need to do to be a Manchester United player.
"He has performed consistently and Paul Pogba hasn't done that and that is why he finds himself on the bench."
Pogba made comments earlier this season about his dream to join Real Madrid.
Shortly after, United triggered a clause in his contract that extended his deal another year - meaning it will now expire in 2022.
However, BBC Sport insist that a decision to enact the extension was made before Pogba's controversial comments.