"People on the outside assume boxers are always so confident. Just because I won Olympic gold, they think I must be full of myself – but that's not true at all," Yafai tells BBC Sport.
"There are times I think 'I can't do this' or 'I might lose that fight'."
Yafai believes facing those negative thoughts head-on can neutralise their impact.
And it is this level-headed approach that may have helped the 32-year-old reach the pinnacle of amateur boxing with that Olympic title and now puts him on the brink of global honours as a professional.
Ten years ago, the Birmingham native was juggling boxing training with working shifts at a Solihull car factory.
On Saturday, he returns home to defend his WBC interim title at the BP Pulse Live Arena against Mexican Francisco Rodriguez Jr.
Victory could lead to a unification bout with WBA and WBC titlist Kenshiro Teraji and Yafai would not hesitate in travelling to the champion's home turf.
"I've got a good connection with Japan - I won Olympic gold in Tokyo," he says.
"Going back there to fight a world champion for a unified title would be incredible. I'd absolutely be up for it."
