In the end, Harvey didn't go to Mandy's home. That was because when he was on his way back, he received a call from Charlotte.
There had been some complications regarding his battle with the Shinto Way from the Island Nation at the Apex of the Forbidden City. He needed to go to the Martial Arts Alliance's Songstress's Stage to deal with it first.
Originally, Harvey didn't want to waste time speaking with garbage from the Alliance. However, Charlotte made things sound serious. According to her,