While Xhaka is new at Sunderland, Ballard has been with the Black Cats since 2022 and was a key player in last season's promotion.
Prior to his move, he did not make a senior appearance in three seasons with Arsenal.
Now a Premier League regular and Northern Ireland international, Ballard said he didn't have the easiest pathway into professional football.
"I wasn't really the best player in my age groups and stuff," he added.
"I had to fight for every opportunity and every chance. It wasn't smooth sailing, but coming up at an academy like that [Arsenal's], there's so many good coaches and so many people to teach you things if you're willing to listen and learn.
"You can start a career out there for yourself, and I've managed to do that."
'I've learned so much from Le Bris'
While both Xhaka and Ballard have impressed with their performances, the club's boss has received a lot of credit too.
French coach Regis le Bris joined in the summer of 2024 and his tactical nous has been key to Sunderland getting impressive results - winning at Chelsea, drawing with Premier League leaders Arsenal and reigning champions Liverpool at Anfield, and overseeing the win against rivals Newcastle.
"He's been amazing for us, a really good fit," said Ballard.
"It was a really young team last year, but the way he plays and sets things out so simply [is key].
"He knows exactly what he wants, and he'll tell you exactly what he wants, and there's no beating around the bush, he's always coaching you.
"I've learned so much, probably more in the last year of my career than all the years before that.
"He has got us playing really well this last year, and he's made us a really strong, competitive team."