But he soon discovered the feeling was mutual.
"They couldn't figure out why I had trouble with them; they said all white people looked identical to each other."
By the time he returned to New Zealand this year, his brain had adapted to pick up differences.
He told the Herald he was keen to continue exploring the science of face perception - to which he last night devoted his inaugural lecture - in his new role in Auckland.
"It's a big topic, and over the last 20 years with globalisation, it's an experience a lot more people are having."
For most of us, he said, seeing was effortless - we opened our eyes and the world was instantly available.
"But the ease of the process belies its complexity, and we are only just beginning to understand how the brain creates our visual sense of the world."
No matter where we come from, our brains are trained to distinguish the features of those we surround ourselves with.
But if those faces are from one ethnicity, then we become overspecialised.
This was particularly noticeable when travelling to countries where the culture was unfamiliar.
"These people aren't more similar to each other than the ones we are used to, but our visual system doesn't know what to pay attention to."
There was also an aspect of social psychology at play, as the brain could automatically group people of other ethnicities together.
"So it's kind of a mixture of how you view, but also the way you think about the person you are looking at."