The man said his health meant that his partner had to drive him to his appointments in Palmerston North, which resulted in the loss of working hours for his partner.
The man said he had received excellent care at both hospitals, and had no complaints about the services themselves.
"But I am seriously concerned at what seems to be delocalisation by stealth of yet more services at Whanganui Hospital."
Tracey Schiebli from the Whanganui District Health Board said while Whanganui offered a urology service - including regular urology clinics staffed by specialists from Palmerston North - the more advanced urology care was only offered by MidCentral DHB.
"Many of our patients travel to Palmerston North for certain tests, outpatient appointments and complex surgery," Ms Schiebli said.
She said there had been a high demand for urology services in Whanganui, and there was a need for more resources across both DHBs.
"Our two DHBs are working together to secure additional specialists, however this is not easy to secure across New Zealand as a whole."
Ms Schiebli said the Ministry of Health had recently introduced a new target for district health boards, around timeframes for treating cancer. This target is one of six that the ministry requires all DHBs to meet.
"[This new target] means that the DHB often slots patients into the first available appointment, and sometimes this means travelling to Palmerston North," she said.
"Even with additional resource, many people will need to continue to travel for some types of treatment. We are mindful of the burden this can place on families, and are giving consideration to transport options," Ms Schiebli said.