Each year, Age Concern receives more than 1000 referrals about people who may be facing elder abuse or neglect; about four referrals every day.
Grey Power and the Aged Care Association see an aged care commissioner as one way to rein in financial abuse of the elderly and Mr Patterson supports their call.
"I only got involved in doing this work because I got more and more angry with stories of family ripping off their parents.
"It's all done very smoothly and without any fuss but I know of cases where houses have been signed over to the person who had enduring power of attorney.
"The kids see mum or dad has reasonable equity while their own state is a bit tight."
He cited an example of a elderly man who had significant property investments around the country worth several million dollars but whose children had been pestering him to sell up.
The man had spoken with companions in the rest home and they suggested he contact Mr Patterson.
"It was obvious the kids could see a lot of money in this but their father did not want to sell," he said.
The children were upset with Mr Patterson's involvement but the outcome was a resolution everyone was happy with. It meant the father retained the properties but dividends from them would be shared among the five children.
"He kept his principal and the kids got some cream," Mr Patterson said. He does not believe many people understand the pressures some people are putting on their parents.
"Unfortunately, there are a lot of families who prey on their elderly parents."
Grey Power president Roy Reid said the number of cases of elderly people being financially abused by the very person who is meant to be acting in their best interests is "unfortunate".
He said an aged care commissioner should have the powers to receive complaints on financial abuse, investigate them, and if required take legal action through the courts.
"As the number of elderly people is increasing, the cases of elder abuse will rise.
"We cannot just sit back and hope the situation will go away, we must do something to protect the most vulnerable elderly people."