He found him not guilty of all three charges on that basis.
The judge said an assessment of the evidence was sufficient to show the man "had caused the events" on that day.
Many locals have demanded the respite care unit be moved away from the nearby school.
The girl's father said on the day of the attack he was walking his daughter home from kindergarten when the man began following them. The man tried to lead the daughter away and became aggressive when the father intervened.
A neighbour had to run out and grab the child while the father tried to fend off the attacker.
The man has been remanded to August 3 for a decision to be made on what to do with him.
He is currently on bail.