Victoria’s premier says honouring the controversial clergyman would be distressing for abuse victims.