River priest has been removed from ministry after credible allegations of sexual misconduct involving two parishioners.