I think that even if Peter had lived up to being the BOY that his father wanted, the only Powerful King in that house could be the father. A tyrant that wouldn't give up his role for anything.
Peter was powerful in the face of being cast out, he would still go to his true self if only in private at first.