They were frightened of his influence