The Most Reverend Justin Welby had faced growing pressure to go following the publication of a damning review.