Jacob Rees-Mogg, who is in any case quite likely to lose his own seat, is never going to secure enough nominations to get on the ballot for Leader of the Conservative Party. The same is true of Boris Johnson, who has already tried and failed once, and whose seat is also now within a hair's breadth of turning red.
Since Gavin Williamson continues to control the Whips' Office, he will be the only candidate when Theresa May stands down. If that did not happen until after the next General Election, then Rees-Mogg and Johnson would very plausibly not be there, anyway.
These are simply the facts of life.