Cabinet minister rules out summer snap general election after party's dismal results