‘There’s a mild hysteria in the news about everything at the moment,’ says cabinet minister as rumours swirl about Starmer leadership challenge