“I'm the nominee of the Democratic Party. No one's pushing me out. I'm not leaving," he said in a call to the broader campaign