Manhattan’s U.S. Attorney Geoffrey Berman, who is investigating President Trump’s key associates, is refusing to step down, hours after the Justice Department moved to oust him.The standoff comes as a new book by former White House National Security Adviser, John…