While staff cuts and retirements are taking a toll, many of the departed staffers say there’s a deeper reason.