A lawyer for Sean "Diddy" Combs says he wants to quit the defense team in the hip-hop mogul's sex trafficking case.