I don't want to have words with you.

have words with sb. 是和某人争吵的意思是，多用于口语，表达地道。