I don’t think God divorced the old covenant. The old covenant came to its end, and thereby the relationship as well? Jesus only has 1 bride. A marriage covenant is binding for both until one dies.
The early church was consistently against re-marriage, and if you read The Shepherd of Hermas, he is explicit that this includes when the wife is unfaithful.
For some perspective on Matthew 19:9, I suggest considering the manuscript variants - check that here: https://bterry.com/tc2/lay03mat.htm
There are several variants there which read more like Matthew 5:32, which is not giving an exception at all.
Concerning Matthew 19:8-9. I think it would be valuable to consider what the disciples thought about the whole situation. Did they view it as an exception clause? Vs 10 I am sharing from the NKJV “His disciples said to Him, “If such is the case of the man with his wife, it is better not to marry.” I personally do not think his disciples viewed this as an exception clause
If you go to the "Topical Bible" here on this site and look up "Divorce" (I think) it has a pretty good discussion on the topic.