You may be correct; I find in the Quran that God punishes the idolaters (also Jews, Christians and others on account of their disobedience) by many ways: one of them is to let them fight each other.
Had He willed, they would not have fought each other, but God does what He wills.