The 'poles' according to what? The crust carries a magnetic signature of the magma when it left the core rather than what magnetic field it was passing through just before it cooled. The oceanic crust is 200M years old, the Continental Crust has a few spots that go back almost 4B years. The core has not changed it's alignment to the sun, let alone done complete flips. Magma was free to float around as a liquid for billions of years before any of it cooled, the size and speed of rotation would have made the earth a big centrifuge where the liquid rock as sorting itself by density as well as magnetic orientation. Magma coming from the core should carry that orientation while the magma that will return to the core would lose any magnetism it carried.
There are 40,000 miles of oceanic rifts that are spreading to any changes it where the continents are going is based in the spreading rather and that is based in the temp of the rising magma, hotter or cooler is the only change it ever makes
If the core has a stable spin and only the crust portion is wobbly then the wobble was introduced after the core had a stable spin(without a doubt). The moon is large enough to create a wobble and modern astronomy software could figure out what the orbits would have hat to have been like.
I would even suggest a large portion of the moon's metal core left the moon and rained down on the earth in a way that saw one location get about 90 of all the material in one event and by the time that heavy material sank to the core the wobble had been established. If the core is also wobbling then it will never recover