Yea, remove the warming and you don't have the warming.
Of course it should.
Are you up for some learning? It was only yesterday you found out we are in an ice age. Would like like to learn more about geology, geophysics and physics?
It's not warming anything out of the ordinary during an interglacial.
Have you read any of the IPCC material on our current interglacial period?
There are some really good things to discuss if you're up to it. It will probably give you a much wider scope on our planet and climate over time beyond the last 40 years.
Read up on the IPCC's way of explaining the rise and fall in temps, the retraction and regrowth of glaciers then read up the interaction of the magnetoshere and the magnetic fields generated by both ocean and atmospheric currents, changes to the dipole system, other sources of ocean acidity and then perhaps you'll see the big picture.
It would be refreshing to have a proper debate that is based on facts, geophysical systems and geological time the way long term climate needs to be discussed.