Yes indeed, there are many other things to take into factor. Several of which you missed:
When there are warmer oceans, There are larger, but less frequent hurricanes. When they are colder, there are more, but less powerful hurricanes. Considdering the last big set of Hurricanes we have had...