I think using the tax system to control money supply is probably the best solution there is. Raising interest rates in of itself is inflationary. After all, inflation is simply getting less with the same buck, if your mortgage rate went up because you were lucky enough to have to renew right after the "inflation controlling" hike, cost of owning the same home just went up. Interest rate hikes feed inflation, which in turn could lead to further increases.
The other part of this, with the taxes going up to slow things down, you can pay down some of the debt, which reduces the debt costs, allowing the government to do the same for less tax requirement. And if it reduced spending, which should happen in a heated economy (less social/corporate assistance), then the impact would be greater.
But if they must stick to the old doctrine, then how about the bank of Canada opening branches all across the land, and let them be the creators of money in this country, not the private banks. Then the billions in interest charges would go to the Bank of Canada, who in turn at the end of its fiscal year, passes its profits on to the Canadian Government. Just imagine if the Band of Canada lent the Govt of Canada funds, the Bank of Canada would have earned over 28 billion last year alone. And yeah, I know, OMGoodness, that's not possible. Why not, the charter banks lend money they don't have. They create it. They don't even have to hold any real money in reserve any more (GOC eliminated that need in 2006). But don't take my word on this, look it up, BofC explains the whole ponzi scheme on its site.
But back to this notion of using tax instead of interest rates to control the economy. Imagine, if you were a business, and were going to make an investment, you would have a good idea what the interest rate would be over a long period of time. Also, to get foreign investment, the country would be forced to manage its affairs better, making the country a country of choice for foreign investment; higher interest rates only garner temporary investment which shifts to the next country offering a better rate. Keeping the dollar volatile.
One thing is for sure, interest rate manipulation is not the answer, it is flawed, just ask the US who only this year ended quantitative easing (printing money to increase supply) because interest rate manipulation did not increase money supply. Whether anyone supports the tax system as a control point or not, the present system is ineffective, and too imprecise.
And finally, why, if we want to take money out of the economy, should the banks get it, why not the government?