It's still public money of course but it's about how a business looks at costs and the way a bureaucracy does. There is a hell of a lot of waste in government and most of it is needless. Again, not saying I endorse privatization of prisons, there are a lot of considerations besides financial costs.
It's public money that the private companies are making a profit on.