Depends...are you buying everything new? I have 5 pressure canners, all pre-owned, all work as good as new, and the most I paid for any of one them was $80 (what I paid at an estate auction for an All-American that was like new...they are over $200 brand new), and two of the five canners I have were free. Most of the jars have been either handed down from grandmothers or picked up free/cheap at freecycle, yard sales and auctions. Quart jars new run about $10 a dozen, but you can often find them cheaper at end of season sales, but be forewarned...the new jars aren't as thick/heavy duty as the older ones (Wmart's Golden Harvest brand are especially thin), and as such I've had a couple of the new ones break during processing, so I would get the older jars if at all possible. The lids (flats) and most of the rings I do purchase new, however. In saying that, I'm considering going to Tattlers, which can be used over and over again.
http://www.reusablecanninglids.com/ Although the Tattlers are a bit pricey initially, they will be cheaper in the long run if you plan on canning year after year.
For my water bath canning, I simply use my stock pot (place a folded thick dish towel in the bottom in lieu of a canning rack) or if I am doing juice in half gallons, hubby's turkey fryer.
If you get a pre-owned pressure canner (personally I would do this even if I were buying a brand new one), be sure to take it by the county extension center and get the gauge tested before ever using it. You should periodically get the gauges tested anyway. And if needed, get a new seal/gasket...you should be able to easily find at your local farm and home supply store (Ace Hardware, Tractor Supply, etc.). But even if the gasket on the one you get is ok, it wouldn't hurt to pick up an extra gasket, just to have on hand.