In most states, powder can be purchased almost anywhere reloading supplies are sold. There are exceptions like the crap-hole I am temporarilly living in. This city (western NY), and 8 cities around it, don't allow the sale or possession of smokeless gun powder. Five of those cities also include primers. --Yet, they still allow the more volatile 'strike anywhere' matches to be sold.--
Gun haters.
For $600, you can get one of the lower end aluminum starter kits, and quite a bit more.
Or, you could pick up a forged/cast iron press for a little more money, and never worry about it again unless you want to upgrade to a progressive press.
Since you are planning only to reload a single caliber right now, a single stage press is probably best.
As for specific press recommendations...
It really comes down to what you think you'll need and want.
Reading as much as possible about the different presses, and reviews from owners should help you decide. Look for the reasons people do, or do not like a particular product.
I like the Redding and RCBS single stage presses for their strength, design, and longevity.
In my opinion, the RCBS Master Reloading Kit is also the best value for your money. The key point for me, is the higher quality powder measure, and scale you get.
My thoughts on a few of the accessories I have used, that come in common kits, but I feel should be replaced:
RCBS Master Reloading Kit -
Priming tool - I hate it. The tolerances make it feel cheap and poorly engineered, the primer tray cover barelly stays on the tray, and I don't like the way the tray is just jammed into the main assembly to hold it in place. I use it, but will eventually get my own Lee Auto Prime.
Hornady Lock-N-Load Classic Kit -
Powder scale - I have used 3 of these scales. None of them held their zero between charges with low weights. (3 to 20 grains) When using check weights to verify, they could be off as much as 10% - after just giving a reading that was right on.
Lee Challenger Kits (several varations) -
"Perfect" Powder measure - To begin with, it is plastic. I don't like plastic. Ball powders tend to find all possible leaks, and exploit them to their fullest. Flake powders work their way into the cracks and require a thorough cleaning afterward. Lastly, it was such an irritation to throw a charge, we gave ours to the kids to use as a crayon holder.