When I first looked into it I found that Centaur Forge has very good prices on equipment. They also hold classes/seminars throughout the country.
Your best resource for farrier and blacksmith supplies
For an anvil, go around to farms and see if they have an old one they want to get rid of.
I used to work with a guy that had his eye on one at a farm where he stored wood that was drying after he'd milled it. The farmer told him he could have the anvil if he could get it into the back of his pickup truck without using a crane. He said he couldn't even tip the pedestal the anvil was on because it was so heavy.
for less expensive anvils for small work you can always ask around and see about getting a section of rail road track. That is plenty hard for smith work.
E