When just starting out, a wooden waster or synthetic trainer can be a nice inexpensive way to get started.
Purplehart Armories has a good selection of both, and makes what is probably the best synthetic trainer on the market.
If you intend to hit people in your training, then I'd go with the synthetic and skip the wood.
If you decide to stick to it, or just want to go ahead and invest in something you'll use a lot longer, there are many options for steel weapons. In no particular order, some good selections are the Albion Meyer, the A&A Fechterspiel, the Ensifer Heavy, and the Darkwood Armory longswords.
The darkwoods are probably the cheapest of that list, and are very serviceable. They just lack some of the subtle cosmetics of the others.
Usually for gear I recommend working with your club first to find out what they recommend and prefer, but you can't really go wrong with the weapon choices above.
Hand protection is the hardest part, but you can get started with hockey/lacrosse gloves to do some light fighting or drills with.
A "3 weapon" fencing mask is the cheapest way to get started on head protection. Some companies (like Absolute Force) offer variants with built-in "back of the head" protection, or you can get one that attaches with elastic to a regular fencing mask. Various jackets and gambesons are out there, as well as elbow/knee pads, and so on, but again it's usually better to talk to the club you'll be training with first.
Our group doesn't have just one school up here. We all train separately across the DC region.