Perfectly Good Guitar
I picked up a Fender Squier (made in Indoesia) electric a couple of years ago for $99 (included shipping). I play it as much as I play my strat and PRS. If they are still available I would suggest you check it out in a local store and see if you like it. Just because a guitar is inexpensive doesn't mean it's not good. It doesn't come with a case so you can expect to spend about $40 or so for a decent hard case.
Amps
All my guitar playing friends swear by tube amps but they are expensive and I personally think a beginner is much better served by a solid state amp.
Money for Nothing and Amps for Free
HOWEVER, if you own a computer, you don't even need an amp for practicing. Buy a USB adapter for your guitar and plug it into your computer and start up Garage Band. GB has modeling for a bunch of amps and stomp boxes you can play with. You can connect some external speakers (or headphones) and have a blast (I know from experience) at reasonably low volumes. It will also teach you about amps and effect pedals. You'll probably find you won't need an amp until you want to jam with friends. The volume from your mac won't keep up with those Marshall stacks they own. Also GB works on the iOS but I haven't tried that yet, but if you have an iTouch, iPhone etc you might see if it has the same features for guitar.
There is similar software for PCs and even Linux.