I recommend getting a midi keyboard. This will allow you to write electronic music so much more easily than without. You don't even have to play it well as you can edit it down after playing it.
As for a DAW, I personally recommend Reaper.
For plugins for use with your midi keyboard, there are some amazing free plugins and virtual instruments to use online. Some websites I've used before:
http://www.dskmusic.com/
I HIGHLY recommend Amplitube. There's a free suite of amps, cabinets, and effects to use from the free version and then you can sample their amps, cabinets, and plugins on a timer once every few months. If something grabs your attention you can typically buy it for like $10-15 bucks. I personally own the Amplitube 3 pack, the Ampeg pack, and a bunch of Orange and boutique pedal stuff. I have been able to mimic my live sound with amplitube almost perfectly. There's literally no reason for me to go in to a studio to record any of my tracks anymore.
There are also tons of free plugins to be found for guitar and bass on plugin boutique.
For drums I use EZDrummer 2 (with the drummer from hell sound pack sometimes). It's easy to use, you can use customized or self written midi tracks, and the sound quality of the drums is actually decent. You can also set up your DAW to have each part of the drum be EQ'd and compressed or otherwise used like a normal set of recorded drums. The only issue I have with it is that it doesn't come with a midi writing tool. Although they exist (all DAWS have them and there are tons to find online), a customized one for the program would have been nice.
All in all, there's a pretty steep learning curve ahead of you. However, if you take it one day at a time, it will pay off immensely.
I personally use this stuff for writing samples and ideas for my band (or myself). More of a proof of concept thing, so I tend to keep the drums fairly simple. Here are some things I've done at 0dB in my small apartment using Reaper, Amplitube, EZDrummer, my guitars and my basses.