For the task bar, try the different configurations, i.e. height and location on the screen. (You can drag and drop it to the sides or top.) Also, "alt-tab" on the keyboard will pop up a box that has the icons for the running programs in it, press repeatedly to find the one you want and "enter" and you can switch fast. I know of no way to re-organize open windows. Sorry.
Windows 7 has the "hover over button on task bar and show me a thumbnail" function to help you find windows.
For the caps lock, just pry the damn key off the keyboard. You won't hit it accidentally then. It will still be usable with a fingernail or pencil or something. But, once you do that you learn pretty quickly how to type in all caps without the caps lock. It's a throwback to typewriter days and should be discarded.