There's some good advice here but really you need to 1) slow down, and 2) run more.
It's a breathing think and you're breathing shallow and shorting yourself on oxygen. So when you feel that, slow the pace down and breathe deeply through your nose, out your mouth. Lean forward a tad at the waist to relax your diaphragm so you can take larger breaths. Take slow, full breaths. Keep slowing your running pace down until the side stitch goes away.
Once the stitch is gone, keep running to build aerobic efficiency and endurance. Again, don't be afraid to run what may feel too slow. You have to build up the breathing. Running training is the epitome of Embrace The Suck.
Source: I'm not super fast, but a fairly decent runner, 23 minute 5k and 1:50 half marathon. I run around 25 miles a week. The above is common advice shared with beginning runners, including myself when I started last winter.
One other thing: run on an empty stomach. Digestion causes stitches. Also don't drink while you run, at least for these short distances of 3-4 miles. You should be hydrated before the run and not have eaten for at least two hours (3 or 4 is better) before you go out.