You want to move the sights in the direction you want your point of impact to change. If the shot is low and to the right, then you will move the adjustments up and left. In the scope or red-dot, the aiming point will actually move in the opposite direction. If you use the method mentioned above where you have the rifle secured in the rest, as you move the adjustment up, you will see the aiming point move down.
Again, the adjustment arrows (up, right) indicate which direction you want the bullet placement to move, not what actually goes on in the sight.
Irons, are a different story, however.