Why are you worried about the front sight being canted? If you can't see the cant, it doesn't matter the direction, it probably isn't canted.
Does your build have an A2 style front sight base, or a front sight on a rail? If it has a FSB, take the upper off the lower and place it upside down on a flat surface. If it rocks excessively, or leans to one side, the FSB is canted too much. Many are canted some, but it doesn't matter. If it is on a rail, the rail may be crooked.
Which barrel did you use on your build? What kind of barrel nut did you use, and what did you torque it to?
Which upper receiver did you use? You may have to face the receiver to make it true. I had an FN upper that took almost all the adjustment to one side to zero. I took it apart, sanded the face of the receiver on a smooth surface and it only required 3 or 4 clicks to zero.