When you are trying to pull the charging handle to the rear, the charging handle has to clear over the top of the stock system, and the bolt carrier has to go rearward into the buffer tube (Receiver extension).
So first make sure that there is nothing obstructing the charging handle from going rearward.
If the receiver has a collapsible stock, there is a locking plate (Some people swap these out for a sling mounting plate), which this plate butts up against that back of the lower receiver and is pushed forward by a spanner nut (Sometimes referred to as a castle nut or lock ring), the charging handles must be able to move freely over the top of this plate when you manually cycle the action. A simple check for this is to remove the bolt carrier assembly, then leave the charging handle in the upper receiver by itself and close the upper & lower receivers and pin them, then try to manually cycle the charging handle rearward and it should be freely and easily with no resistance as you manually cycle it over the top of the locking plate.
If the charging handle clears the locking plate, then I would check to see if the bolt carrier is in proper alignment with the buffer, as the bolt carrier needs to go rearward into the buffer tube. Without seeing your actual set up, I am guessing, in theory the bolt carrier should properly align so it can go back into the center of the buffer tube, but since you have a mix of brands it is something to check to see if something is not aligning correctly.
CY6
Greg Sullivan "Sully"
SLR15 Rifles TheDefensiveEdge.com(763) 712-0123