I think it has to do with the Concentric/Coincident(Holes) Constraint. Hence, it turns 180 degrees and inverts the axis direction when you pull the part in particular fashion.
Probable Solution: Try mating any 2 contacting surfaces (sliding in this case.)