Need Help! 2D HS REST MILL WONT RETRACT AFTER FIRST DEPTH

I have gone around my part with a 2" shell mill. I now want to perform a 2d high speed rest mill with a 1/2" em to peck out the corners. I have depth of cut set to .475, and on the first depth of cut it retracts before going to next corner. But the next 2 depths, it doesnt retract and runs through the part. I have been messing with my parameters for 30 mins now, nothing seems to be helping. Thought I would throw it up here to see if anyone might know the answer.

Thanks,