I cant figure out why photoshop sometimes shifts my pixel grid when I change image size to 200% and 50% for retina

My flow has always been to start at 1X and use image>image size>200% to get 2x and I flip between the 2 using 50% to get back to 1x.

But for no apparent reason, 1 out of 50-ish times it shifts everything off of my pixel grid into sub pixels.

Anyone else have this problem?