Annotation dimensions distance vary between viewpoints

Not quite sure how to explain this so I've enclosed a couple of picture aswell. I'm doing my first 3d cabinet and now I'm trying to add the dimensions to the drawing. On the default viewpoint it working like I anticipated, att: help1.png . To add the dimensions in another plane I'm changing the viewpoint (view -> appearance -> left) and again choosing liniar dimension etc., att: help2.png.

But when i change the view the new dimensions are far away from the design, att: hekp3.png. Any suggestions to how I fix this so everythis is relativly close to the design?

I've already tried checking whether any layers was frozen and tried selecting all the dimension and using the "Synchronize multiple-scale positions"

Thanks in advance!

Either reset your UCS origin or try using the Dynamic UCS feature.

Thanks! The result isn't pretty in my case, but I made it work