Jump to content

rtos precision misbehaving.


JamCAD

Recommended Posts

I'm not getting the expected result for rtos. It is removing trailing zeros even if I "force" a precision???

(rtos 380.00 2 2) returns "380" not "380.00". I'm thinking it must be a system variable?

Link to comment
Share on other sites

I'm not getting the expected result for rtos. It is removing trailing zeros even if I "force" a precision???

(rtos 380.00 2 2) returns "380" not "380.00". I'm thinking it must be a system variable?

Explore DIMZIN sysvar.

Link to comment
Share on other sites

I'm thinking it must be a system variable?

 

Set the System Variable dimzin to zero or set it to zero and reset it back in your routine .

Link to comment
Share on other sites

Thanks all. I was coding on my laptop while traveling so didn't have normal access to my research options (I.e. Google). Posted on my phone thinking I would get the quick response I did :-). Lee, later after dimzin was mentioned I googled "rtos dimzin". I will give you three guesses as to the first page I visited...

Link to comment
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Unfortunately, your content contains terms that we do not allow. Please edit your content to remove the highlighted words below.
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

×
×
  • Create New...