If you have a problem or need to report a bug please email : support@dsprobotics.com
There are 3 sections to this support area:
DOWNLOADS: access to product manuals, support files and drivers
HELP & INFORMATION: tutorials and example files for learning or finding pre-made modules for your projects
USER FORUMS: meet with other users and exchange ideas, you can also get help and assistance here
NEW REGISTRATIONS - please contact us if you wish to register on the forum
Users are reminded of the forum rules they sign up to which prohibits any activity that violates any laws including posting material covered by copyright
Rounding and Float to Integer Errors (Solved)
3 posts
• Page 1 of 1
Rounding and Float to Integer Errors (Solved)
There appears to be a rounding error were a conversion from a float calculation that results is a whole number is then connected to an integer data element. The result of the float multiply is display as a whole number - which I believe is rounded up - but results in a different integer value.
Attached is the schematic that seems to not make sense other than it being a bug.
I think we need a rounding primitive to be able to control results.
Attached is the schematic that seems to not make sense other than it being a bug.
I think we need a rounding primitive to be able to control results.
- Attachments
-
- IntegerBug.fsm
- Simple schematic
- (258 Bytes) Downloaded 1386 times
Last edited by boris on Mon Nov 15, 2010 11:11 pm, edited 1 time in total.
- boris
- Posts: 2
- Joined: Wed Jul 28, 2010 11:31 pm
Re: Rounding and Float to Integer Errors
Hey and welcome boris
This is not a bug. The float is rounded up for display purposes only, the underlying float is unchanged.
If you go into options under "Advanced" there is an option to turn "display floats as 32bit binary representations" on.
Switch that option on for the true value.
Cheers
Exo
This is not a bug. The float is rounded up for display purposes only, the underlying float is unchanged.
If you go into options under "Advanced" there is an option to turn "display floats as 32bit binary representations" on.
Switch that option on for the true value.
Cheers
Exo
- Exo
- Posts: 426
- Joined: Wed Aug 04, 2010 8:58 pm
- Location: UK
3 posts
• Page 1 of 1
Who is online
Users browsing this forum: Google [Bot] and 59 guests