If you have a problem or need to report a bug please email : support@dsprobotics.com
There are 3 sections to this support area:
DOWNLOADS: access to product manuals, support files and drivers
HELP & INFORMATION: tutorials and example files for learning or finding pre-made modules for your projects
USER FORUMS: meet with other users and exchange ideas, you can also get help and assistance here
NEW REGISTRATIONS - please contact us if you wish to register on the forum
Users are reminded of the forum rules they sign up to which prohibits any activity that violates any laws including posting material covered by copyright
About value inaccuracy
22 posts
• Page 3 of 3 • 1, 2, 3
Re: About value inaccuracy
Tulamide, I have one thing to mention. When you save preset with FS preset manager, float values are actually stored as 8digit decimals. This effectively means floats will get quantized to 0.0000001 steps (rounding anything lower than that to zero). It popped up when I tried saving filter coefficients (which are very sensitive to rounding)... It is probably the most serious issue with inaccuracy in flowstone.
- KG_is_back
- Posts: 1196
- Joined: Tue Oct 22, 2013 5:43 pm
- Location: Slovakia
Re: About value inaccuracy
KG_is_back wrote:Tulamide, I have one thing to mention. When you save preset with FS preset manager, float values are actually stored as 8digit decimals. This effectively means floats will get quantized to 0.0000001 steps (rounding anything lower than that to zero). It popped up when I tried saving filter coefficients (which are very sensitive to rounding)... It is probably the most serious issue with inaccuracy in flowstone.
KG many thanks for mentioning that! We discovered such a fine difference as well, as the one I'm working for did the hard works of going through each seperate value and discovered that some of them work correctly when 0.0000001 added (within green). I then made the Ruby test and came to the result that I could simply add 0.0000001 to ALL values to get them to work.
EDIT: I'm talking of 8-bit-integers converted to floats in the range 0-1
Since I thought of a coincidence I didn't want to rely on it and decided to go with your proposals, but if this is a fix behaviour of the preset manager I might save all the time-wasting work of re-coding and just add 0.0000001!
"There lies the dog buried" (German saying translated literally)
- tulamide
- Posts: 2714
- Joined: Sat Jun 21, 2014 2:48 pm
- Location: Germany
22 posts
• Page 3 of 3 • 1, 2, 3
Who is online
Users browsing this forum: No registered users and 28 guests