[eigen] Precision difference on 32-bit and 64-bit linux using float? |
[ Thread Index |
Date Index
| More lists.tuxfamily.org/eigen Archives
]
Hi!
I have a unit-test where I check a function, using a lot of Eigen math,
against some hard coded results for equality. However, the precision on
32-bit and 64-bit platforms differ, which causes the test to fail on our
32-bit nightly test. I am using floats, not doubles. Is this a known
"problem"?
Here are the results from the 32-bit run (the 64-bit run gets the
correct answers):
Expected: -8.333e-12 Actual: -8.34754e-12
Expected: -1.111e-06 Actual: -1.11111e-06
Expected: -1.389e-12 Actual: -1.39126e-12
Expected: -1.389e-12 Actual: -1.39126e-12
Expected: -5.556e-07 Actual: -5.55554e-07
Expected: -5.556e-07 Actual: -5.55554e-07
Expected: -5.556e-07 Actual: -5.55554e-07
Expected: -5.556e-07 Actual: -5.55554e-07
Expected: -6.944e-13 Actual: -6.95629e-13
Expected: -6.944e-13 Actual: -6.95629e-13
Expected: 1.111e-06 Actual: 1.11111e-06
Expected: -1.389e-12 Actual: -1.39126e-12
Expected: -1.389e-12 Actual: -1.39126e-12
Expected: -1.389e-12 Actual: -1.39126e-12
Expected: 5.556e-07 Actual: 5.55557e-07
Expected: 5.556e-07 Actual: 5.55557e-07
Expected: 5.556e-07 Actual: 5.55557e-07
Expected: 5.556e-07 Actual: 5.55557e-07
Expected: -6.944e-13 Actual: -6.95629e-13
Expected: -6.944e-13 Actual: -6.95629e-13
- Atle