[eigen] Precision difference on 32-bit and 64-bit linux using float?

[ Thread Index | Date Index | More lists.tuxfamily.org/eigen Archives ]


Hi!

I have a unit-test where I check a function, using a lot of Eigen math, against some hard coded results for equality. However, the precision on 32-bit and 64-bit platforms differ, which causes the test to fail on our 32-bit nightly test. I am using floats, not doubles. Is this a known "problem"?

Here are the results from the 32-bit run (the 64-bit run gets the correct answers):
Expected: -8.333e-12 Actual: -8.34754e-12
Expected: -1.111e-06 Actual: -1.11111e-06
Expected: -1.389e-12 Actual: -1.39126e-12
Expected: -1.389e-12 Actual: -1.39126e-12
Expected: -5.556e-07 Actual: -5.55554e-07
Expected: -5.556e-07 Actual: -5.55554e-07
Expected: -5.556e-07 Actual: -5.55554e-07
Expected: -5.556e-07 Actual: -5.55554e-07
Expected: -6.944e-13 Actual: -6.95629e-13
Expected: -6.944e-13 Actual: -6.95629e-13
Expected: 1.111e-06 Actual: 1.11111e-06
Expected: -1.389e-12 Actual: -1.39126e-12
Expected: -1.389e-12 Actual: -1.39126e-12
Expected: -1.389e-12 Actual: -1.39126e-12
Expected: 5.556e-07 Actual: 5.55557e-07
Expected: 5.556e-07 Actual: 5.55557e-07
Expected: 5.556e-07 Actual: 5.55557e-07
Expected: 5.556e-07 Actual: 5.55557e-07
Expected: -6.944e-13 Actual: -6.95629e-13
Expected: -6.944e-13 Actual: -6.95629e-13

- Atle



Mail converted by MHonArc 2.6.19+ http://listengine.tuxfamily.org/