lucenenet-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From laimis <>
Subject [GitHub] lucenenet pull request: use reduced precision float base class
Date Thu, 18 Jun 2015 01:58:32 GMT
GitHub user laimis opened a pull request:

    use reduced precision float base class

    We noticed that running tests in 32 bit CPUs was introducing floating point rounding issues
and tests were failing as the same calculation could produce different result if executed
multiple times in a single test. After some discussions on the mailing list it was determined
that on 32 bit machines different instructions are used from 64 bit machines to process floating
point numbers. Intermediate results when transferred with higher precision to the next operations
eventually lead to rounding errors once a final calculation is returned as float.
    From all the reading and trying several approaches so far, the only way I was able to
consistently to get floating point conversion issues to go away is to pinvoke _controlfp_s
to set floating point precision to 24 bits.
    I got the idea from,
see section "Floating-point settings (runtime)", last paragraph. controlfp seems to come up
in other suggestions around this issue as well. 
    Here is the information on _controlfp_s:
And it seems like there is an equivalent function in *nix environments although I haven't
tried them or researched them in more depth yet.
    For tests that rely on floating point calculations to be consistent, a variant of LuceneTestCase
is used that sets the precision mask to 24 bits before each test run. I put this in the test
as I don't think this code belongs to the core itself.

You can merge this pull request into a Git repository by running:

    $ git pull controlfp_s

Alternatively you can review and apply these changes as the patch at:

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #150
commit c11e3683b9abcc67893e8a885066107d9f703f80
Author: Laimonas Simutis <>
Date:   2015-06-06T18:20:27Z

    use reduced precision float base class


If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at or file a JIRA ticket
with INFRA.

View raw message