Update fastpfor source and header files to incorporate changes made since 2018.

[jsford]

Hello @searchivarius,

Please consider this pull request to update the source and header files for fastpfor. I have copied in the source and header files from the most recent fastpfor commit --- 8e67fbd3418e27c8b593cc94335fc584c5e937cb --- made on June 5 2023.

I am motivated to update these files because I am using both PyFastPFor and lemire/FastPFor in my projects, and I would like the results to match. There have been small tweaks to the encodings made since your last checkpoint in 2018, so I am currently unable to use PyFastPFor to decode files I have written using FastPFor.

I was able to swap in the new files without too many problems. The only substantive change I made to the code is to instantiate a CODECFactory in the IntegerCODECWrapper since the formerly static methods getFromName() and allNames() now require an instance of the factory to call.

If you're willing to accept this pull request, that would be awesome. If you'd like to add lemire/FastPFor as a submodule, I'd be happy to set that up as well.

Regards,
Jordan Ford

[searchivarius]

This is great! @jsford could we have some at least basic test to check if things are working?

[jsford]

Cool, sure. I ran the test_basic1.py script on my machine without errors. What additional tests did you have in mind?

[searchivarius]

@jsford are you submitting test_basic as a part of pull request? You can add tests to setup.py.

[jsford]

@searchivarius --- this confused me, but I think I figured out the issue.

test_basic1.py already existed in your repo. My pull request doesn't list the test_basic1.py file because I didn't need to make any changes to it. As far as I can tell, you should be able to accept this pull request and continue to use the pre-existing test script that is already in your repository.

I've actually never submitted a pull request before, so if I've got this all wrong, just let me know!

[searchivarius]

@jsford sorry about the confusion. Indeed, there's a test.

Did you add new codecs too? The test is only for a bunch of old ones.

[searchivarius]

Hi @jsford please see my question above!

[jsford]

Hi @searchivarius
I've updated the test script to cover all codecs returned by getCodecList(). I also made some changes to the formatting of the test output, and I changed the filename from test_basic1.py to test_codecs.py. Let me know what you think!

[searchivarius]

@jsford sorry about delays. This is awesome, I will look into merging the PR soon!

[jsford]

Hi @searchivarius, just a reminder to look into this. Thanks!

[searchivarius]

Hi @jsford : just being overloaded, sorry.

Anyways, it all seems to be working (all tests pass) and the new version is uploaded to PyPi. I think buiding needs an update potentially, std=C++-11 flag doesn't work with MAC OS (despite there's a check in setup.py). However, it's possible to install on MAC with some hacks, and it's just fine on Linux.