Feature arbitrary size encodings

[hardbyte]

Builds on #363 as suggested by @nbgl in #163

Implements in C a path to popcount and dice one to many when the encoding size is not word aligned. This means you can finally work on encodings of just 1 byte or 13 bytes (if you are so inclined).

I haven't done any benchmarking although I've expanded and added several tests.

[codecov]

Codecov Report

Merging #366 (47ca356) into master (03ac3d0) will not change coverage.
The diff coverage is 100.00%.

@@           Coverage Diff           @@
##           master     #366   +/-   ##
=======================================
  Coverage   94.57%   94.57%           
=======================================
  Files          16       16           
  Lines         792      792           
=======================================
  Hits          749      749           
  Misses         43       43           

[hardbyte]

@wilko77 did you find a way to make the coverage work for external PRs? As far as I can tell this is passing all the tests on each system and is ready for review.

[wilko77]

I started looking into the pipeline (#365). I made the coverage optional, that works. However, we then have another step where we upload the artifacts to a feed. And this still fails. It complains that the Anonlink build service hasn't got the permissions to publish there.
That's where I got stuck. As far as I can see, the Build Service has contributor permissions, thus should be fine to twine upload to the feed.
Maybe we can get the release pipeline to do the publishing to the feed.
Or can we do without that feed?

[hardbyte]

My guess is that "Publish package to test feed" stage could be only enabled for the main branches - https://docs.microsoft.com/en-us/azure/devops/pipelines/process/conditions?view=azure-devops&tabs=yaml

Maybe we can get the release pipeline to do the publishing to the feed.
Or can we do without that feed?

Yeah I think if you could get the release pipeline to pick up all the artifacts directly you wouldn't need the test feed. I made it so we could test linked feature branches across the multiple projects. Primarily so anonlink-entity-service could test a not-yet released version of the anonlink library by pulling from the test feed.

[wilko77]

Nice.
A few minor things. See comments.
Thank you.

If you merge master, then you'll get the updated CI definition, and with it the satisfaction of seeing the CI pipeline succeed.

[wilko77]

I don't fully understand this. I though you implemented arbitrary sized inputs? What is this issue here exactly?

[hardbyte]

This was me recording my thinking early on. As you know, before this PR the CPP code assumed inputs would be a multiple of WORD_SIZE (8 bytes) in length, at least for supporting popcount we could have padded the input with zeros up to the nearest word size boundary and avoided modifying the CPP code.

Ultimately I didn't take that approach anywhere so I'll remove the comment.