Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Refactoring CDXServer processor code for coming extension of CDX #172

Merged
merged 1 commit into from Apr 26, 2018

Conversation

kngenie
Copy link
Member

@kngenie kngenie commented Apr 18, 2018

format and field interpretation change -- we are adding more fields to CDX and also changing how revisit records are represented in CDX line. This change will allow us to make that change without affecting other deployment using traditional CDX11/CDX9.
There should be no change to external behavior, except for CDXServer.cdxFormat property whose type has changed from String to CDXFormat;
it is backward compatible at Spring configuration level thanks to property editor for CDXFormat.

CDXLineFactory and FieldSplitFormat are encapsulated in new interface CDXFormat, through which revisit detection can be customized.
CDXLine Processor constructor signature has changed. modifyOutputFormat behavior has changed (now it must add fields before calling downstream).
For any deployment using custom processor, this can be a breaking change (unlikely, I hope)
As a side effect, resolveRevisit bug is fixed (WWM-978).

…ormat and field interpretation change.

CDXLineFactory and FieldSplitFormat are encapsulated in new interface CDXFormat, with which revisit detection can be customized.
Processor constructor signature has changed. modifyOutputFormat behavior has changed (now it must add fields before calling downstream).
There should be no change to external behavior, except for CDXServer.cdxFormat property whose type has changed from String to CDXFormat;
it is backward compatible at Spring configuration level thanks to property editor for CDXFormat.
As a side effect, resolveRevisit bug is fixed (WWM-978).
@kngenie kngenie changed the title Major refactoring of CDXServer processor code for coming extension of CDX Refactoring CDXServer processor code for coming extension of CDX Apr 19, 2018
@BitBaron
Copy link

Nothing reported from our merge into ait-qa a couple of days ago. AIT is good to merge into master.

@kngenie kngenie merged commit 8293bce into internetarchive:master Apr 26, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants