New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Bug fix/internal issue #566 #9497
Conversation
Is there documentation for the new behaviours / functionality? Anything that needs to be mentioned in UpgradingChanges? |
Implementation is backward compatible, e.g. all existing queries utilizing TOKENS functions will behave the same way as before. So, I assume there is nothing to mention in UpgradeChanges? Documentation will be updated with separate PR. |
} else if (current.isBool()) { | ||
arangodb::iresearch::addStringRef( | ||
builder, arangodb::basics::StringUtils::encodeBase64(irs::ref_cast<char>( | ||
irs::boolean_token_stream::value(current.getBoolean())))); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I have no idea what this should do. At the very least I've got to see the documentation first.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This will give us internal analyzer representation for given value, just like with strings
…-fix/optimization-of-nested-collect * 'devel' of https://github.com/arangodb/arangodb: fix asan issue (#9540) Docs: Add missing Cookbook placeholder folder Remove documentation, now here: github.com/arangodb/docs (#8918) Revert "Fix name of example graph in k Shortest Paths documentation (#8972)" Docs: Revert more accidental changes fixed an issue with smart joins if both collections were restricted to a (#9535) Remove some minReplicationFactor doc changes, fix indent Bug fix/internal issue #566 (#9497)
…ture/one-shard-db * 'devel' of https://github.com/arangodb/arangodb: fix asan issue (#9540) Docs: Add missing Cookbook placeholder folder Remove documentation, now here: github.com/arangodb/docs (#8918) Revert "Fix name of example graph in k Shortest Paths documentation (#8972)" Docs: Revert more accidental changes fixed an issue with smart joins if both collections were restricted to a (#9535) Remove some minReplicationFactor doc changes, fix indent Bug fix/internal issue #566 (#9497)
New behavior for TOKENS function.
Added ability to tokenize numbers, nulls and booleans with corresponding analyzers (terms returned as Base64Encoded)
Analyzer name (second parameter) is now optional (identity used by default)
Added ability to process arrays (possible nested)
Added tests for new functionality (js and GTEST)
https://jenkins.arangodb.biz/view/PR/job/arangodb-matrix-pr/5262/