Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add restrictions for several sources of external dictionaries #8127

Merged
merged 5 commits into from Dec 17, 2019

Conversation

alesapin
Copy link
Member

@alesapin alesapin commented Dec 10, 2019

I hereby agree to the terms of the CLA available at: https://yandex.ru/legal/cla/?lang=en

Changelog category (leave one):

  • Improvement

Changelog entry (up to few sentences, required except for Non-significant/Documentation categories):
Add additional checks for external dictionaries created from DDL-queries. Now it's not possible to create dictionaries with Executable source with DDL. Files for dictionaries from File source have to be located in user_files directory. Remote hosts for HTTP dictionaries now checked with remote_url_allow_hosts section from config. Shared libraries for corresponding dictionaries' sources have to be placed in dictionaries_lib folder.

May cause some compatibility problems.

@alesapin alesapin added the pr-improvement Pull request with some product improvements label Dec 10, 2019
return DictionaryFactory::create(name, *configurationFromAST, "dictionary", context, true);
}

bool DictionaryFactory::isComplex(const std::string & layout_type) const
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Not related to the main code of this PR.

except QueryRuntimeException as ex:
assert 'is not allowed in config.xml' in str(ex)

def test_file_dictionary_restrictions(started_cluster):
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No test for library source, but it's quite complex to implement.

@alexey-milovidov alexey-milovidov changed the title Add restrections for several sources of external dictionaries Add restrictions for several sources of external dictionaries Dec 10, 2019
@alesapin alesapin force-pushed the restrictions_for_external_dictionaries_from_ddl branch from 23d4c9a to a2180b0 Compare December 16, 2019 20:22
@alesapin
Copy link
Member Author

failed test flap, so I'll merge it.

@alesapin alesapin merged commit 3ad6b48 into master Dec 17, 2019
@alexey-milovidov alexey-milovidov added the pr-bugfix Pull request with bugfix, not backported by default label Jan 17, 2020
alexey-milovidov pushed a commit that referenced this pull request Jan 17, 2020
…ctionaries_from_ddl

Add restrictions for several sources of external dictionaries
filimonov added a commit that referenced this pull request Dec 7, 2020
sync docs with #8127
@filimonov filimonov mentioned this pull request Dec 7, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
pr-bugfix Pull request with bugfix, not backported by default pr-improvement Pull request with some product improvements
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants