Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

package_show response includes solr rubbish when using ckan.cache_validated_datasets #1764

Closed
davidread opened this issue Jun 11, 2014 · 0 comments
Closed

package_show response includes solr rubbish when using ckan.cache_validated_datasets #1764

davidread opened this issue Jun 11, 2014 · 0 comments

Comments

@davidread
Copy link
Contributor

e.g. When you get a dataset it includes the large 'data_dict' field which seems irrelevant rubbish:
http://data.gov.uk/api/action/package_show?id=article-4-directions9

This occurs when you switch on ckan.cache_validated_datasets. Then package_show gets the package_dict from a SOLR cache rather than the database, so it is faster. However, the validated_package_dict in SOLR contains the 'data_dict' field which is big and seems useless - it is the unvalidated cache of the package_dict. I think this was added by mistake.
davidread pushed a commit that referenced this issue Jun 11, 2014
[#1764] Reorder the creation of the SOLR cache of the validated packa…
595d058 
…ge_dict so that it does not include the unvalidated package_dict.
davidread pushed a commit that referenced this issue Jun 24, 2014
[#1764] Add tests.
05f2af5
davidread pushed a commit that referenced this issue Jun 24, 2014
[#1764] Change nose imports to stupid long-hand, as per the coding gu…
fd7d089 
…idelines.
davidread pushed a commit that referenced this issue Jun 24, 2014
[#1764] Compatibility with python 2.6.
a35ae70
davidread pushed a commit that referenced this issue Jun 24, 2014
[#1764] PEP8 fix.
fbfdbcc
@wardi wardi closed this as completed Jun 30, 2014
davidread pushed a commit that referenced this issue Jul 16, 2014
@amercader
[#1764] Reorder the creation of the SOLR cache of the validated packa…
e6bcc72 
…ge_dict so that it does not include the unvalidated package_dict.
wardi added a commit to wardi/ckan that referenced this issue Jan 12, 2015
@wardi
[ckan#2208] fix test for ckan#1764 regression
43379b1
wardi pushed a commit to wardi/ckan that referenced this issue Jan 12, 2015
@wardi
[ckan#1764] Reorder the creation of the SOLR cache of the validated p…
7f4ebf6 
…ackage_dict so that it does not include the unvalidated package_dict.
davidread pushed a commit to datagovuk/ckan that referenced this issue Nov 3, 2015
[ckan#1764] Reorder the creation of the SOLR cache of the validated p…
2c6a6f4 
…ackage_dict so that it does not include the unvalidated package_dict.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@wardi @davidread