Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

fix(gatsby-source-drupal): cache backlink records #33444

Merged
merged 12 commits into from
Oct 25, 2021
Merged

fix(gatsby-source-drupal): cache backlink records #33444

merged 12 commits into from
Oct 25, 2021

Conversation

KyleAMathews
Copy link
Contributor

@KyleAMathews KyleAMathews commented Oct 5, 2021 •
edited
Loading

Write the in-memory lookup map to the cache after a successful run of "sourceNodes" and reload it for use in subsequent builds.

This fixes an issue where backlinks aren't preserved properly for incremental node updates with a warm cache.

Fixes #33267

GatsbyJS Bot and others added 6 commits September 17, 2021 17:52
@KyleAMathews
fix(gatsby-source-drupal): check relationships type exists on node be…
c410082 
…fore filtering (#33181) (#33228)

* fix(gatsby-source-drupal): check relationships type exists on node before filtering

* Update packages/gatsby-source-drupal/src/utils.js

Co-authored-by: Dustin Schau <DSchau@users.noreply.github.com>

* format

Co-authored-by: Dustin Schau <DSchau@users.noreply.github.com>
(cherry picked from commit d4f8355)

Co-authored-by: Kyle Mathews <mathews.kyle@gmail.com>
@vladar
chore(release): Publish
f3f1bbc 
 - babel-plugin-remove-graphql-queries@3.14.0
 - babel-preset-gatsby-package@1.14.0
 - babel-preset-gatsby@1.14.0
 - create-gatsby@1.14.0
 - gatsby-admin@0.24.0
 - gatsby-cli@3.14.0
 - gatsby-codemods@2.14.0
 - gatsby-core-utils@2.14.0
 - gatsby-cypress@1.14.0
 - gatsby-design-tokens@3.14.0
 - gatsby-dev-cli@3.14.0
 - gatsby-graphiql-explorer@1.14.0
 - gatsby-legacy-polyfills@1.14.0
 - gatsby-link@3.14.0
 - gatsby-page-utils@1.14.0
 - gatsby-plugin-benchmark-reporting@1.14.0
 - gatsby-plugin-canonical-urls@3.14.0
 - gatsby-plugin-catch-links@3.14.0
 - gatsby-plugin-coffeescript@3.14.0
 - gatsby-plugin-create-client-paths@3.14.0
 - gatsby-plugin-cxs@3.14.0
 - gatsby-plugin-emotion@6.14.0
 - gatsby-plugin-facebook-analytics@3.14.0
 - gatsby-plugin-feed@3.14.0
 - gatsby-plugin-flow@2.14.0
 - gatsby-plugin-fullstory@3.14.0
 - gatsby-plugin-gatsby-cloud@3.2.0
 - gatsby-plugin-google-analytics@3.14.0
 - gatsby-plugin-google-gtag@3.14.0
 - gatsby-plugin-google-tagmanager@3.14.0
 - gatsby-plugin-graphql-config@0.23.0
 - gatsby-plugin-image@1.14.0
 - gatsby-plugin-jss@3.14.0
 - gatsby-plugin-layout@2.14.0
 - gatsby-plugin-less@5.14.0
 - gatsby-plugin-lodash@4.14.0
 - gatsby-plugin-manifest@3.14.0
 - gatsby-plugin-mdx@2.14.0
 - gatsby-plugin-netlify-cms@5.14.0
 - gatsby-plugin-no-sourcemaps@3.14.0
 - gatsby-plugin-nprogress@3.14.0
 - gatsby-plugin-offline@4.14.0
 - gatsby-plugin-page-creator@3.14.0
 - gatsby-plugin-postcss@4.14.0
 - gatsby-plugin-preact@5.14.0
 - gatsby-plugin-preload-fonts@2.14.0
 - gatsby-plugin-react-css-modules@3.14.0
 - gatsby-plugin-react-helmet@4.14.0
 - gatsby-plugin-remove-trailing-slashes@3.14.0
 - gatsby-plugin-sass@4.14.0
 - gatsby-plugin-schema-snapshot@2.14.0
 - gatsby-plugin-sharp@3.14.0
 - gatsby-plugin-sitemap@4.10.0
 - gatsby-plugin-styled-components@4.14.0
 - gatsby-plugin-styled-jsx@4.14.0
 - gatsby-plugin-styletron@6.14.0
 - gatsby-plugin-stylus@3.14.0
 - gatsby-plugin-subfont@3.14.0
 - gatsby-plugin-twitter@3.14.0
 - gatsby-plugin-typescript@3.14.0
 - gatsby-plugin-typography@3.14.0
 - gatsby-plugin-utils@1.14.0
 - gatsby-react-router-scroll@4.14.0
 - gatsby-recipes@0.25.0
 - gatsby-remark-autolink-headers@4.11.0
 - gatsby-remark-code-repls@5.11.0
 - gatsby-remark-copy-linked-files@4.11.0
 - gatsby-remark-custom-blocks@3.14.0
 - gatsby-remark-embed-snippet@6.11.0
 - gatsby-remark-graphviz@3.11.0
 - gatsby-remark-images-contentful@4.11.0
 - gatsby-remark-images@5.11.0
 - gatsby-remark-katex@5.11.0
 - gatsby-remark-prismjs@5.11.0
 - gatsby-remark-responsive-iframe@4.11.0
 - gatsby-remark-smartypants@4.11.0
 - gatsby-source-contentful@5.14.0
 - gatsby-source-drupal@4.14.0
 - gatsby-source-faker@3.14.0
 - gatsby-source-filesystem@3.14.0
 - gatsby-source-graphql@3.14.0
 - gatsby-source-hacker-news@3.14.0
 - gatsby-source-lever@3.14.0
 - gatsby-source-medium@3.14.0
 - gatsby-source-mongodb@3.14.0
 - gatsby-source-npm-package-search@3.14.0
 - gatsby-source-shopify@5.6.0
 - gatsby-source-wikipedia@3.14.0
 - gatsby-source-wordpress@5.14.0
 - gatsby-telemetry@2.14.0
 - gatsby-transformer-asciidoc@2.14.0
 - gatsby-transformer-csv@3.14.0
 - gatsby-transformer-documentationjs@5.14.0
 - gatsby-transformer-excel@3.14.0
 - gatsby-transformer-hjson@3.14.0
 - gatsby-transformer-javascript-frontmatter@3.14.0
 - gatsby-transformer-javascript-static-exports@3.14.0
 - gatsby-transformer-json@3.14.0
 - gatsby-transformer-pdf@2.14.0
 - gatsby-transformer-react-docgen@6.14.0
 - gatsby-transformer-remark@4.11.0
 - gatsby-transformer-screenshot@3.14.0
 - gatsby-transformer-sharp@3.14.0
 - gatsby-transformer-sqip@3.14.0
 - gatsby-transformer-toml@3.14.0
 - gatsby-transformer-xml@3.14.0
 - gatsby-transformer-yaml@3.14.0
 - gatsby-worker@0.5.0
 - gatsby@3.14.0
@kszot-ref
Preserve backlink/reference lookup tables in cache
0c10243
@kszot-ref
Merge branch 'master' into gatsby-source-drupal-inc-build-backlink-fi…
8438e7a 
…x-pr
@KyleAMathews
Merge remote-tracking branch 'origin/master' into gatsby-source-drupa…
c49dee8 
…l-inc-build-backlink-fix-pr
@KyleAMathews
test
80befd5
@gatsbot gatsbot bot added the status: triage needed Issue or pull request that need to be triaged and assigned to a reviewer label Oct 5, 2021
@KyleAMathews KyleAMathews added topic: source-drupal Related to Gatsby's integration with Drupal type: bug An issue or pull request relating to a bug in Gatsby and removed status: triage needed Issue or pull request that need to be triaged and assigned to a reviewer labels Oct 5, 2021
@KyleAMathews KyleAMathews added this to To cherry-pick in V3 Release Hotfixes via automation Oct 25, 2021
KyleAMathews added a commit that referenced this pull request Oct 25, 2021
@KyleAMathews
cache backlink records #33444
3fa6041
wardpeet
wardpeet reviewed Oct 25, 2021
View reviewed changes
packages/gatsby-source-drupal/src/utils.js
Comment on lines +20 to +24
backRefsNamesLookup = new Map(JSON.parse(backRefsNamesLookupStr))
}

if (referencedNodesLookupStr) {
referencedNodesLookup = new Map(JSON.parse(referencedNodesLookupStr))
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I wonder if this can become very memory expensive. Does this run on PSU without problems? If not we should look into http://ndjson.org/

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I tested it on a smaller site but good point — lemme test how expensive this is for a PSU-sized site

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

rss increases about 400mb while stringifying the two maps into a totoal of ~85 million characters. Execution time is ~600ms.

I think reasonable enough given how big PSU is — they're using ~6.5gb already at this point so this is a temp 15% bump in memory use that'll be GCed fairly soon after that.

@KyleAMathews KyleAMathews merged commit 0def3ac into master Oct 25, 2021
@KyleAMathews KyleAMathews deleted the kyle-s-fork branch October 25, 2021 19:56
@gatsbybot gatsbybot mentioned this pull request Oct 27, 2021
Merged
vladar pushed a commit that referenced this pull request Oct 27, 2021
@KyleAMathews @vladar
fix(gatsby-source-drupal): cache backlink records (#33444)
092a204 
* fix(gatsby-source-drupal): check relationships type exists on node before filtering (#33181) (#33228)

* fix(gatsby-source-drupal): check relationships type exists on node before filtering

* Update packages/gatsby-source-drupal/src/utils.js

Co-authored-by: Dustin Schau <DSchau@users.noreply.github.com>

* format

Co-authored-by: Dustin Schau <DSchau@users.noreply.github.com>
(cherry picked from commit d4f8355)

Co-authored-by: Kyle Mathews <mathews.kyle@gmail.com>

* chore(release): Publish

 - babel-plugin-remove-graphql-queries@3.14.0
 - babel-preset-gatsby-package@1.14.0
 - babel-preset-gatsby@1.14.0
 - create-gatsby@1.14.0
 - gatsby-admin@0.24.0
 - gatsby-cli@3.14.0
 - gatsby-codemods@2.14.0
 - gatsby-core-utils@2.14.0
 - gatsby-cypress@1.14.0
 - gatsby-design-tokens@3.14.0
 - gatsby-dev-cli@3.14.0
 - gatsby-graphiql-explorer@1.14.0
 - gatsby-legacy-polyfills@1.14.0
 - gatsby-link@3.14.0
 - gatsby-page-utils@1.14.0
 - gatsby-plugin-benchmark-reporting@1.14.0
 - gatsby-plugin-canonical-urls@3.14.0
 - gatsby-plugin-catch-links@3.14.0
 - gatsby-plugin-coffeescript@3.14.0
 - gatsby-plugin-create-client-paths@3.14.0
 - gatsby-plugin-cxs@3.14.0
 - gatsby-plugin-emotion@6.14.0
 - gatsby-plugin-facebook-analytics@3.14.0
 - gatsby-plugin-feed@3.14.0
 - gatsby-plugin-flow@2.14.0
 - gatsby-plugin-fullstory@3.14.0
 - gatsby-plugin-gatsby-cloud@3.2.0
 - gatsby-plugin-google-analytics@3.14.0
 - gatsby-plugin-google-gtag@3.14.0
 - gatsby-plugin-google-tagmanager@3.14.0
 - gatsby-plugin-graphql-config@0.23.0
 - gatsby-plugin-image@1.14.0
 - gatsby-plugin-jss@3.14.0
 - gatsby-plugin-layout@2.14.0
 - gatsby-plugin-less@5.14.0
 - gatsby-plugin-lodash@4.14.0
 - gatsby-plugin-manifest@3.14.0
 - gatsby-plugin-mdx@2.14.0
 - gatsby-plugin-netlify-cms@5.14.0
 - gatsby-plugin-no-sourcemaps@3.14.0
 - gatsby-plugin-nprogress@3.14.0
 - gatsby-plugin-offline@4.14.0
 - gatsby-plugin-page-creator@3.14.0
 - gatsby-plugin-postcss@4.14.0
 - gatsby-plugin-preact@5.14.0
 - gatsby-plugin-preload-fonts@2.14.0
 - gatsby-plugin-react-css-modules@3.14.0
 - gatsby-plugin-react-helmet@4.14.0
 - gatsby-plugin-remove-trailing-slashes@3.14.0
 - gatsby-plugin-sass@4.14.0
 - gatsby-plugin-schema-snapshot@2.14.0
 - gatsby-plugin-sharp@3.14.0
 - gatsby-plugin-sitemap@4.10.0
 - gatsby-plugin-styled-components@4.14.0
 - gatsby-plugin-styled-jsx@4.14.0
 - gatsby-plugin-styletron@6.14.0
 - gatsby-plugin-stylus@3.14.0
 - gatsby-plugin-subfont@3.14.0
 - gatsby-plugin-twitter@3.14.0
 - gatsby-plugin-typescript@3.14.0
 - gatsby-plugin-typography@3.14.0
 - gatsby-plugin-utils@1.14.0
 - gatsby-react-router-scroll@4.14.0
 - gatsby-recipes@0.25.0
 - gatsby-remark-autolink-headers@4.11.0
 - gatsby-remark-code-repls@5.11.0
 - gatsby-remark-copy-linked-files@4.11.0
 - gatsby-remark-custom-blocks@3.14.0
 - gatsby-remark-embed-snippet@6.11.0
 - gatsby-remark-graphviz@3.11.0
 - gatsby-remark-images-contentful@4.11.0
 - gatsby-remark-images@5.11.0
 - gatsby-remark-katex@5.11.0
 - gatsby-remark-prismjs@5.11.0
 - gatsby-remark-responsive-iframe@4.11.0
 - gatsby-remark-smartypants@4.11.0
 - gatsby-source-contentful@5.14.0
 - gatsby-source-drupal@4.14.0
 - gatsby-source-faker@3.14.0
 - gatsby-source-filesystem@3.14.0
 - gatsby-source-graphql@3.14.0
 - gatsby-source-hacker-news@3.14.0
 - gatsby-source-lever@3.14.0
 - gatsby-source-medium@3.14.0
 - gatsby-source-mongodb@3.14.0
 - gatsby-source-npm-package-search@3.14.0
 - gatsby-source-shopify@5.6.0
 - gatsby-source-wikipedia@3.14.0
 - gatsby-source-wordpress@5.14.0
 - gatsby-telemetry@2.14.0
 - gatsby-transformer-asciidoc@2.14.0
 - gatsby-transformer-csv@3.14.0
 - gatsby-transformer-documentationjs@5.14.0
 - gatsby-transformer-excel@3.14.0
 - gatsby-transformer-hjson@3.14.0
 - gatsby-transformer-javascript-frontmatter@3.14.0
 - gatsby-transformer-javascript-static-exports@3.14.0
 - gatsby-transformer-json@3.14.0
 - gatsby-transformer-pdf@2.14.0
 - gatsby-transformer-react-docgen@6.14.0
 - gatsby-transformer-remark@4.11.0
 - gatsby-transformer-screenshot@3.14.0
 - gatsby-transformer-sharp@3.14.0
 - gatsby-transformer-sqip@3.14.0
 - gatsby-transformer-toml@3.14.0
 - gatsby-transformer-xml@3.14.0
 - gatsby-transformer-yaml@3.14.0
 - gatsby-worker@0.5.0
 - gatsby@3.14.0

* Preserve backlink/reference lookup tables in cache

* test

* fix bad merge

* try try again

* Improve log

* Get working with tests

Co-authored-by: GatsbyJS Bot <mathews.kyle+gatsbybot@gmail.com>
Co-authored-by: Vladimir Razuvaev <vladimir.razuvaev@gmail.com>
Co-authored-by: Krzysztof Szot <kszot@reference.be>
(cherry picked from commit 0def3ac)
@vladar vladar moved this from To cherry-pick to Backport PR opened in V3 Release Hotfixes Oct 27, 2021
vladar pushed a commit that referenced this pull request Oct 27, 2021
@KyleAMathews
fix(gatsby-source-drupal): cache backlink records (#33444) (#33701)
26c51c0 
* fix(gatsby-source-drupal): check relationships type exists on node before filtering (#33181) (#33228)

* fix(gatsby-source-drupal): check relationships type exists on node before filtering

* Update packages/gatsby-source-drupal/src/utils.js

Co-authored-by: Dustin Schau <DSchau@users.noreply.github.com>

* format

Co-authored-by: Dustin Schau <DSchau@users.noreply.github.com>
(cherry picked from commit d4f8355)

Co-authored-by: Kyle Mathews <mathews.kyle@gmail.com>

* chore(release): Publish

 - babel-plugin-remove-graphql-queries@3.14.0
 - babel-preset-gatsby-package@1.14.0
 - babel-preset-gatsby@1.14.0
 - create-gatsby@1.14.0
 - gatsby-admin@0.24.0
 - gatsby-cli@3.14.0
 - gatsby-codemods@2.14.0
 - gatsby-core-utils@2.14.0
 - gatsby-cypress@1.14.0
 - gatsby-design-tokens@3.14.0
 - gatsby-dev-cli@3.14.0
 - gatsby-graphiql-explorer@1.14.0
 - gatsby-legacy-polyfills@1.14.0
 - gatsby-link@3.14.0
 - gatsby-page-utils@1.14.0
 - gatsby-plugin-benchmark-reporting@1.14.0
 - gatsby-plugin-canonical-urls@3.14.0
 - gatsby-plugin-catch-links@3.14.0
 - gatsby-plugin-coffeescript@3.14.0
 - gatsby-plugin-create-client-paths@3.14.0
 - gatsby-plugin-cxs@3.14.0
 - gatsby-plugin-emotion@6.14.0
 - gatsby-plugin-facebook-analytics@3.14.0
 - gatsby-plugin-feed@3.14.0
 - gatsby-plugin-flow@2.14.0
 - gatsby-plugin-fullstory@3.14.0
 - gatsby-plugin-gatsby-cloud@3.2.0
 - gatsby-plugin-google-analytics@3.14.0
 - gatsby-plugin-google-gtag@3.14.0
 - gatsby-plugin-google-tagmanager@3.14.0
 - gatsby-plugin-graphql-config@0.23.0
 - gatsby-plugin-image@1.14.0
 - gatsby-plugin-jss@3.14.0
 - gatsby-plugin-layout@2.14.0
 - gatsby-plugin-less@5.14.0
 - gatsby-plugin-lodash@4.14.0
 - gatsby-plugin-manifest@3.14.0
 - gatsby-plugin-mdx@2.14.0
 - gatsby-plugin-netlify-cms@5.14.0
 - gatsby-plugin-no-sourcemaps@3.14.0
 - gatsby-plugin-nprogress@3.14.0
 - gatsby-plugin-offline@4.14.0
 - gatsby-plugin-page-creator@3.14.0
 - gatsby-plugin-postcss@4.14.0
 - gatsby-plugin-preact@5.14.0
 - gatsby-plugin-preload-fonts@2.14.0
 - gatsby-plugin-react-css-modules@3.14.0
 - gatsby-plugin-react-helmet@4.14.0
 - gatsby-plugin-remove-trailing-slashes@3.14.0
 - gatsby-plugin-sass@4.14.0
 - gatsby-plugin-schema-snapshot@2.14.0
 - gatsby-plugin-sharp@3.14.0
 - gatsby-plugin-sitemap@4.10.0
 - gatsby-plugin-styled-components@4.14.0
 - gatsby-plugin-styled-jsx@4.14.0
 - gatsby-plugin-styletron@6.14.0
 - gatsby-plugin-stylus@3.14.0
 - gatsby-plugin-subfont@3.14.0
 - gatsby-plugin-twitter@3.14.0
 - gatsby-plugin-typescript@3.14.0
 - gatsby-plugin-typography@3.14.0
 - gatsby-plugin-utils@1.14.0
 - gatsby-react-router-scroll@4.14.0
 - gatsby-recipes@0.25.0
 - gatsby-remark-autolink-headers@4.11.0
 - gatsby-remark-code-repls@5.11.0
 - gatsby-remark-copy-linked-files@4.11.0
 - gatsby-remark-custom-blocks@3.14.0
 - gatsby-remark-embed-snippet@6.11.0
 - gatsby-remark-graphviz@3.11.0
 - gatsby-remark-images-contentful@4.11.0
 - gatsby-remark-images@5.11.0
 - gatsby-remark-katex@5.11.0
 - gatsby-remark-prismjs@5.11.0
 - gatsby-remark-responsive-iframe@4.11.0
 - gatsby-remark-smartypants@4.11.0
 - gatsby-source-contentful@5.14.0
 - gatsby-source-drupal@4.14.0
 - gatsby-source-faker@3.14.0
 - gatsby-source-filesystem@3.14.0
 - gatsby-source-graphql@3.14.0
 - gatsby-source-hacker-news@3.14.0
 - gatsby-source-lever@3.14.0
 - gatsby-source-medium@3.14.0
 - gatsby-source-mongodb@3.14.0
 - gatsby-source-npm-package-search@3.14.0
 - gatsby-source-shopify@5.6.0
 - gatsby-source-wikipedia@3.14.0
 - gatsby-source-wordpress@5.14.0
 - gatsby-telemetry@2.14.0
 - gatsby-transformer-asciidoc@2.14.0
 - gatsby-transformer-csv@3.14.0
 - gatsby-transformer-documentationjs@5.14.0
 - gatsby-transformer-excel@3.14.0
 - gatsby-transformer-hjson@3.14.0
 - gatsby-transformer-javascript-frontmatter@3.14.0
 - gatsby-transformer-javascript-static-exports@3.14.0
 - gatsby-transformer-json@3.14.0
 - gatsby-transformer-pdf@2.14.0
 - gatsby-transformer-react-docgen@6.14.0
 - gatsby-transformer-remark@4.11.0
 - gatsby-transformer-screenshot@3.14.0
 - gatsby-transformer-sharp@3.14.0
 - gatsby-transformer-sqip@3.14.0
 - gatsby-transformer-toml@3.14.0
 - gatsby-transformer-xml@3.14.0
 - gatsby-transformer-yaml@3.14.0
 - gatsby-worker@0.5.0
 - gatsby@3.14.0

* Preserve backlink/reference lookup tables in cache

* test

* fix bad merge

* try try again

* Improve log

* Get working with tests

Co-authored-by: GatsbyJS Bot <mathews.kyle+gatsbybot@gmail.com>
Co-authored-by: Vladimir Razuvaev <vladimir.razuvaev@gmail.com>
Co-authored-by: Krzysztof Szot <kszot@reference.be>
(cherry picked from commit 0def3ac)

Co-authored-by: Kyle Mathews <mathews.kyle@gmail.com>
@vladar vladar moved this from Backport PR opened to Backported in V3 Release Hotfixes Oct 27, 2021
@vladar vladar moved this from Backported to Published in V3 Release Hotfixes Oct 28, 2021
wardpeet pushed a commit to herecydev/gatsby that referenced this pull request Oct 29, 2021
@KyleAMathews @vladar
@kszot-ref @wardpeet
fix(gatsby-source-drupal): cache backlink records (gatsbyjs#33444)
c3ef48c 
* fix(gatsby-source-drupal): check relationships type exists on node before filtering (gatsbyjs#33181) (gatsbyjs#33228)

* fix(gatsby-source-drupal): check relationships type exists on node before filtering

* Update packages/gatsby-source-drupal/src/utils.js

Co-authored-by: Dustin Schau <DSchau@users.noreply.github.com>

* format

Co-authored-by: Dustin Schau <DSchau@users.noreply.github.com>
(cherry picked from commit d4f8355)

Co-authored-by: Kyle Mathews <mathews.kyle@gmail.com>

* chore(release): Publish

 - babel-plugin-remove-graphql-queries@3.14.0
 - babel-preset-gatsby-package@1.14.0
 - babel-preset-gatsby@1.14.0
 - create-gatsby@1.14.0
 - gatsby-admin@0.24.0
 - gatsby-cli@3.14.0
 - gatsby-codemods@2.14.0
 - gatsby-core-utils@2.14.0
 - gatsby-cypress@1.14.0
 - gatsby-design-tokens@3.14.0
 - gatsby-dev-cli@3.14.0
 - gatsby-graphiql-explorer@1.14.0
 - gatsby-legacy-polyfills@1.14.0
 - gatsby-link@3.14.0
 - gatsby-page-utils@1.14.0
 - gatsby-plugin-benchmark-reporting@1.14.0
 - gatsby-plugin-canonical-urls@3.14.0
 - gatsby-plugin-catch-links@3.14.0
 - gatsby-plugin-coffeescript@3.14.0
 - gatsby-plugin-create-client-paths@3.14.0
 - gatsby-plugin-cxs@3.14.0
 - gatsby-plugin-emotion@6.14.0
 - gatsby-plugin-facebook-analytics@3.14.0
 - gatsby-plugin-feed@3.14.0
 - gatsby-plugin-flow@2.14.0
 - gatsby-plugin-fullstory@3.14.0
 - gatsby-plugin-gatsby-cloud@3.2.0
 - gatsby-plugin-google-analytics@3.14.0
 - gatsby-plugin-google-gtag@3.14.0
 - gatsby-plugin-google-tagmanager@3.14.0
 - gatsby-plugin-graphql-config@0.23.0
 - gatsby-plugin-image@1.14.0
 - gatsby-plugin-jss@3.14.0
 - gatsby-plugin-layout@2.14.0
 - gatsby-plugin-less@5.14.0
 - gatsby-plugin-lodash@4.14.0
 - gatsby-plugin-manifest@3.14.0
 - gatsby-plugin-mdx@2.14.0
 - gatsby-plugin-netlify-cms@5.14.0
 - gatsby-plugin-no-sourcemaps@3.14.0
 - gatsby-plugin-nprogress@3.14.0
 - gatsby-plugin-offline@4.14.0
 - gatsby-plugin-page-creator@3.14.0
 - gatsby-plugin-postcss@4.14.0
 - gatsby-plugin-preact@5.14.0
 - gatsby-plugin-preload-fonts@2.14.0
 - gatsby-plugin-react-css-modules@3.14.0
 - gatsby-plugin-react-helmet@4.14.0
 - gatsby-plugin-remove-trailing-slashes@3.14.0
 - gatsby-plugin-sass@4.14.0
 - gatsby-plugin-schema-snapshot@2.14.0
 - gatsby-plugin-sharp@3.14.0
 - gatsby-plugin-sitemap@4.10.0
 - gatsby-plugin-styled-components@4.14.0
 - gatsby-plugin-styled-jsx@4.14.0
 - gatsby-plugin-styletron@6.14.0
 - gatsby-plugin-stylus@3.14.0
 - gatsby-plugin-subfont@3.14.0
 - gatsby-plugin-twitter@3.14.0
 - gatsby-plugin-typescript@3.14.0
 - gatsby-plugin-typography@3.14.0
 - gatsby-plugin-utils@1.14.0
 - gatsby-react-router-scroll@4.14.0
 - gatsby-recipes@0.25.0
 - gatsby-remark-autolink-headers@4.11.0
 - gatsby-remark-code-repls@5.11.0
 - gatsby-remark-copy-linked-files@4.11.0
 - gatsby-remark-custom-blocks@3.14.0
 - gatsby-remark-embed-snippet@6.11.0
 - gatsby-remark-graphviz@3.11.0
 - gatsby-remark-images-contentful@4.11.0
 - gatsby-remark-images@5.11.0
 - gatsby-remark-katex@5.11.0
 - gatsby-remark-prismjs@5.11.0
 - gatsby-remark-responsive-iframe@4.11.0
 - gatsby-remark-smartypants@4.11.0
 - gatsby-source-contentful@5.14.0
 - gatsby-source-drupal@4.14.0
 - gatsby-source-faker@3.14.0
 - gatsby-source-filesystem@3.14.0
 - gatsby-source-graphql@3.14.0
 - gatsby-source-hacker-news@3.14.0
 - gatsby-source-lever@3.14.0
 - gatsby-source-medium@3.14.0
 - gatsby-source-mongodb@3.14.0
 - gatsby-source-npm-package-search@3.14.0
 - gatsby-source-shopify@5.6.0
 - gatsby-source-wikipedia@3.14.0
 - gatsby-source-wordpress@5.14.0
 - gatsby-telemetry@2.14.0
 - gatsby-transformer-asciidoc@2.14.0
 - gatsby-transformer-csv@3.14.0
 - gatsby-transformer-documentationjs@5.14.0
 - gatsby-transformer-excel@3.14.0
 - gatsby-transformer-hjson@3.14.0
 - gatsby-transformer-javascript-frontmatter@3.14.0
 - gatsby-transformer-javascript-static-exports@3.14.0
 - gatsby-transformer-json@3.14.0
 - gatsby-transformer-pdf@2.14.0
 - gatsby-transformer-react-docgen@6.14.0
 - gatsby-transformer-remark@4.11.0
 - gatsby-transformer-screenshot@3.14.0
 - gatsby-transformer-sharp@3.14.0
 - gatsby-transformer-sqip@3.14.0
 - gatsby-transformer-toml@3.14.0
 - gatsby-transformer-xml@3.14.0
 - gatsby-transformer-yaml@3.14.0
 - gatsby-worker@0.5.0
 - gatsby@3.14.0

* Preserve backlink/reference lookup tables in cache

* test

* fix bad merge

* try try again

* Improve log

* Get working with tests

Co-authored-by: GatsbyJS Bot <mathews.kyle+gatsbybot@gmail.com>
Co-authored-by: Vladimir Razuvaev <vladimir.razuvaev@gmail.com>
Co-authored-by: Krzysztof Szot <kszot@reference.be>
axe312ger pushed a commit that referenced this pull request Nov 9, 2021
@KyleAMathews @vladar
@kszot-ref @axe312ger
fix(gatsby-source-drupal): cache backlink records (#33444)
ad2938c 
* fix(gatsby-source-drupal): check relationships type exists on node before filtering (#33181) (#33228)

* fix(gatsby-source-drupal): check relationships type exists on node before filtering

* Update packages/gatsby-source-drupal/src/utils.js

Co-authored-by: Dustin Schau <DSchau@users.noreply.github.com>

* format

Co-authored-by: Dustin Schau <DSchau@users.noreply.github.com>
(cherry picked from commit d4f8355)

Co-authored-by: Kyle Mathews <mathews.kyle@gmail.com>

* chore(release): Publish

 - babel-plugin-remove-graphql-queries@3.14.0
 - babel-preset-gatsby-package@1.14.0
 - babel-preset-gatsby@1.14.0
 - create-gatsby@1.14.0
 - gatsby-admin@0.24.0
 - gatsby-cli@3.14.0
 - gatsby-codemods@2.14.0
 - gatsby-core-utils@2.14.0
 - gatsby-cypress@1.14.0
 - gatsby-design-tokens@3.14.0
 - gatsby-dev-cli@3.14.0
 - gatsby-graphiql-explorer@1.14.0
 - gatsby-legacy-polyfills@1.14.0
 - gatsby-link@3.14.0
 - gatsby-page-utils@1.14.0
 - gatsby-plugin-benchmark-reporting@1.14.0
 - gatsby-plugin-canonical-urls@3.14.0
 - gatsby-plugin-catch-links@3.14.0
 - gatsby-plugin-coffeescript@3.14.0
 - gatsby-plugin-create-client-paths@3.14.0
 - gatsby-plugin-cxs@3.14.0
 - gatsby-plugin-emotion@6.14.0
 - gatsby-plugin-facebook-analytics@3.14.0
 - gatsby-plugin-feed@3.14.0
 - gatsby-plugin-flow@2.14.0
 - gatsby-plugin-fullstory@3.14.0
 - gatsby-plugin-gatsby-cloud@3.2.0
 - gatsby-plugin-google-analytics@3.14.0
 - gatsby-plugin-google-gtag@3.14.0
 - gatsby-plugin-google-tagmanager@3.14.0
 - gatsby-plugin-graphql-config@0.23.0
 - gatsby-plugin-image@1.14.0
 - gatsby-plugin-jss@3.14.0
 - gatsby-plugin-layout@2.14.0
 - gatsby-plugin-less@5.14.0
 - gatsby-plugin-lodash@4.14.0
 - gatsby-plugin-manifest@3.14.0
 - gatsby-plugin-mdx@2.14.0
 - gatsby-plugin-netlify-cms@5.14.0
 - gatsby-plugin-no-sourcemaps@3.14.0
 - gatsby-plugin-nprogress@3.14.0
 - gatsby-plugin-offline@4.14.0
 - gatsby-plugin-page-creator@3.14.0
 - gatsby-plugin-postcss@4.14.0
 - gatsby-plugin-preact@5.14.0
 - gatsby-plugin-preload-fonts@2.14.0
 - gatsby-plugin-react-css-modules@3.14.0
 - gatsby-plugin-react-helmet@4.14.0
 - gatsby-plugin-remove-trailing-slashes@3.14.0
 - gatsby-plugin-sass@4.14.0
 - gatsby-plugin-schema-snapshot@2.14.0
 - gatsby-plugin-sharp@3.14.0
 - gatsby-plugin-sitemap@4.10.0
 - gatsby-plugin-styled-components@4.14.0
 - gatsby-plugin-styled-jsx@4.14.0
 - gatsby-plugin-styletron@6.14.0
 - gatsby-plugin-stylus@3.14.0
 - gatsby-plugin-subfont@3.14.0
 - gatsby-plugin-twitter@3.14.0
 - gatsby-plugin-typescript@3.14.0
 - gatsby-plugin-typography@3.14.0
 - gatsby-plugin-utils@1.14.0
 - gatsby-react-router-scroll@4.14.0
 - gatsby-recipes@0.25.0
 - gatsby-remark-autolink-headers@4.11.0
 - gatsby-remark-code-repls@5.11.0
 - gatsby-remark-copy-linked-files@4.11.0
 - gatsby-remark-custom-blocks@3.14.0
 - gatsby-remark-embed-snippet@6.11.0
 - gatsby-remark-graphviz@3.11.0
 - gatsby-remark-images-contentful@4.11.0
 - gatsby-remark-images@5.11.0
 - gatsby-remark-katex@5.11.0
 - gatsby-remark-prismjs@5.11.0
 - gatsby-remark-responsive-iframe@4.11.0
 - gatsby-remark-smartypants@4.11.0
 - gatsby-source-contentful@5.14.0
 - gatsby-source-drupal@4.14.0
 - gatsby-source-faker@3.14.0
 - gatsby-source-filesystem@3.14.0
 - gatsby-source-graphql@3.14.0
 - gatsby-source-hacker-news@3.14.0
 - gatsby-source-lever@3.14.0
 - gatsby-source-medium@3.14.0
 - gatsby-source-mongodb@3.14.0
 - gatsby-source-npm-package-search@3.14.0
 - gatsby-source-shopify@5.6.0
 - gatsby-source-wikipedia@3.14.0
 - gatsby-source-wordpress@5.14.0
 - gatsby-telemetry@2.14.0
 - gatsby-transformer-asciidoc@2.14.0
 - gatsby-transformer-csv@3.14.0
 - gatsby-transformer-documentationjs@5.14.0
 - gatsby-transformer-excel@3.14.0
 - gatsby-transformer-hjson@3.14.0
 - gatsby-transformer-javascript-frontmatter@3.14.0
 - gatsby-transformer-javascript-static-exports@3.14.0
 - gatsby-transformer-json@3.14.0
 - gatsby-transformer-pdf@2.14.0
 - gatsby-transformer-react-docgen@6.14.0
 - gatsby-transformer-remark@4.11.0
 - gatsby-transformer-screenshot@3.14.0
 - gatsby-transformer-sharp@3.14.0
 - gatsby-transformer-sqip@3.14.0
 - gatsby-transformer-toml@3.14.0
 - gatsby-transformer-xml@3.14.0
 - gatsby-transformer-yaml@3.14.0
 - gatsby-worker@0.5.0
 - gatsby@3.14.0

* Preserve backlink/reference lookup tables in cache

* test

* fix bad merge

* try try again

* Improve log

* Get working with tests

Co-authored-by: GatsbyJS Bot <mathews.kyle+gatsbybot@gmail.com>
Co-authored-by: Vladimir Razuvaev <vladimir.razuvaev@gmail.com>
Co-authored-by: Krzysztof Szot <kszot@reference.be>
This was referenced Apr 15, 2024
Open
Open
Open
Open
@MaxMood96 MaxMood96 mentioned this pull request Apr 15, 2024
Open
This was referenced Apr 15, 2024
Open
Open
Open
Open
Open
Open
Open
Open
Open
Open
This was referenced Apr 15, 2024
Open
Open
This was referenced Apr 15, 2024
Open
Open
This was referenced Apr 15, 2024
Open
Open
Open
This was referenced Apr 15, 2024
Open
Open
Open
Open
@impactyogi impactyogi mentioned this pull request Apr 15, 2024
Open
@MaxMood96 MaxMood96 mentioned this pull request Apr 15, 2024
Open
This was referenced Apr 15, 2024
Open
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@wardpeet wardpeet wardpeet approved these changes

Assignees
No one assigned
Labels
topic: source-drupal Related to Gatsby's integration with Drupal type: bug An issue or pull request relating to a bug in Gatsby
Projects
No open projects
V3 Release Hotfixes
Published
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

gatsby-source-drupal: Incremental build breaks backlinks
4 participants
@KyleAMathews @wardpeet @vladar @kszot-ref